Bug 119606 - PDF: Arabic text gets deformed when creating a PDF in LibreOffice Writer
Summary: PDF: Arabic text gets deformed when creating a PDF in LibreOffice Writer
Status: NEW
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Printing and PDF export (show other bugs)
Version:
(earliest affected)
5.4.6.2 release
Hardware: x86-64 (AMD64) Linux (All)
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: PDF-Export
  Show dependency treegraph
 
Reported: 2018-08-30 12:25 UTC by vaaydayaasra
Modified: 2019-10-07 15:55 UTC (History)
1 user (show)

See Also:
Crash report or crash signature:


Attachments
PDF created with LO 5.4.6.2 where textual content is garbled (10.56 KB, application/pdf)
2018-08-30 12:26 UTC, vaaydayaasra
Details

Note You need to log in before you can comment on or make changes to this bug.
Description vaaydayaasra 2018-08-30 12:25:49 UTC
Description:
Creating a PDF from a document written in the Arabic script deforms the textual content of the document, although it looks fine on the screen.

For example, see the attached PDF created with Writer 5.4.6.2 on Ubuntu 17.10, where the example sentence "اشترى بلال خمسة آلاف كتاب وَأَنَا اشْتَرَيْتُهَا مِنْهُ" looks as it should, but when you view it with any PDF reader, such as evince, copying the text deforms most of the words. Some characters are clearly visible but cannot be selected or searched (such as ى at the end of the first word اشترى). If I search for the second word بلال, evince tells me there are no matches in the document. The same happens when converting the file with pdftotext, which produces the following output:

اشتر

للا مسة لفا كتاب وَأَنَا ْ
ه
اشت َ َريْتُهَا ِ
من ْ ُ

Here only two of the eight words are intact, the rest are garbled in one way or another. If the text is in Latin script, both evince and pdftotext behave as expected, meaning that the textual content is transferred correctly from Writer to the PDF.

On LO 6.0.3.2 on Ubuntu 18.04, the textual content is preserved a little better but it is still quite garbled. This is the output from pdftotext:

ه
اشترى للا خمسة آفا كتاب وَأنَا اشْ ت َ َريْتُهَا ِ
من ْ ُ

Here four out of the eight words are intact, and for example the last word of the sentence is divided so that the last full character is found on the first line and the rest on the third line. Some diacritics are found where they are supposed to be, some others not.

MS Word 2007 handles this case better, although it's not perfect either. This is the output from pdftotext:

اشترى بالل خمسة آالف كتاب وأنا اشتريتها منه

Here all diacritics are dropped and all sequences of ل (U+0644) + ا (U+0627) are reversed turning لا into ال. Otherwise the sentence is intact.

This bug was first reported on Launchpad for LO 5.4.6.2 on Ubuntu 17.10 at: https://bugs.launchpad.net/ubuntu/+source/libreoffice/+bug/1772439 . After my initial report, I have upgraded to LO 6.0.3.2 where the problem persists, although the actual output is different. Another user on Launchpad confirmed the bug on LO 6.0.3.2, as well.

Steps to Reproduce:
1. In a new Writer document, type some text in Arabic. My example sentence was: اشترى بلال خمسة آلاف كتاب وَأَنَا اشْتَرَيْتُهَا مِنْهُ
2. Create a PDF.
3. Open the created PDF with a PDF reader (such as evince) and type one of the words in the Search dialog, e.g. بلال. Alternatively select the word in the PDF reader and copy-paste it somewhere else. You can also convert the PDF to text using a utility like pdftotext.

Actual Results:
The PDF reader reports there are no matches for some of the words in the document, although they are all clearly visible. Selecting and copy-pasting the word garbles it. Pdftotext's output is garbled.

Expected Results:
All the words that are visible should also be searchable in a PDF reader, copy-pasting should preserve the text, and the output of pdftotext should match the original document.


Reproducible: Always


User Profile Reset: No



Additional Info:
Comment 1 vaaydayaasra 2018-08-30 12:26:47 UTC
Created attachment 144554 [details]
PDF created with LO 5.4.6.2 where textual content is garbled
Comment 2 Buovjaga 2018-09-23 15:50:15 UTC
Repro. Can only successfully search with individual glyphs in PDF

Arch Linux 64-bit
Version: 6.2.0.0.alpha0+
Build ID: 8b1501d80dc9d3f42c351c6e026fa737e116cae5
CPU threads: 8; OS: Linux 4.18; UI render: default; VCL: gtk3_kde5; 
Locale: fi-FI (fi_FI.UTF-8); Calc: threaded
Built on 23 September 2018
Comment 3 QA Administrators 2019-09-24 03:09:47 UTC Comment hidden (obsolete)
Comment 4 vaaydayaasra 2019-10-07 15:55:37 UTC
Still reproducible on:

Version: 6.3.2.2
Build ID: libreoffice-6.3.2.2-snap1
CPU threads: 4; OS: Linux 4.15; UI render: default; VCL: gtk3; 
Locale: fi-FI (fi_FI.UTF-8); UI-Language: en-US
Calc: threaded

pdftotext's output is again different from my initial report but it's still garbled:

أ
ه
ن
ا م
ه
ت
ي
ر
ا اشْت
و ن
اشترى بالل خمسة آالف كتاب َ

This time the beginning of the sentence (found on the last line of the output) is already quite good, though ل and ا in the ligature لا are reversed. Thus on evince بالل matches بلال. The end of the sentence where there are diacritical vowel marks is worse than in my initial report.