Bug 107528 - Hebrew text partially garbled since some Hebrew fonts are rendered as other Hebrew fonts
Summary: Hebrew text partially garbled since some Hebrew fonts are rendered as other H...
Status: RESOLVED NOTOURBUG
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: LibreOffice (show other bugs)
Version:
(earliest affected)
5.3.3.2 release
Hardware: All Linux (All)
: high major
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-04-30 08:31 UTC by Eyal Rozenberg
Modified: 2017-06-21 11:31 UTC (History)
2 users (show)

See Also:
Crash report or crash signature:


Attachments
Misrendering of David, Aharoni fonts in Writer (54.34 KB, application/pdf)
2017-04-30 08:31 UTC, Eyal Rozenberg
Details
Same text, rendered in Inkscape (20.53 KB, application/pdf)
2017-04-30 08:32 UTC, Eyal Rozenberg
Details
Same text, rendered in Inkscape (PNG) (23.59 KB, image/png)
2017-04-30 08:33 UTC, Eyal Rozenberg
Details
Misrendering of David, Aharoni fonts in Writer (PNG) (40.25 KB, image/png)
2017-04-30 08:36 UTC, Eyal Rozenberg
Details
The writer document used in the examples (10.00 KB, application/vnd.oasis.opendocument.text)
2017-04-30 08:36 UTC, Eyal Rozenberg
Details
Screenshot from Windows with correct rendering (74.08 KB, image/png)
2017-06-20 23:36 UTC, ⁨خالد حسني⁩
Details
PDF exported on Windows with correct rendering (35.38 KB, application/pdf)
2017-06-20 23:37 UTC, ⁨خالد حسني⁩
Details
Format-Character dialog for the misrendered David text (39.07 KB, image/png)
2017-06-21 08:34 UTC, Eyal Rozenberg
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Eyal Rozenberg 2017-04-30 08:31:52 UTC
Created attachment 132962 [details]
Misrendering of David, Aharoni fonts in Writer

I use Linux Mint 18.1, first with LO 5.1.62, now upgraded to 5.3.2.2 using the PPA. I also use many fonts which are not part of the distro, including Hebrew fonts.

Ever since installing I've been seeing an extremely annoying behavior: Some of these fonts are rendered as _another_ font - as though the app was getting the index wrong in some font table. Specifically, this happens for some of the "traditional" Hebrew fonts from MS Windows: David and Aharoni (but not all of them).

This doesn't happen with "David CLM" and "Aharoni CLM", which are just next to the fonts I mentioned in the font selection list. It also doesn't happen with other applications; I'll attach a PDF created in Inkscape to illustrate.

I'll mention I'm not entirely sure which font is actually used, so I can't - for now - locate those other fonts to report how they "reciprocate".

This does not happen on other systems I use or have used, including with very recent versions of LO.
Comment 1 Eyal Rozenberg 2017-04-30 08:32:24 UTC
Created attachment 132963 [details]
Same text, rendered in Inkscape
Comment 2 Eyal Rozenberg 2017-04-30 08:33:26 UTC
Created attachment 132965 [details]
Same text, rendered in Inkscape (PNG)
Comment 3 Eyal Rozenberg 2017-04-30 08:36:21 UTC
Created attachment 132966 [details]
Misrendering of David, Aharoni fonts in Writer (PNG)
Comment 4 Eyal Rozenberg 2017-04-30 08:36:40 UTC
Created attachment 132967 [details]
The writer document used in the examples
Comment 5 Buovjaga 2017-04-30 09:59:28 UTC
If you check the David and Aharoni font properties, are they "Type 1" by any chance? Type 1 fonts are no longer supported and fallback fonts are used instead.
Comment 6 Eyal Rozenberg 2017-04-30 10:17:23 UTC
I forgot to mention both Aharoni and David are Truetype fonts.

You can get them here:
https://fontzone.net/font-details/david
http://www.myfontfree.com/download-aharoni-zip60472.htm
Comment 7 Buovjaga 2017-04-30 11:01:50 UTC
Ok, I installed the fonts and confirm they are substituted by some others.

Khaled: what's the story with these 1991-1993 TrueType fonts?

Version: 5.4.0.0.alpha0+ (x64)
Build ID: e4f28aea21ce7e8f960cc2062f83715549be215e
CPU threads: 4; OS: Windows 6.19; UI render: default; 
TinderBox: Win-x86_64@62-TDF, Branch:MASTER, Time: 2017-04-25_02:04:15
Locale: fi-FI (fi_FI); Calc: group
Comment 8 Eyal Rozenberg 2017-04-30 11:42:46 UTC
I'll just emphasize that this did not always happen; on previous distro's I had installed on my desktop - with these fonts available from the same location (the Windows font folder which is mounted and part of the font path) - I would see the fonts I'm supposed to.
Comment 9 Eyal Rozenberg 2017-04-30 11:44:33 UTC
I'll also mention that David was the default font for Hebrew documents on Windows for decades; and Israeli courts and the legislature use it documents they publish. So it's a really big deal that LO messes it up.
Comment 10 Buovjaga 2017-04-30 12:00:29 UTC
(In reply to Eyal Rozenberg from comment #9)
> I'll also mention that David was the default font for Hebrew documents on
> Windows for decades; and Israeli courts and the legislature use it documents
> they publish. So it's a really big deal that LO messes it up.

Well I understand Israeli government has some LibreOffice project/migration going on, so they could probably come up with a solution.
Comment 11 Eyal Rozenberg 2017-04-30 12:10:28 UTC
(In reply to Buovjaga from comment #10)

> Well I understand Israeli government has some LibreOffice project/migration
> going on, so they could probably come up with a solution.

Well, maybe. But the government also has a project to build a subway in Tel Aviv. It has only taken them 35 years so far and scheduled to be concluded by 2022. If the corruption charges don't slow that down even more. So... I wouldn't bank on the Israeli government solving it.

More seriously, though, the government is very much into Microsoft's products, and even though I also remember the ministry of finance sponsored something related to LO (when it was still just OpenOffice) - there's nobody to talk to that I know of. MS Word still reigns supreme.
Comment 12 Eyal Rozenberg 2017-06-19 21:55:42 UTC
I want to stress
Comment 13 Eyal Rozenberg 2017-06-19 21:57:51 UTC
I would like to ask that the severity of this issue be increased. It becomes nigh-impossible to edit many documents, as one can't simply change the fonts of all text; numbering, footnote references, text with a combination of many styles and fonts etc. requires painstaking corrections. What's more, collaboration with people using Word becomes very difficult, again if not impossible, since the typical Hebrew fonts used on Windows are among those that are rendered as other fonts and garbled (e.g. David).
Comment 14 ⁨خالد حسني⁩ 2017-06-20 23:35:00 UTC
Both are proprietary fonts and these sites are distributing them illegally, so I’m not going to look into them.

The document renders and exports to PDF correctly on Windows (which has these fonts), so there is no bug here. I suggest the reporter obtain up to date version of the fonts (hopefully legally), since whatever he is downloading from these dubious sites seems to be seriously broken.
Comment 15 ⁨خالد حسني⁩ 2017-06-20 23:36:25 UTC
Created attachment 134171 [details]
Screenshot from Windows with correct rendering
Comment 16 ⁨خالد حسني⁩ 2017-06-20 23:37:15 UTC
Created attachment 134172 [details]
PDF exported on Windows with correct rendering
Comment 17 Eyal Rozenberg 2017-06-21 08:30:26 UTC
Khaled,

* Those fonts are just an example of the problem. I chose them because they are two of the, say, six or so most popular fonts in use for writing Hebrew in MS Office / LibreOffice . So even without access to them - it could be various other fonts. Now it is true that not all fonts behave like this, and it could very well be some bug in font-loading-related code (since fonts are being mixed up
* The legal situation in different states in the world is different; and Millions of Hebrew users have legal rights to be using these fonts
* Even in the US context (which I'm assuming you're referring to though I could be wrong) - I am certain that you using these files in order to resolve this issue is covered by "fair use" (e.g. as described here: https://en.wikipedia.org/wiki/Fair_use )
* Even given what you've said, the outcome should be restricting the platform to Linux rather than closing as WFM.
Comment 18 Eyal Rozenberg 2017-06-21 08:34:20 UTC
Created attachment 134181 [details]
Format-Character dialog for the misrendered David text

If your cursor is on the misrendered David text in the example document, and you navigate to Format|Character... on the menu, you find that the "Style" for the "David" font is "Amra Hebrew". There is no such style obviously and it's not on the drop-down list - which has Normal, Bold, Italic and Bold Italic.
Comment 19 Buovjaga 2017-06-21 09:06:36 UTC
(In reply to Eyal Rozenberg from comment #17)
> * The legal situation in different states in the world is different; and
> Millions of Hebrew users have legal rights to be using these fonts
> * Even in the US context (which I'm assuming you're referring to though I
> could be wrong) - I am certain that you using these files in order to
> resolve this issue is covered by "fair use" (e.g. as described here:
> https://en.wikipedia.org/wiki/Fair_use )

Eyal, no.. just no. Please never do this again, linking to some font warez sites.

I am closing this as NOTOURBUG due to the proprietary fonts in question.

If you find some free fonts, you can open a new report and CC us to it. It is better to have a fresh report anyway as this has so many comments (reading takes time and time is money).
Comment 20 Eyal Rozenberg 2017-06-21 10:31:17 UTC
(In reply to Buovjaga from comment #19)

You're conflating the fonts I used in an example with a bug that _is_ LibreOffice. 

* A font (regardless if its proprietary or not) cannot in itself make LO use another, unrelated font in its stead (unless its a proper substitution).
* LO choosing a "font style" which is not one of the styles it acknowledges as existing cannot be an issue with the font itself - even if the font was totally corrupt and unusable.
* If the same font results in reasonable behavior on Windows but not on Linux, with older versions but not with newer ones - it's not (or not only) an issue with the font.

so it is not a "NOTOURBUG".

Again, if you don't like the fonts I used for the example - fine, just declare that you can't reproduce it for reasons of intellectual property rights. That just means it's difficult to investigate the bug, that's all. 

If you want to open the bug again without the links and with the same priority and severity - please do so. I'll try to find other examples, but it's not so easy, since there's a correlation between what the font files are like (and what behavior they trigger in LO) and their legal status.
Comment 21 Eyal Rozenberg 2017-06-21 10:52:23 UTC
It is inappropriate to alter a bug's state in the middle of a discussion about what the state should be, before the discussion is concluded - and that was your second-last change. Now it's resorting to aggression when your argument after your argument has been rebutted. Please stop.
Comment 22 Buovjaga 2017-06-21 10:58:54 UTC
(In reply to Eyal Rozenberg from comment #21)
> It is inappropriate to alter a bug's state in the middle of a discussion
> about what the state should be, before the discussion is concluded - and
> that was your second-last change. Now it's resorting to aggression when your
> argument after your argument has been rebutted. Please stop.

No argument has been rebutted. Please stop reverting the status change. Do like I said in comment 19. If you do not stop, I will ask our QA engineer to put a stop to this, if you want multiple people to confirm the closing.
Comment 23 ⁨خالد حسني⁩ 2017-06-21 11:31:59 UTC
There is no issue with the fonts, they work on Windows and should work on Linux. There is an issue with your version of the fonts, which seems to be seriously broken, but these are copies of unknown origin and illegally distributed so there is no point in even trying to debug the issue.

If you can reproduce the issue with other fonts, please report that.