Bug 114272 - [macOS] Some Asian characters are garbled with western fonts.
Summary: [macOS] Some Asian characters are garbled with western fonts.
Status: RESOLVED WORKSFORME
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: LibreOffice (show other bugs)
Version:
(earliest affected)
5.4.3.2 release
Hardware: All macOS (All)
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords: bibisectRequest
Depends on:
Blocks: Font-Rendering CJK
  Show dependency treegraph
 
Reported: 2017-12-06 07:03 UTC by Kamei
Modified: 2022-08-22 23:30 UTC (History)
3 users (show)

See Also:
Crash report or crash signature:


Attachments
garbled.m4v (4.42 MB, video/x-m4v)
2017-12-07 08:07 UTC, Kamei
Details
garbled_sample.odt (8.67 KB, application/vnd.oasis.opendocument.text)
2017-12-07 08:10 UTC, Kamei
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Kamei 2017-12-06 07:03:30 UTC
Description:
Some Asian characters are garbled with western fonts.

Steps to Reproduce:
1. Create some new document. (ex. Writer document)
2. Set font including western character only. (ex. Arial)
3. Put Asian character. (ex. " あいうえお ")
4. Put special character. (ex. " ➀ ")
5. You can see some garbled characters.
6. Delete special character.
7. You can see not garbled characters.

Actual Results:  
Asian character like Japanese, Chinese and Korean is garbled.

Expected Results:
not garbled


Reproducible: Always


User Profile Reset: No


OpenGL enabled: Yes

Additional Info:
I think this issue is related with bug 106148 and bug 108042 .


Version: 5.4.3.2
Build ID: 92a7159f7e4af62137622921e809f8546db437e5
CPU threads: 8; OS: Mac OS X 10.11.6; UI render: GL; 
Locale: ja-JP (ja.UTF-8); Calc: group


User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:58.0) Gecko/20100101 Firefox/58.0
Comment 1 V Stuart Foote 2017-12-06 13:58:15 UTC
Sounds like a font fall back issue, standard Arial font does not include the CIRCLED NUMBERs or the Hiragana. But "Garbled" how? Please attach a few screen clips showing the issue.

Also, perhaps include a sample document we can consistently test against.

Otherwise can not reproduce on Windows 10 64-bit en-US with 
Version: 5.4.3.1 (x64)
Build ID: 32c8895c6cae21571f364dbb059f419a743ee44d
CPU threads: 4; OS: Windows 6.19; UI render: GL; 
Locale: en-US (en_US); Calc: group

On Windows, with Arial font selected, I get clean font fall back when doing an <Alt>+x conversion of the U+2469 interspersed with the hiragana text (also fall back) as clipped from line 3.
Comment 2 Kamei 2017-12-07 08:07:38 UTC
Created attachment 138260 [details]
garbled.m4v

Please take a look at attached movie file.
Comment 3 Kamei 2017-12-07 08:10:16 UTC
Created attachment 138261 [details]
garbled_sample.odt
Comment 4 Kamei 2017-12-07 08:32:29 UTC
I confirmed this issue is not occurred on my Windows 10(32bit) environment.

Version: 5.4.3.2
Build ID: 92a7159f7e4af62137622921e809f8546db437e5
CPU threads: 1; OS: Windows 6.2; UI render: default; 
Locale: ja-JP (ja_JP); Calc: group
Comment 5 Buovjaga 2017-12-19 19:15:51 UTC
I get the opposite result in macOS. The Arial circled one appears as a square. Everything else is fine.
On Linux, everything is fine, even the Arial circled one (I have Arial installed on Linux).

I see you have Render: GL. Try disabling Tools - Options - LibreOffice - View - Use OpenGL for all rendering

5.4.3.2, macOS 10.12.6

Arch Linux 64-bit
Version: 6.1.0.0.alpha0+
Build ID: c3764c6848bd5ce0bbea2a82bedc3f0d55f01dce
CPU threads: 8; OS: Linux 4.14; UI render: default; VCL: kde4; 
Locale: fi-FI (fi_FI.UTF-8); Calc: group threaded
Built on December 19th 2017
Comment 6 Kamei 2017-12-21 08:35:33 UTC
Thank you very much for your testing.
Though macOS 10.12 has installed Asian font like Hiragino,
I'm interested in why circled character is displayed as square on Finnish environment.

And I confirmed this issue is reproduced on English environment and OpenGL is off.
(I changed language setting to English on System Preference.)

Version: 6.0.0.0.beta2
Build ID: 13edaaa12f25de343fce136064e27da66c1c4fa4
CPU threads: 8; OS: Mac OS X 10.11.6; UI render: default; 
Locale: en-US (en.UTF-8); Calc: group threaded
Comment 7 Buovjaga 2017-12-21 09:09:58 UTC
The macOS locale is en-US (en_FI.UTF-8).
Comment 8 Kamei 2017-12-22 01:40:46 UTC
Buovjaga,
Thank you for tell your locale on macOS.
Maybe, this is the issue on macOS only because we confirm this issue is not reproduced on Windows and Linux.

Do me a favor if you have time, try ⌘ and/or ⌥ instead of circled number.
And please set the Arial font the text again after putting it just in case.
Are ⌘ and ⌥ still displayed as square and Is Hiragana (like あ) displayed still fine?
Comment 9 Buovjaga 2017-12-22 15:09:27 UTC
(In reply to Kamei from comment #8)
> Do me a favor if you have time, try ⌘ and/or ⌥ instead of circled number.
> And please set the Arial font the text again after putting it just in case.
> Are ⌘ and ⌥ still displayed as square and Is Hiragana (like あ) displayed
> still fine?

I pasted as unformatted text. ⌘ was square, but ⌥ was fine.
If I re-change the character to Arial, both the circled one and ⌘ become fine.
Comment 10 Kamei 2017-12-27 07:50:09 UTC
(In reply to Buovjaga from comment #9)

Thank you very much for testing.
Hiragana is displayed fine anyway, isn't it?

I create new macOS account which environment is very clean, then I tested those procedure.
But Hiragana is still displayed □ on typing with ⌘ and/or ⌥.
It occurs to me that this issue is caused by too much fonts that I installed additionally.
I'm trying to inspect more.
Comment 11 Alex Thurgood 2018-01-12 08:35:18 UTC
Testing against :

Version: 5.4.4.2
Build ID: 2524958677847fb3bb44820e40380acbe820f960
Threads CPU : 4; OS : Mac OS X 10.13.2; UI Render : par défaut; 
Locale : fr-FR (fr_FR.UTF-8); Calc: group


I couldn't reproduce when copy/pasting the Japanese characters as text. These characters were automatically converted to LiSungPro font in Writer. Changing the font to Hiragino made no difference. 

Trying to insert the "➀" character made no difference, whether in Arial or LiSungPro, or Hiragino.


However, I could reproduce the problem with the "⌘", when the default font was Arial. In this case, the font fallback fails and the borders of a square are displayed in stead.
Comment 12 Alex Thurgood 2018-01-12 08:38:57 UTC
Further testing shows that I can also confirm with a Hiragino or LiSungPro formatted string when I:

- select the string in Hiragino or LiSungPro and
- change the font to Arial

the impugned character, whether it be the "➀" or "⌘" is displayed as a square.

So, clearly a font fallback issue.
Comment 13 Alex Thurgood 2018-01-12 08:41:48 UTC
Jeez, I should reread what I write before posting or get some new specs !

Correction to my previous posts :

The "⌘" is always displayed correctly.
It is the "➀" that gets converted into a square.

Nonetheless, the buggy behaviour is reproduced.
Comment 14 Kamei 2018-01-19 02:34:02 UTC
(In reply to Alex Thurgood from comment #13)

Thank you so much for testing!!
Now the font I installed additionally is not the problem.

And I think bug106148 is very similar to this bug.
Comment 15 V Stuart Foote 2018-01-19 15:26:36 UTC
Attachments comment 2 and comment 3 show errant font fallback on OSX
Comment 16 ⁨خالد حسني⁩ 2018-04-27 04:48:46 UTC
Why is this marked as a blocker for bug 103729, Has any one bisected it?
Comment 17 Kamei 2019-01-22 06:51:14 UTC
I marked this issue is Blocker for bug 103729. 
Because I thought character rendering system may cause this.
But investigation was not comprehensive. 
So I remove Block tag in this moment.
Comment 18 eisa01 2020-05-03 11:34:34 UTC
I'm not seeing this problem, I tried typing with Hiragana and e.g., pressing © key

Do you still see this problem on a recent macOS and LO version?

Can you give step by step instruction in reproduing this, incl which keys to press on a Western keyboard layout? No clue how to produce ➀

The sample odt does however not render the ➀ on the first line, while TextEdit does.
TextEdit has this as ZapfDingbats, while LO has it as Arial

Version: 6.4.3.5
Build ID: 4db9852e73d9e9d662fc8a2783bace79addf1805
CPU threads: 4; OS: Mac OS X 10.14.6; UI render: default; VCL: osx; 
Locale: en-US (en_US.UTF-8); UI-Language: en-US
Calc: threaded
Comment 19 Kamei 2020-05-07 07:30:21 UTC
Thank you for your test.
I confirmed this issue is still occurred.

Procedure:
1. Create new Writer document
2. Put following the text '⌘あいうえお'
3. Select the text '⌘あいうえお'. Then change the font to 'Arial'
4. You will see garbled text.

バージョン: 6.4.3.2
Build ID: 747b5d0ebf89f41c860ec2a39efd7cb15b54f2d8
CPU threads: 16; OS:Mac OS X 10.15.4; UI render: GL; VCL: osx; 
ロケール: ja-JP (ja_JP.UTF-8); UIの言語: ja-JP
Calc: threaded
Comment 20 Kamei 2020-05-08 01:25:45 UTC
Sorry for forgetting put my macOS version.
macOS Catalina 10.15.4(19E287)

And you do not need to put '①' necessarily.
(For example, ⌘ or ⌥ instead ①, like above the post)
Comment 21 Volga 2021-05-19 17:36:36 UTC
(In reply to Kamei from comment #17)
> Because I thought character rendering system may cause this.
This is not related to font rendering system, but related to font fallback mechanism. I think LibreOffice need build new font fallback mechanism to fix this bug.
Comment 22 ⁨خالد حسني⁩ 2022-08-22 23:30:30 UTC
Can’t reproduce this with 7.3.5 on macOS. Please reopen if still reproducible on recent LibreOffice.