Bug 64914 - FILEOPEN: Libreoffice freezes importing a file containing a chart with large data source
Summary: FILEOPEN: Libreoffice freezes importing a file containing a chart with large ...
Status: NEW
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Chart (show other bugs)
Version:
(earliest affected)
3.6.7.2 release
Hardware: All All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard: target:7.4.0
Keywords: haveBacktrace, perf
Depends on:
Blocks: Chart
  Show dependency treegraph
 
Reported: 2013-05-23 12:40 UTC by Xisco Faulí
Modified: 2024-11-11 10:51 UTC (History)
5 users (show)

See Also:
Crash report or crash signature:


Attachments
sample with 66000 points in the chart (1.85 MB, application/vnd.ms-excel)
2013-05-23 12:40 UTC, Xisco Faulí
Details
Callgrind with 5.3 (6.89 MB, application/x-xz)
2016-07-18 18:27 UTC, Buovjaga
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Xisco Faulí 2013-05-23 12:40:08 UTC
Created attachment 79703 [details]
sample with 66000 points in the chart

Description from #i121058 (https://issues.apache.org/ooo/show_bug.cgi?id=121058):
Open the sample file with large chart, it takes too much time on loading, looks like freeze. And sometimes a warning dialog pops up with warning msg "Main memory shortage. Please quit other applications or close some windows before continuing.", click "OK" button on this dialog, then pops up an error dialog and AOO crashes.

AOO solution isn't that good because it only works for numeric data, not for text data. Besides, as Kohei suggested, it should be done in the chart engine, not in calc
Comment 1 Thomas van der Meulen [retired] 2013-05-26 08:27:00 UTC
Thank you for your bug report, I can reproduce this bug running libreoffice Version: 4.1.0.0.beta1
Build ID: 3a2c2d2417101e45fe07cfd8358acf2204a98f3 on Mac osx 10.8.3 
and version 4.0.3.3.

Loading does take like 2 minute and I get the spinning wheel on my mac. 
Wen I look at my system use LibreOffice uses 98.9% of my cpu. after loading just 0.2%
Comment 2 Kevin Suo 2014-07-12 14:32:07 UTC
It's the same problem with version 3.6.7.2. May be from Aoo?

I am wondering how this chart was created, as when I was trying to create a chart from data which contains 10K+ rows, it's really slow, and when you try to rezise the chart, calc will freeze.

Also, when attachment 79703 [details] finished loading finally in Calc, if you scroll, there is secious lag/delay. There is a saperate bug report regard this issue: Bug 81230. I added as see also.
Comment 3 QA Administrators 2015-07-18 17:43:01 UTC Comment hidden (obsolete)
Comment 4 Xisco Faulí 2015-07-21 08:14:45 UTC
This issue is still reproducible with Version: 4.4.4.3
Build ID: 2c39ebcf046445232b798108aa8a7e7d89552ea8.
It took me 3 minutes and 10 seconds to open the file under Window 7
Comment 5 Buovjaga 2016-07-18 09:21:31 UTC
Yeah, freezy, but not entirely. Should probably try a callgrind on Linux later..

Win 7 Pro 64-bit Version: 5.3.0.0.alpha0+
Build ID: 28ac6fdc11559b58ac62089300aa99530b0b822d
CPU Threads: 4; OS Version: Windows 6.1; UI Render: default; 
TinderBox: Win-x86@42, Branch:master, Time: 2016-07-18_02:54:20
Locale: fi-FI (fi_FI); Calc: CL
Comment 6 Buovjaga 2016-07-18 18:27:16 UTC
Created attachment 126287 [details]
Callgrind with 5.3

Callgrind of opening the file an scrolling just a little bit.

Arch Linux 64-bit, KDE Plasma 5
Version: 5.3.0.0.alpha0+
Build ID: ab1b351840160655a9f0caedbb35e9fdf203c5a0
CPU Threads: 8; OS Version: Linux 4.6; UI Render: default; 
Locale: fi-FI (fi_FI.UTF-8); Calc: group
Built on July 16th 2016
Comment 7 Xisco Faulí 2017-03-25 16:43:14 UTC
In

Version: 5.4.0.0.alpha0+
Build ID: 193f8966135064a32164c9da08d01dab9c1fc15d
CPU threads: 4; OS: Linux 4.8; UI render: default; VCL: gtk2; 
Locale: ca-ES (ca_ES.UTF-8); Calc: group

it takes

real	0m48.947s
user	0m32.280s
sys	0m1.480s

approximately.
I think we can delete the crask work from the summary.
Comment 8 QA Administrators 2018-05-11 02:33:27 UTC Comment hidden (obsolete)
Comment 9 Xisco Faulí 2020-03-25 14:51:39 UTC
it takes

real	0m30,883s
user	0m21,790s
sys	0m0,984s


in

Version: 7.0.0.0.alpha0+
Build ID: 9163755e9f64a0b1dd5f2090e0702c19e31c12c9
CPU threads: 4; OS: Linux 4.19; UI render: default; VCL: gtk3; 
Locale: en-US (en_US.UTF-8); UI-Language: en-US
Calc: threaded

I think we can reduce its priority
Comment 10 Buovjaga 2021-11-06 14:24:50 UTC
30 sec stopwatch time here

Version: 7.3.0.0.alpha1+ (x64) / LibreOffice Community
Build ID: 5c5f36aa73b11356a3bff0a9cc8b5fe8d1a776b9
CPU threads: 2; OS: Windows 10.0 Build 19042; UI render: default; VCL: win
Locale: fi-FI (fi_FI); UI: en-US
Calc: threaded
Comment 11 Roman Kuznetsov 2022-01-07 15:17:25 UTC
32 sec (Intel Core2Quad 9450) in

Version: 7.4.0.0.alpha0+ (x64) / LibreOffice Community
Build ID: 1be170d0629cf761f0ee4173007a3c021966546e
CPU threads: 4; OS: Windows 6.1 Service Pack 1 Build 7601; UI render: Skia/Raster; VCL: win
Locale: ru-RU (ru_RU); UI: en-US
Calc: CL
Comment 12 Commit Notification 2022-02-22 07:08:25 UTC
Noel Grandin committed a patch related to this issue.
It has been pushed to "master":

https://git.libreoffice.org/core/commit/56cd3b2b5d395165cd4add2f46ac4ba25a4ea4af

tdf#64914 slow opening large chart

It will be available in 7.4.0.

The patch should be included in the daily builds available at
https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More
information about daily builds can be found at:
https://wiki.documentfoundation.org/Testing_Daily_Builds

Affected users are encouraged to test the fix and report feedback.
Comment 13 Commit Notification 2022-02-22 10:40:08 UTC
Noel Grandin committed a patch related to this issue.
It has been pushed to "master":

https://git.libreoffice.org/core/commit/06b7f930a51d396bf9e3b6b8d0b3fcbd034730b4

tdf#64914 small improvements

It will be available in 7.4.0.

The patch should be included in the daily builds available at
https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More
information about daily builds can be found at:
https://wiki.documentfoundation.org/Testing_Daily_Builds

Affected users are encouraged to test the fix and report feedback.
Comment 14 Commit Notification 2022-02-23 11:51:18 UTC
Noel Grandin committed a patch related to this issue.
It has been pushed to "master":

https://git.libreoffice.org/core/commit/cf201db990e8973f801ba6c44f74605330a4af74

tdf#64914 elide some dynamic_cast

It will be available in 7.4.0.

The patch should be included in the daily builds available at
https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More
information about daily builds can be found at:
https://wiki.documentfoundation.org/Testing_Daily_Builds

Affected users are encouraged to test the fix and report feedback.
Comment 15 Roman Kuznetsov 2022-03-01 21:34:04 UTC
(In reply to Roman Kuznetsov from comment #11)
> 32 sec (Intel Core2Quad 9450) in
> 
> Version: 7.4.0.0.alpha0+ (x64) / LibreOffice Community
> Build ID: 1be170d0629cf761f0ee4173007a3c021966546e
> CPU threads: 4; OS: Windows 6.1 Service Pack 1 Build 7601; UI render:
> Skia/Raster; VCL: win
> Locale: ru-RU (ru_RU); UI: en-US
> Calc: CL

Today it took only 18 sec on the same hardware in

Version: 7.4.0.0.alpha0+ (x64) / LibreOffice Community
Build ID: 2c6f5ebfe69c3031af7b4903637226bd8a3dde62
CPU threads: 4; OS: Windows 6.1 Service Pack 1 Build 7601; UI render: Skia/Raster; VCL: win
Locale: ru-RU (ru_RU); UI: ru-RU
Calc: CL Jumbo

MS Excel 2007 opens it for 5 sec, btw
Comment 16 Xisco Faulí 2022-03-02 10:47:30 UTC
(In reply to Roman Kuznetsov from comment #15)
> (In reply to Roman Kuznetsov from comment #11)
> > 32 sec (Intel Core2Quad 9450) in
> > 
> > Version: 7.4.0.0.alpha0+ (x64) / LibreOffice Community
> > Build ID: 1be170d0629cf761f0ee4173007a3c021966546e
> > CPU threads: 4; OS: Windows 6.1 Service Pack 1 Build 7601; UI render:
> > Skia/Raster; VCL: win
> > Locale: ru-RU (ru_RU); UI: en-US
> > Calc: CL
> 
> Today it took only 18 sec on the same hardware in
> 
> Version: 7.4.0.0.alpha0+ (x64) / LibreOffice Community
> Build ID: 2c6f5ebfe69c3031af7b4903637226bd8a3dde62
> CPU threads: 4; OS: Windows 6.1 Service Pack 1 Build 7601; UI render:
> Skia/Raster; VCL: win
> Locale: ru-RU (ru_RU); UI: ru-RU
> Calc: CL Jumbo
> 
> MS Excel 2007 opens it for 5 sec, btw

Hi Roman,
What's the time if you don't use Jumbo sheets ?
Comment 17 Roman Kuznetsov 2022-03-02 11:10:17 UTC
(In reply to Xisco Faulí from comment #16)
 
> Hi Roman,
> What's the time if you don't use Jumbo sheets ?

it took absolutely the same time
Comment 18 QA Administrators 2024-03-02 03:15:49 UTC Comment hidden (obsolete)
Comment 19 Buovjaga 2024-11-11 10:51:56 UTC
What I see now on Linux is that kf6 and especially gtk3 remain slow to respond to arrow keys after opening (kf6 became snappy after like 1min 30sec). Gen backend responds to arrow keys very soon after opening. All backends are slow to update the view when scrolling. We do have many reports about slow scrolling with complex objects, though. So maybe we should close this as fixed as it has commits.

Xisco and Roman could test and give their opinions.

Arch Linux 64-bit
Version: 25.2.0.0.alpha0+ (X86_64) / LibreOffice Community
Build ID: 80cda6954adc88eac3b99171acafea004976915b
CPU threads: 8; OS: Linux 6.11; UI render: default; VCL: kf6 (cairo+wayland)
Locale: fi-FI (fi_FI.UTF-8); UI: en-US
Calc: CL threaded
Built on 11 November 2024