Bug 39760 - severe performance issues graphing large amounts of data
Summary: severe performance issues graphing large amounts of data
Status: RESOLVED DUPLICATE of bug 36779
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Chart (show other bugs)
Version:
(earliest affected)
3.3.3 release
Hardware: Other All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-08-02 05:22 UTC by Diggory Hardy
Modified: 2013-05-01 02:10 UTC (History)
2 users (show)

See Also:
Crash report or crash signature:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Diggory Hardy 2011-08-02 05:22:26 UTC
When trying to plot lots of data in calc, performance is very bad (>2sec to select a chart, several seconds to create a new chart).

Reproduction is easy and has affected all versions of OO/LO I can remember using:
1. Open a spreadsheet containing several thousand rows of numerical data (1000 rows causes noticeable but not severe slowdowns when plotting, 7000 causes major problems).
2. Select a column of data and chart it (possibly line and XY graphs are slower than bar plots).
3. After finishing the plot wizard, deselect the new chart. It can take several seconds.

My machine's not slow either: intel i7 620M CPU, 4GB RAM. Increasing cache sizes in libreoffice's settings may help, but shouldn't be necessary IMO (LibreOffice should take reasonable guesses based on hardware and allow some objects to be quite large if necessary).

I don't know how many people this issue impacts, but personally I try to create quick plots of data up to around 10000 lines long fairly frequently.

Possible solutions:
* cache graph as bitmap and only redraw when necessary
* restrict the number of data-points used by previews to 1000 data-points or less (even with a very simple sampling algorithm such as taking every nth value can create good enough graphs for previewing setting changes, etc.)
* or maybe increasing cache and optimising code will be enough; I don't know what the bottleneck is
Comment 1 Jeffrey 2011-08-02 07:22:04 UTC
Failed to reproduce on LibreOffice 3.4  340m1(Build:103) for OpenSuse Linux. Created an 8000 rows long line graph chart, did not take longer to deselect, but maybe a 0.5 second delay.
Comment 2 Diggory Hardy 2011-08-02 08:17:26 UTC
Hmm. As a simple test, I started localc, created a sequence from 1 to 8xxx in one column, took the sin of this in the second column, then did an XY plot. After clicking finish on the wizard, it took a long time for the graph to appear (I waited 15 seconds or so then gave up).

Scrolling such that the chart comes on or goes off the screen is slow too.

Any ideas on the culprit: different version, different settings, different OS? I'm running debian testing, linux 3 kernel, KDE 4.6, but have had the same problem on older versions too.
Comment 3 m_a_riosv 2011-08-05 17:41:15 UTC
Could be a try with Menu/Tools/Options/LibreOffice/View - Anti-alising
Comment 4 Diggory Hardy 2011-08-13 02:23:58 UTC
Indeed, disabling anti-aliasing dramatically increases performance. The plot quality does suffer, but with large plots this is necessary and perhaps AA should only be used when printing (though even there it might cause problems). Perhaps AA should automatically be disabled on plots with more than a few hundred data points?
Comment 5 Björn Michaelsen 2011-12-23 12:23:50 UTC
[This is an automated message.]
This bug was filed before the changes to Bugzilla on 2011-10-16. Thus it
started right out as NEW without ever being explicitly confirmed. The bug is
changed to state NEEDINFO for this reason. To move this bug from NEEDINFO back
to NEW please check if the bug still persists with the 3.5.0 beta1 or beta2 prereleases.
Details on how to test the 3.5.0 beta1 can be found at:
http://wiki.documentfoundation.org/QA/BugHunting_Session_3.5.0.-1

more detail on this bulk operation: http://nabble.documentfoundation.org/RFC-Operation-Spamzilla-tp3607474p3607474.html
Comment 6 Diggory Hardy 2011-12-29 09:48:19 UTC
Just tried 3.5.0 beta 2 (debian packages). Still takes a minute or so to complete any action with an XY line graph of 2500 data points with antialiasing on. Turning off antialiasing makes it fast.
Comment 7 Thomas Arnhold 2013-05-01 02:10:15 UTC

*** This bug has been marked as a duplicate of bug 36779 ***