Bug 92197 - Slow performance of Calc with filter set
Summary: Slow performance of Calc with filter set
Status: RESOLVED WORKSFORME
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
5.0.3.2 release
Hardware: Other Linux (All)
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2015-06-20 05:18 UTC by Robert Gonzalez MX
Modified: 2016-08-06 07:51 UTC (History)
5 users (show)

See Also:
Crash report or crash signature:


Attachments
Test file for slow performance (73.74 KB, application/vnd.oasis.opendocument.spreadsheet)
2015-06-20 14:17 UTC, Robert Gonzalez MX
Details
screenshoot of Option View Graphic Output (132.28 KB, application/vnd.oasis.opendocument.text)
2015-06-21 01:52 UTC, Robert Gonzalez MX
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Gonzalez MX 2015-06-20 05:18:48 UTC
Tested LibreOfficeDev 5.0 Beta3 on Windows XP SP3
RAM at 50% of 4 GB
cpu Intel core 2 Duo at 2% to 4%

AutoFilter
Opening filter list doesn't display the selections, it needs to scroll the list to display properly. Selecting the All option, at first works well, but after the first operation, it began to work slow, not refreshing in the display. Guessing and applying the filter, performs slow when there are many elements (but not too many), but, this doesn't happen in calc 4.4.
When filter is applied, entering data in the cells doesn't display until scrolling the view or changing between applications.

changing between spreadsheets with ctrl – page up or ctrl – page down is slow, and after changing 3 or 4 spreadsheets, it hangs from 4 to 7 seconds and then displays.

Erasing the content of a cell, with the delete key, doesn't erase it, as it was waiting or pending for some refreshing of the spell checker.

Pasting to a cell, doesn't display contents until scrolling the spreadsheet with mouse, moving the cursor does not refresh or display the cell contents, unless the whole area scrolls.

When scrolling the cells, with page up or page down keys, it took 9 seconds to refresh the automatic spell checking 

Testing on Windows 8 with Version: 5.0.0.0.beta3
Build ID: 96345c15d8ab19c49014f055fe41ba8e1f421e5c
Locale: es-MX (es_MX)

Performs the same.

Its more visible when changing between spreadsheets with ctrl – page up or ctrl – page down, after changing 3 or 4 spreadsheets, it hangs from 4 to 7 seconds and then displays the spreadsheet cells content.
Comment 1 m_a_riosv 2015-06-20 13:32:34 UTC Comment hidden (obsolete)
Comment 2 Robert Gonzalez MX 2015-06-20 14:17:15 UTC
Created attachment 116680 [details]
Test file for slow performance
Comment 3 Robert Gonzalez MX 2015-06-20 14:24:53 UTC
I am attaching a test file.

it has a parameters sheet and a movements sheet

the movements sheet has 3600 rows and in some columns it has valdity referencing the parameters sheet.

it has also a VLOOKUP function to obtain some data from the parameters sheet based on the date.

I changed the language from spanish to english and what i noticed is that the spell checking delays up to 9 seconds to display the red waving underlines.

In some cases when moving around on the cells, in the input bar doesn't display the contents, formula or text.
Comment 4 m_a_riosv 2015-06-20 16:31:53 UTC
I can't reproduce your delays with:
Win7x64Ultimate
Version: 5.1.0.0.alpha1+ Build ID: d56b125f6c6c18ac40712cefc3cec06530750e15
TinderBox: Win-x86@39, Branch:master, Time: 2015-06-13_07:08:43

Maybe the first thing to try is resetting the user profile.
https://wiki.documentfoundation.org/UserProfile

Also e.g. VLOOKUP()s can be replaced with TEXT() function to get the month name.
K2: =TEXT(A2;"MMMM")
Comment 5 Robert Gonzalez MX 2015-06-20 22:48:23 UTC
Ok.
I have reseted the user profile in my laptop with Windows 8, but still teh same performance.

By the way, the same behavior is present in a desktop pc with windows XP SP3.

So i think that is not probable that the same problem is present in two different, but I leave it for if there is anyone else with this.
Comment 6 m_a_riosv 2015-06-20 23:33:52 UTC
Please test if the changing the options:
Menu/Tools/LibreOffice/View - Graphics output
change something.
Comment 7 Robert Gonzalez MX 2015-06-21 01:51:55 UTC
I have compared the options graphics output en LO 4.4.3.2 and LO 5.0.0.0 beta3, and are identical, but en LO 4.4 it performs as expected. see attachment.

Then changed the options graphics output one by one, but still, hangs changing from one sheet to another, for about 5-7 seconds.

What I do to reproduce is change from one sheet to another, using the ctrl-page up and ctrl-page down, repeatedly. With version 4.4.3.2 it performs fast and normal. With version 5, it hangs.

So I try turning off the automatic spell checking, and the problem was gone.

Then, turn it on again, and the problem went back.

Maybe it has something to do with the spell checking.
Comment 8 Robert Gonzalez MX 2015-06-21 01:52:39 UTC
Created attachment 116693 [details]
screenshoot of Option View Graphic Output
Comment 9 m_a_riosv 2015-06-21 12:31:48 UTC
There is a portable version to test.

https://www.libreoffice.org/download/portable-versions/
Comment 10 Fabio 2015-11-06 10:25:35 UTC
Hi, 

I`m trying to work with a database that has over than 4 milion cells (800K lines and 5 coluns) but the performance of the software is bellow from the competitor to the same database.

My PC`s configuration is?

Memory: 7.7GiB
Processor: Intel® Core™ i7-3632QM CPU @ 2.20GHz × 8 
Graphycs: Intel® Ivybridge Mobile
Type of SO: 64-bit
Disk: 976,1 GB

Is there some configuration that I could change to get a better performance ?

Thanks for help.
Comment 11 jean-mathieu.deschenes 2015-12-10 16:12:00 UTC
I saw very similar issue on my computer with LibreOffice 5.0.3 on Ubuntu 14.04

I am usually working with decently sized spreadsheets(~50 column, ~20k rows) and and it is really hard to get anything done with this problem.

I can confirm that the removing the Spell Checker features made it run a lot smoother.

Let me know if you want more information.
Comment 12 Cor Nouws 2016-03-01 07:46:39 UTC
@Miguel:

What do you think of https://bugs.documentfoundation.org/show_bug.cgi?id=95414#c3
(from  Beluga )
> I had no problem with filling down J2:M2. Didn't have to reopen.
> 
> I did notice some lag with the autofilter steps after doing it a couple of
> times. I also confirm that after editing any value or string while having
> filtered, I have to scroll away and back to see the change.
Comment 13 Cor Nouws 2016-03-01 07:51:17 UTC
Can people involved here maybe please test a recent daily build
  http://dev-builds.libreoffice.org/daily/master/
because of the fix for bug 91307
  (to be backported to 5.0 and 5.1 hopefully)

Thanks!
Cor
Comment 14 m_a_riosv 2016-03-01 22:42:41 UTC
@Cor, I have no problem with this one neither with #95414
Win10x64
Version: 5.0.5.2 (x64) Build ID: 55b006a02d247b5f7215fc6ea0fde844b30035b3
Version: 5.2.0.0.alpha0+
Build ID: 85fcf15ff41ceb95f46dee586ff7187551be4955
CPU Threads: 4; OS Version: Windows 6.19; UI Render: GL; 
TinderBox: Win-x86@39, Branch:master, Time: 2016-02-27_09:23:38
Comment 15 Robert Gonzalez MX 2016-03-02 21:37:35 UTC
Problem not present anymore with the test file and other files with +35,000 rows

Version: 5.1.1.0.0+
Build ID: fdf698bef5bf25c2a10e2b8ddb1955143cd3f227
CPU Threads: 8; OS Version: Windows 6.2; UI Render: default; 
TinderBox: Win-x86@62-merge-TDF, Branch:libreoffice-5-1, Time: 2016-02-04_13:51:00
Locale: es-MX (es_MX)

Version: 5.1.1.1 (RC1)
Build ID: c43cb650e9c145b181321ea547d38296db70f36e
CPU Threads: 8; OS Version: Windows 6.2; UI Render: default; 
Locale: es-MX (es_MX)
Comment 16 Cor Nouws 2016-03-02 23:07:04 UTC
Thanks Robert and Miguel

Since as far as we can see the fix for bug 91307 is not yet pushed to 5.1 / 5.0, we can only resolve this as WorksForMe