Bug 96588 - Very slow XLSX Pivot Table load ...
Summary: Very slow XLSX Pivot Table load ...
Status: RESOLVED FIXED
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
5.0.2.1 rc
Hardware: All All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard: target:5.2.0
Keywords:
: 96589 (view as bug list)
Depends on:
Blocks:
 
Reported: 2015-12-18 22:18 UTC by Michael Meeks
Modified: 2016-10-28 18:36 UTC (History)
1 user (show)

See Also:
Crash report or crash signature:


Attachments
pivot range test. (11.82 KB, application/vnd.openxmlformats-officedocument.spreadsheetml.sheet)
2015-12-19 10:35 UTC, Michael Meeks
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Michael Meeks 2015-12-18 22:18:09 UTC
With an XLSX pivot table - it is possible to base the data source on a range name. That range name can contain a very large range that is full of empty cells =) for example SheetFoo!$A:$Z.

Then as we fillTable on this we burn a huge amount of time iterating over ~1 million empty cells repeatedly looking up the same pointless (blank) information =)

Sadly a private example file, but no doubt reasonably easy to construct one.
Comment 1 Michael Meeks 2015-12-19 10:35:11 UTC
Created attachment 121397 [details]
pivot range test.

Takes ~30+ seconds to open for me, and ~25 seconds to refresh the (trivial) pivot =)
Comment 2 Commit Notification 2015-12-21 14:31:10 UTC
Michael Meeks committed a patch related to this issue.
It has been pushed to "master":

http://cgit.freedesktop.org/libreoffice/core/commit/?id=6833f382c5c8350256e97e2b342eb939a8c373ba

tdf#96588 - avoid redundant work on large numbers of trailing rows.

It will be available in 5.2.0.

The patch should be included in the daily builds available at
http://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More
information about daily builds can be found at:
http://wiki.documentfoundation.org/Testing_Daily_Builds

Affected users are encouraged to test the fix and report feedback.
Comment 3 Commit Notification 2015-12-22 17:32:42 UTC
Michael Meeks committed a patch related to this issue.
It has been pushed to "master":

http://cgit.freedesktop.org/libreoffice/core/commit/?id=cd945a000623838e96b7dd534ca618071c44995d

tdf#96588 - avoid redundant pivot cache filter on import.

It will be available in 5.2.0.

The patch should be included in the daily builds available at
http://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More
information about daily builds can be found at:
http://wiki.documentfoundation.org/Testing_Daily_Builds

Affected users are encouraged to test the fix and report feedback.
Comment 4 Timur 2015-12-24 12:35:54 UTC
Testing Bug 90129, I encountered on this one. That one is not solved, and this one looks like it is. Although I couldn't notice a difference on the attached file, of course.
Comment 5 MM 2016-01-04 22:56:01 UTC
*** Bug 96589 has been marked as a duplicate of this bug. ***
Comment 6 Timur 2016-10-28 18:36:39 UTC
I guess it should be closed.