Bug 149526 - Calc Pivot Table where the range includes many empty rows takes 30 minutes and 9GB of Ram before crashing
Summary: Calc Pivot Table where the range includes many empty rows takes 30 minutes an...
Status: RESOLVED WORKSFORME
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
7.2.7.2 release
Hardware: x86-64 (AMD64) Windows (All)
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: Pivot-Table
  Show dependency treegraph
 
Reported: 2022-06-11 18:04 UTC by Colin
Modified: 2022-10-04 21:00 UTC (History)
3 users (show)

See Also:
Crash report or crash signature:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Colin 2022-06-11 18:04:18 UTC
I'm no expert but having failed four times with LO I tried Excel and the result was impeccable - leads me to believe it's a LO bug.
I have a sheet with 2500 rows and perhaps 20 columns - only 8 of the columns are in the Pivot Table array
Some of the cells are VLOOKUP() results, some are "same row" calculations
All columns are autofiltered.
993 rows are populated and the remaining empty rows contain formulae checking for "source" cells. Empty source cells will generate "forced null" results where appropriate.
If I define the pivot table array as including the 1507 empty rows then LO meanders its way through 9 of 12gB of memory and I suspect the crash (which occurs around 30 minutes after initiation) coincides with the requirement to use a paging file - I'm not sure if this is "memory leakage" I read about in bug100244.
All other open processes become unstable and the only remedy is to kill them through Task Manager. Sometimes it works, other times I have to reboot the PC. The "unstable" processes will often still require activating and closing down - following the restart - before they stabilise.
If I define the pivot table array exclusively as the populated rows then I get a pivot table within a few moments.
As I mentioned, Excel has no problem with the empty rows which satisfied me that it's not just my inexperience with pivot tables.
I imagine you have more than your fair share of sample sheets accompanying all the reports in hand, if you need me to submit mine then I can easily anonymise the data.

Version: 7.2.7.2 (x64) / LibreOffice Community
Build ID: 8d71d29d553c0f7dcbfa38fbfda25ee34cce99a2
CPU threads: 4; OS: Windows 10.0 Build 19043; UI render: Skia/Raster; VCL: win
Locale: sv-SE (en_GB); UI: en-GB
Calc: threaded
Comment 1 Rafael Lima 2022-06-14 15:08:44 UTC
Hi Colin, can you try with a more recent version of LO? The current fresh branch is in 7.3.4. You can also try 7.4 beta / 7.5 alpha.

Let us know if the problem persists.

Also, if you can provide a sample file, we can test if this is indeed a bug.
Comment 2 Colin 2022-06-14 16:02:05 UTC
(In reply to Rafael Lima from comment #1)
> Hi Colin, can you try with a more recent version of LO? The current fresh
> branch is in 7.3.4. You can also try 7.4 beta / 7.5 alpha.
> 
> Let us know if the problem persists.
> 
> Also, if you can provide a sample file, we can test if this is indeed a bug.

Version: 7.4.0.0.alpha0+ (x64) / LibreOffice Community
Build ID: 1bb0e177124d5d6661b72df6c7d848fb23639652
CPU threads: 4; OS: Windows 10.0 Build 19044; UI render: Skia/Raster; VCL: win
Locale: en-US (en_SE); UI: en-US
Calc: threaded

Worked in this version on a different machine with a totally modified file perfected using Excel.
I just loaded the excel in LO, saved it as an odf, deleted the working Excel pivot table and rebuilt from scratch.
First time I instantly got a message saying LO couldn't create the table but I'm happy to assume it was a user definition anomaly because the system didn't crash.
I modified my table layout and it was produced without drama.

Kudos goes to you if you flag it as FIXED works for RAFAEL ;)
Comment 3 raal 2022-10-04 21:00:06 UTC
closing per comment 2