Bug 116206 - Calc has very high memory consumption when dealing with lots of data on multiple worksheets
Summary: Calc has very high memory consumption when dealing with lots of data on multi...
Status: NEW
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
Inherited From OOo
Hardware: All All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords: perf
Depends on:
Blocks: Memory
  Show dependency treegraph
 
Reported: 2018-03-05 14:38 UTC by Gabor Kelemen (allotropia)
Modified: 2024-02-09 17:06 UTC (History)
3 users (show)

See Also:
Crash report or crash signature:


Attachments
Example file with lots of random data (19.39 MB, application/vnd.openxmlformats-officedocument.spreadsheetml.sheet)
2018-03-05 14:38 UTC, Gabor Kelemen (allotropia)
Details
Memory usage of Excel and Calc as reported by the Task manager (29.77 KB, image/png)
2018-03-05 14:39 UTC, Gabor Kelemen (allotropia)
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Gabor Kelemen (allotropia) 2018-03-05 14:38:52 UTC
Created attachment 140357 [details]
Example file with lots of random data

LibreOffice Calc has very high memory consumption when dealing with lots of data on multiple worksheets compared to Microsoft Excel. The result is that Calc is unable to open more complex spreadsheets that work just fine in Microsoft Excel on the same computer.

Steps to reproduce:
1. Create a new spreadsheet in LibreOffice Calc.
2. Add a simple function (e.g. =RAND()*1000000) to many (tens of thousands) of cells on the first worksheet.
3. Copy the content of the first Sheet to multiple Sheets.
4. Sum the values from multiple sheets on the last sheet.
4. Save the file as XLSX.
5. Open the file in LibreOffice Calc and in Microsoft Excel.
6. Compare the memory consumption of the two applications.

Actual results:
The memory consumption of LibreOffice Calc is many times higher than the memory consumption of Microsoft Excel. The memory consumption of Calc is even higher when opening the XLSX file.

Expected results:
The memory consumption of LibreOffice Calc should be lower when dealing with lots of data.
Comment 1 Gabor Kelemen (allotropia) 2018-03-05 14:39:41 UTC
Created attachment 140358 [details]
Memory usage of Excel and Calc as reported by the Task manager
Comment 2 Xavier Van Wijmeersch 2018-03-05 15:44:00 UTC
confirm with (about 850MB)

Version: 6.1.0.0.alpha0+
Build ID: ab63510e104c4b8e42982390357af1281c4b11a7
CPU threads: 8; OS: Linux 4.14; UI render: default; VCL: kde4; 
TinderBox: Linux-rpm_deb-x86_64@70-TDF, Branch:master, Time: 2018-03-05_01:01:02
Locale: nl-BE (en_US.UTF-8); Calc: group
Comment 3 Telesto 2020-05-23 13:08:34 UTC
Same with.. not specific XLSX
LibreOffice 3.3.0 
OOO330m19 (Build:6)
tag libreoffice-3.3.0.4
Comment 4 Buovjaga 2022-05-12 11:16:46 UTC
Still high

Version: 7.4.0.0.alpha0+ (x64) / LibreOffice Community
Build ID: 172e208e6b0674f42c301c5ee5e280e9138ba1b4
CPU threads: 2; OS: Windows 10.0 Build 19044; UI render: Skia/Raster; VCL: win
Locale: fi-FI (fi_FI); UI: en-US
Calc: threaded Jumbo
Comment 5 Tex2002ans 2024-02-09 04:10:58 UTC
Retested in:

Version: 24.2.0.3 (X86_64) / LibreOffice Community
Build ID: da48488a73ddd66ea24cf16bbc4f7b9c08e9bea1
CPU threads: 8; OS: Windows 10.0 Build 22631; UI render: Skia/Vulkan; VCL: win
Locale: en-US (en_US); UI: en-US
Calc: CL threaded

Loaded attachment in Comment #0:

~955 MB peak while loading
~825 MB on final load
Comment 6 Tex2002ans 2024-02-09 17:06:15 UTC
And for comparison, I tested same spreadsheet in:

Excel 365:

- ~350 MB peak while loading
- ~346 MB on final load

This was Version 2401 (Build 17231.20194).