Bug 87321 - FILEOPEN: high memory footprint opening a xls containg a big html table in Calc
Summary: FILEOPEN: high memory footprint opening a xls containg a big html table in Calc
Status: NEW
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
4.3.4.1 release
Hardware: Other All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: XLS Memory
  Show dependency treegraph
 
Reported: 2014-12-15 10:02 UTC by Gabriele
Modified: 2023-10-01 20:39 UTC (History)
3 users (show)

See Also:
Crash report or crash signature:


Attachments
text.xls with a big html table. Open with plenty of RAM... (67.91 KB, application/zip)
2014-12-15 10:02 UTC, Gabriele
Details
Memory used by Excel 2016 vs LO 7.1.1 when LO started (7.86 KB, image/png)
2021-03-01 10:57 UTC, Svatopluk Vít
Details
Memory used by Excel 2016 vs LO 7.1.1 after LO started (3.62 KB, image/png)
2021-03-01 10:58 UTC, Svatopluk Vít
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Gabriele 2014-12-15 10:02:16 UTC
Created attachment 110849 [details]
text.xls with a big html table. Open with plenty of RAM...

Opening a xls file with a big html table (~40k rows and ~20 cols) in Calc takes over 4.5GB of memory.
The file is opened and works correctly if enough RAM is provided.

Tested on Libreoffice Calc 4.3.4.1 Linux 64bit

Attached a sample file to reproduce the issue.
Comment 1 Tim Lloyd 2014-12-15 20:52:10 UTC
Hi Gabriele, the attachment does not open as a LO doc. This is a problem I have seen before and it is due to the way the bugzilla sees the attachment.

If any gurus are reading could you pls modify the attachment so it is readable?

Cheers
Comment 2 Buovjaga 2014-12-16 12:04:10 UTC
I guess I didn't have enough RAM because of my Ubuntu VM running, so LibO just hung. Let's set to NEW.

Win 7 64-bit Version: 4.5.0.0.alpha0+
Build ID: 170616e9f2d30c1302bbb5a7a4b588bc05cd5cc9
TinderBox: Win-x86@39, Branch:master, Time: 2014-12-12_01:58:46
Comment 3 QA Administrators 2015-12-20 16:17:45 UTC Comment hidden (obsolete)
Comment 4 Gabriele 2015-12-24 10:56:40 UTC
I'm the original submitter

The bug is still present in

Libreoffice 5.0.4.2 (build id:2b9802c1994aa0b7dc6079e128979269cf95bc78)
Kubuntu 15.10 64bit 

According to htop calc use over 5GB RAM while opening the file.
After some time that the file is opened (without doing anything on it) RAM usage is down to 3037MB.
Comment 5 QA Administrators 2017-01-03 19:55:31 UTC Comment hidden (obsolete)
Comment 6 Gabriele 2017-01-05 15:58:03 UTC
I'm the original submitter

The bug is still present in

Versione: 5.2.3.2
Build ID: 1:5.2.3~rc2-0ubuntu1~xenial1
Thread CPU: 8; Versione SO: Linux 4.4;
Versione locale: it-IT (it_IT.UTF-8);

According to htop calc use ~4.6GB RAM while opening the file.

I've reported it 2 years ago, I'll be happy to test if someone have a look at it.
Comment 7 QA Administrators 2018-07-31 02:33:43 UTC Comment hidden (obsolete)
Comment 8 Gabriele 2018-08-28 11:19:51 UTC
I'm the original submitter

The bug is still present in

version: 6.0.6.2
Build ID: 1:6.0.6-0ubuntu0.18.04.1
Thread CPU: 8; SO: Linux 4.15; Resa interfaccia: predefinito; VCL: gtk3; 
Versione locale: it-IT (it_IT.UTF-8); Calc: group

According to htop calc use ~4.6GB RAM while opening the file.
Comment 9 QA Administrators 2021-01-11 03:57:31 UTC Comment hidden (obsolete)
Comment 10 Gabriele 2021-01-21 21:43:34 UTC
I'm the original submitter, 6 years later.

Seems to be at least partially solved.
RAM usage to open the file is down to 2.1GB which is still high but surely feasible nowadays

Version: 7.0.3.1
Build ID: 00(Build:1)
CPU threads: 6; OS: Linux 5.8; UI render: default; VCL: kf5
Locale: en-US (it_IT.UTF-8); Interfaccia utente: it-IT
Ubuntu package version: 1:7.0.3-0ubuntu0.20.10.1
Calc: threaded

I've also tested in version 6.4.6 in Windows and also in that version appears to use something more than 2GB of memory
Comment 11 Roman Kuznetsov 2021-01-22 08:12:13 UTC
I don't think problem is solved. It takes about 2Gb of memory anyway while opening process is running and after it becames only 140 mb!
Comment 12 Svatopluk Vít 2021-03-01 10:57:29 UTC
Created attachment 170147 [details]
Memory used by Excel 2016 vs LO 7.1.1 when LO started
Comment 13 Svatopluk Vít 2021-03-01 10:58:28 UTC
Created attachment 170148 [details]
Memory used by Excel 2016 vs LO 7.1.1 after LO started
Comment 14 Svatopluk Vít 2021-03-01 10:59:35 UTC
Looks like partial solution when comparing with Excel...

Version: 7.1.1.1 (x64) / LibreOffice Community
Build ID: 575c5867c4cc13d7ae78f9ce39a54a52ed38c769
CPU threads: 4; OS: Windows 10.0 Build 19042; UI render: Skia/Vulkan; VCL: win
Locale: cs-CZ (cs_CZ); UI: en-GB
Calc: threaded
Comment 15 Buovjaga 2021-03-21 08:44:04 UTC
Setting back to new as Roman had concerns about the high peak during opening
Comment 16 QA Administrators 2023-08-16 03:06:04 UTC Comment hidden (obsolete)
Comment 17 Gabriele 2023-10-01 20:39:29 UTC
I'm the original submitter.

In version:

Version: 7.3.7.2 / LibreOffice Community
Build ID: 30(Build:2)
CPU threads: 8; OS: Linux 6.2; UI render: default; VCL: gtk3
Locale: en-US (en_US.UTF-8); UI: en-US
Ubuntu package version: 1:7.3.7-0ubuntu0.22.04.3
Calc: threaded

the behaviour is similar to 7.1.1.
Peak of something more than 2GB of RAM during opening (around 2.3), down to ~250MB after some time.