Bug 34777 - Libre Office crashes after EDITING big datasets
Summary: Libre Office crashes after EDITING big datasets
Status: CLOSED WONTFIX
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
3.3.0 release
Hardware: x86-64 (AMD64) Windows (All)
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-02-26 12:16 UTC by walli2
Modified: 2016-09-01 12:50 UTC (History)
6 users (show)

See Also:
Crash report or crash signature:


Attachments
Example file (8.56 MB, application/x-7z-compressed)
2015-10-23 05:05 UTC, Buovjaga
Details

Note You need to log in before you can comment on or make changes to this bug.
Description walli2 2011-02-26 12:16:46 UTC
My calc-file is about 40MB big, there are some tables and each of them has more than 100.000 rows.

Libre Office crashes after I delete a table and try to work with remaining data (somtimes the tab with the tablename remains after deleting, some more graphical errors - white rectangles,... apear before crash)

Error also happens after i copy a cell with a formula to the remaining 100k+ cells below.

In both cases I am able to delete one table, or copy the cells one time and save the document. After this the crash happened allways

Exact time when Libre Office crashes depends on activity: at saving, at deleting another table, at copying another column formulas,...

best regards
Comment 1 Cédric Bosdonnat 2011-02-28 02:34:31 UTC
If you don't provide any more information, I'll be forced to close this bug as invalid. You need to help us reproduce the bug. A sample file is a minimum to provide here, but a backtrace of the crash would help a lot.

Please read: http://wiki.documentfoundation.org/BugReport
Comment 2 walli2 2011-03-01 02:19:28 UTC
Sorry, I had to change data because of copyright and was in haste while filing the bug.

As the example-file is to large, i provede the download from 
http://dl.dropbox.com/u/12755058/example_file.7z

Reproducing crash:
*) Open File
*) Table3: mark Range A2:N2, copy
*) mark Range A3:N678257, paste


Libre Office also crashes when copying in 100k steps
A3:N100000, paste
A100001:N200000, paste --> crash

My System:
Windows7 - 64bit
4GB RAM
LibreOffice 3.3.0 (32bit)
Comment 3 Cédric Bosdonnat 2011-03-02 08:44:31 UTC
Kohei, this is yours. I could see huge memory increase during the paste... but it didn't crash. But may be that the insane amount of memory on my machine that prevented it.
Comment 4 Kohei Yoshida 2011-06-02 07:45:57 UTC
Marking this as a perf (memory footprint) issue.  The crash is likely caused by too much allocation based on the comments so far.
Comment 5 Kohei Yoshida 2011-11-29 21:54:50 UTC
(In reply to comment #2)

> As the example-file is to large, i provede the download from 
> http://dl.dropbox.com/u/12755058/example_file.7z

Hmm that file is no longer available.  Could you post it again?
Comment 6 Kohei Yoshida 2011-12-12 12:53:55 UTC
I need to get the document from the reporter once again.  The dropbox link is no longer working.
Comment 7 walli2 2011-12-16 02:13:56 UTC
Hi

Sorry for the delay.  I posted the file again on dropbox - the new url is http://dl.dropbox.com/u/12755058/example_file.7z
Comment 8 Kohei Yoshida 2011-12-17 16:28:56 UTC
Thanks.  This time I've mirrored it in my home directory to avoid losing it again.

http://people.freedesktop.org/~kohei/fdo/34777/example_file.7z
Comment 9 Kohei Yoshida 2012-01-23 09:25:17 UTC
Ok.  The cause for the crash is excessive memory usage.  We may or may not be able to solve this short-term, since part of that is a design issue.

We probably need to change a lot of places to allow documents this large to be editable without consuming a lot of memory.  Let me dig into this to at least identify the problem areas.
Comment 10 danielle@bywatersolutions.com 2013-09-08 05:12:39 UTC
I am also experiencing this with files from 11,000 to 80,000 rows.
Comment 11 ace_dent 2014-02-06 18:40:08 UTC
I appreciate this may not be the most useful bug report... 
Performance on Mac OS X with latest release, is actually worse now with medium/ big spreadsheets crashing regularly, that worked in earlier versions (4.1.4). Data is sensitive so I cannot provide sample file, but has 7 sheets, each ~10 columns and ~2000 rows...

Version: 4.2.0.2
Build ID: 125e3e788aa207ab80b6f39e74ef57af7e2129b6
Comment 12 melquiades 2014-02-06 21:25:04 UTC
Hi there,
I'm having the same problem, working with big files becomes really painful if you have many other programs running including other LO files as well (chrome with a lot of tabs for instance).
walli2 had the crash while copying and pasting, i have them while introducing a formula (=si(buscarv(xx)... crashed).
This wasn't so visible on previous releases but with the arrival of 4.1.4, working with big files has become really hard. 
I'm running win 7 x86 with 2 GB of RAM
Comment 13 QA Administrators 2015-07-18 17:43:53 UTC Comment hidden (obsolete)
Comment 14 Buovjaga 2015-10-22 17:15:47 UTC
Didn't crash here with A3:N678257, paste, but I have 8GB of memory.

Win 7 Pro 64-bit Version: 5.1.0.0.alpha1+
Build ID: fcc2415ade6ae93710bbbda9f7e163045e323105
TinderBox: Win-x86@62-merge-TDF, Branch:MASTER, Time: 2015-10-21_16:55:13
Locale: fi-FI (fi_FI)
Comment 15 Buovjaga 2015-10-23 05:05:16 UTC
Created attachment 119895 [details]
Example file
Comment 16 Robinson Tryon (qubit) 2015-12-10 10:41:20 UTC Comment hidden (obsolete)
Comment 17 Eike Rathke 2016-09-01 12:50:04 UTC
The 32-bit Windows version can easily run out of memory for large data amounts, there's ~nothing we can do about. One can try to limit Undo steps to 1 or even disable Undo, as holding Undo information for large data changes needs additional memory for each step. Other than that use the 64-bit version instead (which wasn't available back when the bug was reported but now is) and have enough RAM.