Bug 77515 - EDITING: Calc crashes when replacing text string in whole file (win64)
Summary: EDITING: Calc crashes when replacing text string in whole file (win64)
Status: RESOLVED WORKSFORME
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
4.1.5.3 release
Hardware: x86-64 (AMD64) Windows (All)
: high blocker
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2014-04-16 08:25 UTC by W.Muellner
Modified: 2015-06-19 07:49 UTC (History)
2 users (show)

See Also:
Crash report or crash signature:


Attachments
Test data - Part1 (2.83 MB, application/x-rar-compressed)
2014-04-16 09:09 UTC, W.Muellner
Details
Test data, Part2 (2.81 MB, application/x-rar-compressed)
2014-04-16 09:10 UTC, W.Muellner
Details
Testcase with LESS data - still crashes (1.54 MB, application/zip)
2014-04-16 21:15 UTC, W.Muellner
Details

Note You need to log in before you can comment on or make changes to this bug.
Description W.Muellner 2014-04-16 08:25:23 UTC
I installed German version of LibeOffice
Workflow to reproduce issue:
1. Open large CSV file (approx. 650K rows)
2. replace text string 'NA' with '' (empty string) in whole file
3 Calc crashes with error message: "Fatal error: bad allocation"
Comment 1 W.Muellner 2014-04-16 08:57:28 UTC
Also tested with 4.1.5.3.:
Same behaviour (AppCrash) except different message (Close App/search online for solution/...)
br, WM
Comment 2 retired 2014-04-16 09:00:31 UTC
Hi, can you please attach a test file to reproduce this problem?
Comment 3 W.Muellner 2014-04-16 09:09:30 UTC
Created attachment 97461 [details]
Test data - Part1

Test CSV file attached.
br, WM
Comment 4 W.Muellner 2014-04-16 09:10:37 UTC
Created attachment 97462 [details]
Test data, Part2

Part2
Comment 5 Julien Nabet 2014-04-16 17:14:45 UTC
W. Muellner: rar isn't well managed on some envs, would it be possible you use zip + this page https://wiki.documentfoundation.org/QA/Bugzilla-Attachments (useful for files > 3MB)
Comment 6 W.Muellner 2014-04-16 21:15:39 UTC
Created attachment 97484 [details]
Testcase with LESS data - still crashes

This is approx. 1/4th of the data, still crashes with same workflow...
Comment 7 Leopoldo Saggin 2014-04-18 22:12:52 UTC
I also observed a crash by using a "multiple search & replace" on a string in a .csv file imported into Calc, version 4.2.x.
Unfortunately I did not remember the exact subversion I was using (maybe 4.2.1), neither I can provide my file to test.
This comment wants to be just an indirect confirmation in support to what W.Muellner reported.
My version of LibO is the US one and my environment is Win 7 64 bit.

Cheers,
Leopoldo Saggin aka Topoldo
Comment 8 Julien Nabet 2014-05-28 19:37:31 UTC
On pc Debian x86-64 with master sources updated yesterday, I waited for some minutes and didn't reproduce this.
BUT, I've got 6GB and above all master sources have several memory leak fixes.

Markus: I thought that perhaps you were still searching for big data files/use cases, so put you in cc.
Comment 9 W.Muellner 2014-05-29 06:26:18 UTC
Just tested once more with newest LibO Version (4.2.4.2) using the smaller file from my attachments here (most recent attachment).
Still crashes with message (after crash, and in German): "Application has crashed..." and offering to recover the document.

My environment: Windows7 Ultimate 64bit, 16GB Ram, Intel i7-860 processor
regards, Walter
Comment 10 Julien Nabet 2014-05-29 17:17:44 UTC
Version indicates the earliest version the bug can be reproduced.
(see https://wiki.documentfoundation.org/QA/Bugzilla/Fields/Version)

Put it at NEW since Leopoldo confirmed in comment 7
Comment 11 paulchen 2014-09-04 14:05:44 UTC
I found, that searching and replacing content in a (uncertain where the limit is) large number of cells, CALC v. 4.3.0.2 seems to go into an endless loop. Quite annoying as I first thought it just takes some time and waited for the program to finish the job...
Could it be that the list of replacement results (that i find useless anyway) that would become huge, produces some overflow error?
Comment 12 Timur 2015-01-05 17:50:32 UTC
Please report for LO 4.3.5 and also 4.4.0 with regard to Bug 79422 and Bug 83141.
Comment 13 Julien Nabet 2015-01-05 20:40:32 UTC
Following Timur's comment, I put it NEEDINFO.
Comment 14 Per 2015-01-12 04:01:03 UTC
Hu!
I tested with the smaller csv (1.5MB) on the current 4.3.5.2 release, under win7 Ultimate, International version, set to use Swedish, 64-bit, and it still craches with the respose: "Libreoffice has stopped working".
When I click on the pop-up generated to get more information I get this list (sorry it's in Swedish):
Problemsignatur:
  Problemhändelsens namn:	APPCRASH
  Programnamn:	soffice.bin
  Programversion:	4.3.5.2
  Programtidsstämpel:	548b440e
  Namn på felmodul:	KERNELBASE.dll
  Modulens version:	6.1.7601.18409
  Tidsstämpel för felmodul:	53159a86
  Undantagskod:	e06d7363
  Undantagsförskjutning:	0000c42d
  OS-version:	6.1.7601.2.1.0.256.1
  Språkvariant-ID:	1053
  Ytterligare information 1:	de7a
  Ytterligare information 2:	de7a2bfc3e0a22039c4ff243444c0c9a
  Ytterligare information 3:	aef1
  Ytterligare information 4:	aef1ebc4504b2e15aa6f5ca814040bd2

I you speak German to can probably understand most of it.
This bug doesn't occur in OpenOffice 4.1.1 (I just tested it on Win7 Ultt-64-bit other PC.)
I will test this on opensuse/libreoffice 4.1 later tonight(if I have time - otherwise later).
I have seen similar problems with editing of large datasets like this in libreoffice (I dump csv from mysql and need to fix some details using calc before analysis in R). My current "fix" has been to run OO 4.1 - now verified on this testcase also!
Best
Per
Comment 15 retired 2015-01-12 08:41:03 UTC
Per, could you check 4.4.0.2 as well?
http://www.libreoffice.org/download/pre-releases/
Comment 16 Per 2015-01-12 22:02:20 UTC
(In reply to foss from comment #15)
> Per, could you check 4.4.0.2 as well?
> http://www.libreoffice.org/download/pre-releases/

OK, I will do this tonight. I've just tested the small csv on opensuse 13.1 using LO 4.1.6 - works OK, but is somewhat slow (still acceptable).
Best Per
Comment 17 Per 2015-01-12 23:17:52 UTC
(In reply to Per from comment #16)
> (In reply to foss from comment #15)
> > Per, could you check 4.4.0.2 as well?
> > http://www.libreoffice.org/download/pre-releases/
> 
> OK, I will do this tonight. I've just tested the small csv on opensuse 13.1
> using LO 4.1.6 - works OK, but is somewhat slow (still acceptable).
> Best Per

"train.csv" now tested with LO 4.4.0.2 on win7 ultimate 64-bit swedish and it fails with this message (much like 4.3 does):
Problemsignatur:
  Problemhändelsens namn:	APPCRASH
  Programnamn:	soffice.bin
  Programversion:	4.4.0.2
  Programtidsstämpel:	54aee95a
  Namn på felmodul:	KERNELBASE.dll
  Modulens version:	6.1.7601.18409
  Tidsstämpel för felmodul:	53159a86
  Undantagskod:	e06d7363
  Undantagsförskjutning:	0000c42d
  OS-version:	6.1.7601.2.1.0.256.1
  Språkvariant-ID:	1053
  Ytterligare information 1:	00cc
  Ytterligare information 2:	00ccc6ce44df1d7060705521c3cebf1d
  Ytterligare information 3:	3093
  Ytterligare information 4:	30934ec3e31539528116278e022a9868
Comment 18 Julien Nabet 2015-01-13 06:29:53 UTC
(In reply to Per from comment #17)
>....
> "train.csv" now tested with LO 4.4.0.2 on win7 ultimate 64-bit swedish and
> it fails with this message (much like 4.3 does):
>....
Could you rename your LO directory profile (see https://wiki.documentfoundation.org/UserProfile#Windows) and give it a new try?
Indeed, sometimes there's a problem in LO profie directory because of old and buggy remnants.
Comment 19 Per 2015-01-14 04:50:19 UTC
(In reply to Julien Nabet from comment #18)
> (In reply to Per from comment #17)
> >....
> > "train.csv" now tested with LO 4.4.0.2 on win7 ultimate 64-bit swedish and
> > it fails with this message (much like 4.3 does):
> >....
> Could you rename your LO directory profile (see
> https://wiki.documentfoundation.org/UserProfile#Windows) and give it a new
> try?
> Indeed, sometimes there's a problem in LO profie directory because of old
> and buggy remnants.

I've done that (unfortunately a have performed a security update of win 7 sinse the last test) and the instability problem remains, but I now get a Bad Allocation error, without any details. Restating LO and replacing "NA" with other characters works fine though, it's just the empty string "" (leaving the "Replace by" empty) that kills LO Calc. That may be a key to where to look?
Comment 20 Per 2015-02-26 14:04:58 UTC
(In reply to foss from comment #15)
> Per, could you check 4.4.0.2 as well?
> http://www.libreoffice.org/download/pre-releases/

Tested the bug using above train csv test-case. Using development version:
libo-44~2015-02-19_23.54.56_LibreOfficeDev_4.4.2.0.0_Win_x86.msi
and it worked without problems om win7 ultimate 64bit Swedish(on AMD64 hw)
One question though - why does the pop-up still show up after the replace, but empty (no list of replacements)? no big issue, just curious /per
Comment 21 Timur 2015-06-19 07:49:03 UTC
So, according to comment and test. Fixed in 4.4.0.3. Probably a dupe of Bug 79422.

(In reply to Per from comment #20)
> One question though - why does the pop-up still show up after the replace,
> but empty (no list of replacements)? no big issue, just curious /per
Interesting, might be a bug, but it should be reported separately after examining the details.