Bug 118652 - opening a large tab delimited file take a long time when tab is not checked off as one of the default delimiters.
Summary: opening a large tab delimited file take a long time when tab is not checked o...
Status: RESOLVED NOTABUG
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
6.0.5.2 release
Hardware: All All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2018-07-09 22:09 UTC by kith.pradhan
Modified: 2018-07-10 04:03 UTC (History)
1 user (show)

See Also:
Crash report or crash signature:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description kith.pradhan 2018-07-09 22:09:43 UTC
Description:
When I try to open a large file (~18mb) that is delimited by tab, sometimes it takes calc a very long time to open.  I noticed if I have tab as one of the default delimiters already checked off, then opening the file only takes a few seconds, but if tabs are unchecked it can take more than 30 minutes!  For larger files I've waited more than an hour before giving up and killing the process.  

I just found out I could work around this problem by first opening a small tab delimited file, making sure to check off the tab checkbox, closing calc, then opening the large tab delimited file.  

For small files, when you open delimited txt you can usually fiddle with the checkboxes on the loading screen to see which delimiter to use.  I'm guessing Calc is running into problems populating that preview table.  Maybe it's  reading the entire line(or the entire file), not running into any expected delimiters so it thinks there's just one super sized cell,then it's getting stuck trying to allocate memory or initializing the sheet with default values of those super sized cells?  When tab is already one of the default delimiters it takes less than a second to populate the preview panel.  



Steps to Reproduce:
1.  have a large tab delimited file
2.  try to open it when tab is not checked off as one of the default delimiters
3.  wait 

Actual Results:
Takes too long to load.  Usually I have to kill the process before then.

Expected Results:
It should have opened in a few seconds


Reproducible: Sometimes


User Profile Reset: No



Additional Info:
Version: 6.0.5.2
Build ID: 1:6.0.5~rc2-0ubuntu0.14.04.1~lo1
CPU threads: 8; OS: Linux 4.4; UI render: default; VCL: gtk2; 
Locale: en-US (en_US.UTF-8); Calc: CL
Comment 1 V Stuart Foote 2018-07-10 04:03:50 UTC
(In reply to kith.pradhan from comment #0)
> ...  I noticed if I have tab as one of
> the default delimiters already checked off, then opening the file only takes
> a few seconds...

With default profile or a clean "reset" profile the Separator Options has Tab, Comma and Semicolon delimiters selected by default.

If you've cleared the settings in the import dialog (which is stateful)--reset to default profile, or adjust the dialog as noted.

Nothing else to be done here, know you data...

=> NAB