Bug 161398 - auto-filter very slow
Summary: auto-filter very slow
Status: RESOLVED NOTABUG
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
unspecified
Hardware: All All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-06-03 16:17 UTC by Pierre Fortin
Modified: 2024-06-04 09:44 UTC (History)
2 users (show)

See Also:
Crash report or crash signature:


Attachments
spreadsheet which has issue (2.80 MB, application/vnd.openxmlformats-officedocument.spreadsheetml.sheet)
2024-06-03 22:50 UTC, Pierre Fortin
Details
Sample file modified (2.73 MB, application/vnd.openxmlformats-officedocument.spreadsheetml.sheet)
2024-06-04 09:43 UTC, m_a_riosv
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Pierre Fortin 2024-06-03 16:17:01 UTC
LibreOfficeDev 24.8.0.0.alpha1 1f15d097cace14ca6e44e7652f460aa3fa7bd150 (June 3)

Downloaded ZIP codes file from www.unitedstateszipcodes.org -- click the link at the upper right, select Non-profit and enter an email for updates.  You'll get 3 download buttons, the top one is the one I'm using:
   2931823  zip_code_database.xlsx

Load this file. On the first sheet:
Data->AutoFilter
Column B, unselect All, select PO BOX, OK

100% CPU, takes 45 seconds to process 42,735 rows of 15 columns to display 9,396 rows.  Reverting to show All also takes 45 seconds.  


Operating System: Mageia 10
KDE Plasma Version: 6.0.4
KDE Frameworks Version: 6.2.0
Qt Version: 6.6.2
Kernel Version: 6.6.28-server-1.mga10 (64-bit)
Graphics Platform: Wayland
Processors: 20 × 12th Gen Intel® Core™ i7-12700K
Memory: 125.5 GiB of RAM
Graphics Processor: AMD Radeon RX 6600 XT
Manufacturer: Dell Inc.
Product Name: XPS 8950
Comment 1 m_a_riosv 2024-06-03 18:41:57 UTC
Please attach the sample file here, and paste the information in Menu/Help/About LibreOffice, there is a copy icon.
Comment 2 Pierre Fortin 2024-06-03 22:50:19 UTC
Created attachment 194528 [details]
spreadsheet which has issue

Version: 24.8.0.0.alpha1+ (X86_64) / LibreOffice Community
Build ID: 1f15d097cace14ca6e44e7652f460aa3fa7bd150
CPU threads: 20; OS: Linux 6.6; UI render: default; VCL: kf5 (cairo+wayland)
Locale: en-US (en_US.UTF-8); UI: en-US
Calc: threaded Jumbo
Comment 3 ady 2024-06-03 23:37:48 UTC
I can reproduce the problem on MS Windows too with recent LO 24.8 alpha.

Anything I do with attachment 194528 [details] is slow. Even opening the file is so slow that Calc does not respond for several seconds (i.e. it temporarily hangs).

After testing several features, I found out that:
1. removing the second worksheet, named "lookup",
2. then save the file, close and reopen it,

...anything that was slow before is now much, much faster.

I am not saying that other factors are not relevant, but the factor that impacted more was removing the second worksheet.

So, maybe the formula on the "lookup" worksheet is what makes everything slow, and not the AutoFilter in particular.

If others can confirm the behavior I am describing, then the Summary field should be changed from the current "auto-filter very slow" into something more relevant to what actually makes attachment 194528 [details] so slow (up to temporal hanging) in Calc.
Comment 4 m_a_riosv 2024-06-04 09:43:46 UTC
Created attachment 194543 [details]
Sample file modified

In the range
lookup.b68:o1002
there are 13090 formulas with VLOOKUP what makes the recalculation slow.

The modified sample has those unneeded formulas deleted.
Also, an array formula showing how to do it only with one formula per row, to avoid several VLOOKUP per row.