Bug 144196 - Make "No duplications" in standard filters depending on case sensitive mode
Summary: Make "No duplications" in standard filters depending on case sensitive mode
Status: NEW
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
(earliest affected) release
Hardware: All All
: medium normal
Assignee: Not Assigned
Depends on:
Blocks: Data-Filter
  Show dependency treegraph
Reported: 2021-08-30 18:50 UTC by Igor
Modified: 2021-12-06 09:06 UTC (History)
3 users (show)

See Also:
Crash report or crash signature:
Regression By:

Demo file with filtering error (68.21 KB, application/vnd.oasis.opendocument.spreadsheet)
2021-08-30 18:55 UTC, Igor
for testing (8.64 KB, application/vnd.oasis.opendocument.spreadsheet)
2021-12-04 06:25 UTC, BogdanB

Note You need to log in before you can comment on or make changes to this bug.
Description Igor 2021-08-30 18:50:57 UTC
SF & AF work always case sensitive.
Checking/unchecking the 'Case sensitive' checkbox does not matter.

Steps to Reproduce:
1. Open Standard/Advanced filter dialog.
2. Check or uncheck 'Case sensitive' checkbox one at a time. Do other work.
3. Apply a filter. Compare the result.

Actual Results:
The data will always be case sensitive.

Expected Results:
There should be no extra data that differs only in the case of characters.

Reproducible: Always

User Profile Reset: No

Additional Info:
A sample file is attached.

Version: / LibreOffice Community Build ID: fa0a9af5681a0acc7909a705f92c1ada8a658552 CPU threads: 8; OS: Linux 4.15; UI render: default; VCL: gtk3 Locale: ru-RU (ru_RU.UTF-8); UI: en-US Calc: threaded
Comment 1 Igor 2021-08-30 18:55:29 UTC
Created attachment 174650 [details]
Demo file with filtering error

The sample file contains the data needed to reproduce the error.
The custom utility correctly performs the case-insensitive duplicate removal task.
Comment 2 Mike Kaganski 2021-08-31 06:36:42 UTC
here is an ambiguity in the feature description that doesn't allow to clearly see if this is a bug or not. The question assumes that "Case sensitive" option of the filters applies to the "No duplications"; but help [1] does not state that; it only tells that (1) Case sensitive "Distinguishes between uppercase and lowercase letters when filtering the data", and (2) No duplication "Excludes duplicate rows in the list of filtered data". So the (1) is only said to apply to the filtering conditions - not to duplication finding? On one hand, this may be seen as "works as designed"; on the other hand, it's likely that users would expect the different behavior.

It's interesting what other spreadsheet applications do in this case.

Adding Eike to CC; also asking advice of UX team.

[1] https://help.libreoffice.org/7.2/en-US/text/scalc/01/12040201.html?&DbPAR=CALC
Comment 3 Igor 2021-08-31 17:57:36 UTC
Excel AdvancedFilter filters unique data case insensitively, including Cyrillic. And the option corresponding to "Case sensitive" is not there. However, numeric data is distinguished as numbers and strings (?).
Comment 4 Heiko Tietze 2021-09-06 10:34:36 UTC
Quite obvious to me since the list of items shows only lowercase (Foo, foo = foo) unless I check the sensitive option (only for SF). Would not increase the complexity of the AF but just add a note to the documentation.
Comment 5 Heiko Tietze 2021-09-09 12:42:58 UTC
No further opinion, recommend to resolve WF (and add it to documentation). The standard filter provides means to run case sensitive and adding the option to the auto filter would clutter the widget further.

(In reply to Mike Kaganski from comment #2)
> Adding Eike to CC

Please reopen in case you disagree.
Comment 6 Eike Rathke 2021-09-10 12:31:11 UTC
(In reply to Heiko Tietze from comment #5)
> The standard filter provides means to run case sensitive and adding the
> option to the auto filter would clutter the widget further.
IMHO that's not what is requested.. the original description lacks the mention of "No duplication" that seems to be the actual problem here, which becomes (somewhat) clearer when opening the sample document (which is confusing enough though).

I'd rather expect that when filtering is done case insensitive that also uniqueness (no duplication) is case insensitive. Doing so also wouldn't need any new option in the dialog.
Comment 7 Heiko Tietze 2021-09-13 09:31:57 UTC
Test: "AAA", "aaa", "BBB", "bbb", "AAA"

Current behavior when sorting "Test" = "not empty" with the options

[x] No duplication & [ ] Case sensitive = "AAA", "aaa", "BBB", "bbb"
[x] No duplication & [x] Case sensitive = "AAA", "aaa", "BBB", "bbb"

Expected behavior:

[x] No duplication & [ ] Case sensitive = "AAA", "BBB"
[x] No duplication & [x] Case sensitive = "AAA", "aaa", "BBB", "bbb"
Comment 8 BogdanB 2021-12-04 06:25:53 UTC
Created attachment 176687 [details]
for testing

I have attached a simple file in order to test the bug, as mentioned by Heiko.

In order to test: just check No duplication, then Check or Uncheck "Case sensitive": not working.