Bug 85976 - Feature Request - Add "Remove Duplicates" button to LibreOffice / filtering showing duplicates is too complicated
Summary: Feature Request - Add "Remove Duplicates" button to LibreOffice / filtering ...
Status: NEW
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
(earliest affected)
Inherited From OOo
Hardware: All All
: medium enhancement
Assignee: Not Assigned
Keywords: difficultyInteresting, easyHack, skillCpp, topicDebug
: 109519 124758 144744 (view as bug list)
Depends on:
Blocks: Calc-Enhancements Data-Filter
  Show dependency treegraph
Reported: 2014-11-06 17:31 UTC by Mr. Bugz
Modified: 2022-04-14 07:58 UTC (History)
25 users (show)

See Also:
Crash report or crash signature:
Regression By:

Remove Duplicates button in Data Ribbon in Excel 2016 (171.06 KB, image/png)
2018-10-22 13:03 UTC, Pedro
Only Office also acquired the Remove Duplicates functionality (36.12 KB, image/png)
2022-01-10 15:58 UTC, Pedro
Remove Duplicates in Google Sheets (1.15 MB, image/png)
2022-01-10 16:08 UTC, Pedro

Note You need to log in before you can comment on or make changes to this bug.
Description Mr. Bugz 2014-11-06 17:31:54 UTC
Excel has a feature where you can remove duplicates with a single click. This would be very helpful to have in LibreOffice as well.
Comment 1 Joel Madero 2014-11-06 18:00:34 UTC Comment hidden (obsolete)
Comment 2 libreoffice 2014-11-24 17:54:39 UTC
Yes, that is what I was looking for. But I still think it should be an optional button/dialog available on the main toolbar without having to go through all that.

Like this:
Comment 3 m.a.riosv 2015-07-29 22:02:51 UTC
*** Bug 92990 has been marked as a duplicate of this bug. ***
Comment 4 Erelyn Alves 2015-07-31 15:21:38 UTC
Below also another program that easily performs the procedure.

WPS Spreadsheets
Comment 5 Mike Kaganski 2018-09-07 08:20:10 UTC
Additional detail: in Excel, the function *removes* duplicates in-place, while filter in LO only allows hiding in-place, or removing by copying to a different location. So actually, LO lacks the functionality.
Comment 6 Roman Kuznetsov 2018-09-07 08:22:39 UTC
(In reply to Joel Madero from comment #1)
> Like this:
> http://milospjanic.blogspot.com/2011/10/how-to-remove-duplicates-in-
> libreoffice.html ?

IMHO, in Excel it made more clear for users. Different dialogue with very simple options. And in result in Excel we have only rows without any duplicates and without copying of result to another range...
Comment 7 Cor Nouws 2018-10-18 14:42:37 UTC
*** Bug 109519 has been marked as a duplicate of this bug. ***
Comment 8 Pedro 2018-10-22 13:01:28 UTC
I would also like to request that "Remove Duplicates" is added to Calc.
In Excel, removing duplicates from a column is a one click action. In Calc I have to go through multiple steps to obtain this. It's a waste of time if it's encessary to do it in multiple spreadsheets, it's a waste of time to make a macro and other spreadsheets offer this by default.

There is an extension that adds this function to Calc so I propose that this is added to the default installation, that a .uno command is created for this button to be integrated in the Notebookbars as well.

Comment 9 Pedro 2018-10-22 13:03:37 UTC
Created attachment 145904 [details]
Remove Duplicates button in Data Ribbon in Excel 2016
Comment 10 Pedro 2018-10-22 13:08:28 UTC Comment hidden (obsolete)
Comment 11 Pedro 2018-10-30 18:06:45 UTC Comment hidden (no-value)
Comment 12 Thomas Lendo 2018-11-06 08:45:42 UTC
*** Bug 73712 has been marked as a duplicate of this bug. ***
Comment 13 Pedro 2018-12-18 12:25:57 UTC Comment hidden (obsolete)
Comment 14 V Stuart Foote 2019-04-15 19:37:25 UTC
*** Bug 124758 has been marked as a duplicate of this bug. ***
Comment 15 Roman Kuznetsov 2019-11-09 22:42:18 UTC
(In reply to Pedro from comment #13)
> Well, Muhammet Kara after checking the extension confirmed that it is
> written in Basic, meaning that it is a macro.
> If someone would translate it to C++, it would be awesome.

Now there is faster extension https://extensions.libreoffice.org/extensions/remove-duplicates-fast for it
Comment 16 Pedro 2019-11-11 10:03:13 UTC
Couldn't this extension be added by default to LibreOffice?
Comment 17 Pedro 2019-11-11 10:04:29 UTC Comment hidden (no-value)
Comment 18 Mark Leo 2020-05-17 18:37:52 UTC Comment hidden (spam)
Comment 19 Heiko Tietze 2020-06-05 11:34:20 UTC
Since we have a working solution with the standard filter dialog it should be easy to add a new UNO command and run the filter procedure with a predefined setting. 

Code pointer

sc/source/ui/view/tabvwshc.cxx #308

Would understand this as a medium to interesting difficulty.
Comment 20 Pedro 2020-06-06 09:58:02 UTC
Just to mention: this is not just filtering. It also deletes the cells with duplicate values. But I guess that is one minor thing to add.
Comment 21 Andrea Winslet 2020-06-22 06:05:32 UTC Comment hidden (spam)
Comment 22 stutisharma900 2020-09-10 02:57:40 UTC Comment hidden (spam)
Comment 23 Pedro 2020-11-23 10:24:01 UTC Comment hidden (obsolete)
Comment 25 Buovjaga 2020-11-23 11:26:08 UTC Comment hidden (obsolete)
Comment 26 Pedro 2020-11-23 13:09:53 UTC Comment hidden (obsolete)
Comment 27 Evgeniy 2021-02-28 18:28:14 UTC Comment hidden (me-too)
Comment 28 breetlee9211 2021-03-19 07:39:15 UTC Comment hidden (spam)
Comment 29 Richard Swayar 2021-07-05 09:12:34 UTC Comment hidden (spam)
Comment 30 Pedro 2022-01-10 15:58:41 UTC
Created attachment 177433 [details]
Only Office also acquired the Remove Duplicates functionality

Only Office also got the Remove Duplicates functionality by default.
Comment 31 Pedro 2022-01-10 16:08:54 UTC
Created attachment 177434 [details]
Remove Duplicates in Google Sheets

This feature is also present in Google Sheets.
Comment 32 Heiko Tietze 2022-01-11 08:44:57 UTC
*** Bug 144744 has been marked as a duplicate of this bug. ***
Comment 33 Mike Kaganski 2022-01-11 09:00:06 UTC
Note that any feature request having a working extension with compatible license is already an easy hack. Just use its source code as the template that provides the required logic - it uses UNO commands, which may be easily converted to a C++ code, and assign a new UNO command to that new function.

(Given that Remove Duplicates Fast is based on Remove Duplicates (https://github.com/ACTom/lo-extension-removeduplicates) which is GPLv3, which doesn't allow to use its code in LO directly because we need an MPL-compatible license, interested parties may ask the author for changed license in a github issue.)
Comment 34 Pedro 2022-01-11 12:09:10 UTC
What MPL specific license do you recommend?
Comment 35 Pedro 2022-01-11 12:13:59 UTC
Asked the dev in a new issue.
Comment 36 Pedro 2022-01-11 12:28:55 UTC
The developer already changed the license to MPL 2.0. Hopefully this allows someone to pick this up. :D