How to Fix Duplicate Filter Values in Microsoft Lists
Question details
The user needs to resolve an issue where Microsoft Lists displays duplicate options in the column filter dropdown despite the entries appearing identical.

- Product
- Microsoft Lists
- Device & OS
- not provided
- Scenario
- Filtering data records based on column values in a SharePoint or Microsoft List.
- Observed behavior
- The filter menu shows duplicate values for entries that seem to have the exact same spelling, spacing, and capitalization.
Ensure you have 'Edit' or 'Full Control' permissions for the list so you can access the List Settings and modify column configurations.
Verify and Clean Choice Column Settings
Inspect the column configuration in List settings to remove any hidden spaces or mismatched characters in the defined choices.
Duplicate filters often occur in 'Choice' columns when there are invisible trailing spaces or different character encodings in the backend settings. Manually re-entering these values can unify them.
Click the gear icon (Settings) in the top right corner of your Microsoft List and select 'List settings'.
Scroll down to the 'Columns' section and click on the name of the column that is displaying duplicate filter values.
Locate the text box labeled 'Type each choice on a separate line'. Look closely for any extra spaces at the end of the words or blank lines.
Delete the problematic choices and manually re-type them to ensure uniformity. Scroll to the bottom and click 'OK' to save your changes.

Create a Calculated Column to Standardize Data
Use a calculated column formula to strip away hidden spaces from the original column and use this new column for filtering.
Manage Data Effectively with WPS Spreadsheet
If you frequently encounter filtering limitations or formatting inconsistencies in Microsoft Lists, consider managing your extensive datasets in a dedicated spreadsheet. WPS Spreadsheet offers a powerful, free, and lightweight alternative to Microsoft Excel, featuring advanced data validation and filtering tools to ensure your data remains clean and deduplicated.
- 1. Export Your List: Click 'Export' > 'Export to Excel' in Microsoft Lists to download your data as a CSV or Excel query file.
- 2. Open in WPS Spreadsheet: Launch WPS Office and open the downloaded file to view your data locally.
- 3. Filter Data Seamlessly: Navigate to the 'Data' tab and click 'AutoFilter' to easily sort and filter your records without hidden duplicate values.

Frequently Asked Questions
Why does Microsoft Lists show identical values multiple times in the filter?
This is usually caused by hidden trailing spaces, leading spaces, or differing character encodings (such as non-breaking spaces vs. regular spaces) in the stored data. The system reads them as distinct entries even though they look identical to the naked eye.
Does changing the column from 'Single line of text' to 'Choice' fix duplicates?
It can help prevent future duplicates by restricting what users can input. However, existing data must still be cleaned up to match the newly defined choices, otherwise the legacy variations will continue to appear in the filter.
How can I quickly find which items have hidden spaces in my list?
The easiest method is to export the Microsoft List to a spreadsheet file (like CSV or Excel). Once opened, you can use the LEN function to count the characters in each cell, easily identifying which entries contain extra invisible spaces.




