Keyword List Deduplicator
Remove duplicate keywords from a list in one click, with optional case and punctuation normalisation and a removal count.
Your input
Everything you type is processed in this browser tab. Nothing is uploaded, logged or stored.
Results
Fill in the fields and choose Run tool to see results here.
About this tool
Deduplication is the single most common cleanup task in keyword work, and it deserves a tool that does exactly that and nothing else. Paste a list, choose how strictly to compare, and get the unique version back with a count of what was removed. No other transformation is applied, so what comes out is what you put in, minus the repeats.
How it works
Each line is normalised before comparison: whitespace is collapsed, punctuation is optionally stripped, and case is optionally ignored. Lines that normalise to the same string are treated as duplicates. You choose whether the first or the last occurrence survives, which matters when the variants differ in capitalisation and you have a preferred spelling later in the list.
- 1Paste the list you want deduplicated.
- 2Choose whether case and punctuation should be ignored.
- 3Decide whether to keep the first or the last occurrence.
- 4Generate and export the unique list.
Example
Input
running shoes, Running Shoes, cycling shoes
Output
running shoes · cycling shoes (1 removed)
When to use it
- Cleaning a list after merging several research sources.
- Preparing a list for bulk upload where duplicates would be rejected.
- Removing repeats before counting or costing a project.
- Standardising a tag or keyword library.
Tips
- Keep case ignored — search engines do not distinguish it, so neither should your list.
- Choose keep-last when your later sources have better formatting.
- Check the removed count; a very high number often points to a broken export upstream.
Limitations
Only textual duplicates are found. Different words for the same idea, singular versus plural, and reordered phrases all survive as separate entries. Ignoring punctuation can occasionally merge entries you meant to keep distinct.
Frequently asked questions
- Which occurrence is kept?
- The first by default. Turn off the keep-first option to retain the last occurrence instead.
- Does it change the keywords themselves?
- No. Normalisation is only used for comparison; the surviving lines are returned exactly as you wrote them.
- What about near-duplicates?
- Phrases that differ by a word are kept as separate entries. Use the Keyword Grouping Tool to see how they cluster.