Last updated: October 2026
Remove duplicate lines online free — the fast way to clean a list
How it works
1. Paste your list into the box — one item per line (keyword lists, email lists, URLs, log lines, anything). 2. Set your options: keep Case sensitive on for exact matches, leave Trim whitespace and Remove empty lines on for the usual cleanup, and choose whether the first or last copy of a repeated line survives. 3. Click Remove duplicates — the stats line tells you exactly how many lines went in, how many are unique, and how many were removed. Then copy the result or download it as a .txt file.
When you need this
Duplicate lines creep into lists constantly: merging two keyword exports for SEO, combining email lists before a send, scraping URLs and getting the same page twice, or cleaning log output before analysis. Doing it by hand in a spreadsheet means sorting, conditional formatting, and hoping you caught them all — this does it in one click, and the keep last occurrence mode is handy when the final entry in a list is the corrected one.
Unlike upload-based dedupe tools, there is no file-size cap here because there is no server involved. If your list has mixed casing, normalize the case first so "SEO Tools" and "seo tools" collapse properly — and afterwards, count word frequency to see what your cleaned list is really made of. Your browser compares the lines locally, so a 100,000-line export dedupes as easily as a 10-line one.
Worked example: one list, three settings
Paste this six-line list and see how each setting changes the result. Matching is exact per line — only full-line matches are removed, so seo tools and seo tools! would count as two different lines.
| Settings | Unique output | Removed |
|---|---|---|
| Defaults | seo tools, SEO Tools, keyword research, backlinks | 2 |
| "Case sensitive" off | seo tools, keyword research, backlinks | 3 |
| "Keep" = Last occurrence | SEO Tools, keyword research, seo tools, backlinks | 2 |
The list above is seo tools, seo tools (leading space), SEO Tools, keyword research, seo tools (trailing space), backlinks. With defaults, the two padded copies collapse into their unpadded originals because Trim whitespace is on — but SEO Tools survives because matching is case-sensitive. Turn case sensitivity off and it folds into seo tools too. Keep-last keeps the final copy of each line instead of the first.
Deduping one column can scramble your spreadsheet
The most common dedupe mistake has nothing to do with the tool: people paste a single column — emails, say — into a deduper, then paste the cleaned list back next to untouched columns. The moment any row was removed, the rows no longer line up, and names, dates and amounts silently attach to the wrong people. Always dedupe before you split your data into columns, or clean whole rows together. Keeping order intact, like this tool does by default, at least lets you spot-check the result against the original.
Frequently asked questions
Are "Apple" and "apple" treated as duplicates?
Which copy is kept when a line repeats?
What about blank lines and extra spaces?
Is there a limit on how much text I can dedupe?
Is my text private?
Will turning on Sort A–Z change my list's order?
Should I clean up my list before removing duplicates?
Can I undo after removing duplicates?
When should I turn Trim whitespace off?
How is this different from the Linux uniq command?
uniq command only removes adjacent duplicate lines, so you have to sort the input first (sort -u) — which destroys your original order. This tool compares every line against all earlier lines, so repeats are caught even when the two copies are far apart, and you can still keep the original order with sorting off.