Remove duplicate lines from text with various comparison modes
Duplicate lines pile up in all kinds of everyday text work: an email list exported twice from a CRM, a log file where the same error repeats a thousand times, a spreadsheet column pasted into a text box, or a word list where you just need the unique entries. Manually scanning for repeats is slow and error-prone once a list passes a few dozen lines, and spreadsheet 'remove duplicates' features don't always work well with raw pasted text. This tool takes a block of text, compares it line by line, and strips out every repeated occurrence so only unique lines remain — instantly, without opening a spreadsheet or writing a script.
You paste or type your text into the input box, and the tool scans each line against the ones it has already seen. Two toggles control how matching works: a case-sensitive option, so 'Apple' and 'apple' can be treated as either the same line or two different lines depending on your needs, and a trim option, so lines that differ only by leading or trailing whitespace (a common artifact of copy-pasting from PDFs or emails) are still recognized as duplicates. The result is a cleaned list with the original line order preserved, ready to copy back out or paste into another tool.
This is particularly handy for deduplicating email or contact lists before a mail merge, cleaning up keyword or tag lists, thinning out repeated log lines when you're hunting for distinct error types, or checking a dataset for accidental double entries before import. Since everything runs client-side in your browser, your data never leaves your machine — there's no upload, no signup, and no size limit imposed by a server round-trip, which matters if the text you're deduplicating is sensitive, like a customer list.
Paste your text, set your matching options, and get a deduplicated list in seconds.
Copy your list, log, or block of text and paste it into the input area.
Toggle the case-sensitive option on if 'Apple' and 'apple' should be treated as different lines, or off if they should count as duplicates.
Enable trim if lines with extra leading or trailing spaces should still be matched as duplicates of an identical line.
The tool scans the text line by line and removes every repeated occurrence, keeping the first instance of each unique line.
Check the cleaned output to confirm the unique lines and their original order look correct.
Copy the deduplicated text out of the tool to paste into your spreadsheet, email client, or script.