Result
This tool removes duplicate lines from a list or text and tells you how many were removed. Choose whether to ignore case and surrounding spaces, keep the first or last copy of each line, or list only the duplicates. It also sorts, cleans spaces and adds prefixes or numbers, so you can tidy email lists, keywords and log files in one place.
How to use
- Paste a list or drop a text file into the box.
- Pick a tool: Dedupe removes repeated lines, Sort orders them, Clean fixes spaces and line breaks, Extras adds prefixes, suffixes or numbers.
- Turn options on or off; the result updates as you go.
- Tap the result to copy it, download it as .txt, or use it as the new input to chain another step.
- Dedupe can ignore case and leading or trailing spaces when comparing, and keep either the first or the last copy of each line. Show removed lists the duplicates instead.
- Sorting follows the rules of your language, so accented letters sort next to their base letter. 1 → 10 sorts numbers by value, so 2 comes before 10.
- Shuffle uses your browser’s cryptographic random generator. Tap it again for a new order.
- Clean can remove zero-width spaces and non-breaking spaces that often sneak in from web pages, Word or PDFs. In the separator, \n means a new line and \t a tab.
- Your text never leaves this browser.
How duplicates are detected
Two lines count as duplicates when they are exactly the same, character for character. That is stricter than it looks: “Apple”, “apple” and “apple ” (with a trailing space) are three different lines. Turn on Ignore case and Ignore spaces to treat them as one. The line that stays is the first one by default, so the original order of your list is kept; Keep last is useful when later entries are more up to date.
Show removed turns the tool around and lists the lines that occurred more than once, which helps when you want to find duplicate orders, IDs or email addresses rather than delete them.
Chaining steps
Use as input sends the result back into the box, so you can dedupe, then sort, then number a list in three steps; Ctrl+Z undoes each step. The Clean tab removes zero-width and non-breaking spaces copied from web pages or PDFs, which are a common reason why two lines that look the same are not detected as duplicates.
Frequently asked questions
How do I remove duplicate lines?
Paste the list and the duplicates are removed immediately. The counter shows how many lines were removed, and you can copy or download the result.
Does it keep the original order?
Yes. The first copy of each line stays where it was and later copies are removed, unless you choose Keep last.
Why are two identical-looking lines not removed?
They usually differ in case, a trailing space or an invisible character. Turn on Ignore case and Ignore spaces, or run Clean with Remove invisible characters first.
Can I find duplicates without deleting them?
Yes. Show removed lists only the lines that appeared more than once, so you can review them.
Is there a size limit?
Lists with hundreds of thousands of lines work; the limit is your device’s memory. Nothing is uploaded, the text stays in your browser.