Remove Duplicate Lines

Paste a list of lines and get each one only once. The text stays in your browser and the result updates while you type.

  • Runs in your browser
  • Free, no sign-up
Ctrl + Enter also runs the tool

What this tool gives you

Exact or case-insensitive

Match lines byte for byte, or treat upper and lower case as equal.

Counts

See how many lines came in, how many are unique and how many were removed.

Private

Everything runs in JavaScript on your device; large lists stay local.

Frequently asked questions

Does it keep the original order?

Yes. The first occurrence of each line is kept in its original position and later repeats are dropped, so the list is not re-sorted.

How large can the list be?

Tens of thousands of lines are processed instantly. Browser memory is the only limit, since no data is sent to a server.

Why are two lines that look identical both kept?

They probably differ in trailing spaces or invisible characters. Enable trimming, or run the text through the Strip HTML Tags tool with whitespace collapsing first.

Can I sort the result as well?

Use the Sort Lines tool, which has a unique option built in, so you can deduplicate and sort in a single step there.

From APIVoid

Need security checks inside your own product?

APIVoid turns the lookups you run here into developer-friendly JSON APIs: IP reputation, URL status and redirects, DNS lookups, SSL info, domain age, screenshots and much more. Simple pricing, 30-day free trial.