Bulk URL dedupe and sort
Paste thousands of URLs to remove duplicates, sort them and filter by domain. Links that lead to the same page count as duplicates, even if written differently.
- Runs in your browser
- Nothing is uploaded
- Free, no sign-up
By using this, you agree to our Terms and Privacy Policy.
Finds duplicates that look different
A plain text compare keeps all four of these, but they are the same page:
https://example.com/a?b=1&a=2https://www.example.com/a/?a=2&b=1https://example.com/a?a=2&b=1&utm_source=newshttp://example.com/a#section
This tool compares them after removing tracking, sorting parameters, and dropping www., the slash at the end and the # part. It keeps the first one it finds, exactly as you pasted it.
Large lists
Big lists are worked through in small steps, so even fifty thousand lines will not freeze the page. The progress bar shows how far along it is. Everything runs on your device, and nothing is uploaded.
Lines that are not links
Blank lines are ignored. Lines that are not links are skipped and counted, so the result is always a clean list. If the count is high, check what you pasted.