Developer tools
Remove duplicates from CSV
Delete repeated rows by whole row or by the columns you choose. Every field you keep stays exactly as it was. It runs in your browser.
Processed in your browser
1. Input CSV data
Choose a UTF-8 CSV file or paste CSV below.
Enable JavaScript to remove duplicates.
2. Duplicate criteria
Comparison options never edit retained fields. Surviving rows stay in their original order.
Results
No result yet
Removed records
Kept records
Copy and download include every retained record and column.
How to remove duplicate rows from a CSV file
Add your CSV
Select Choose file for a UTF-8 file, or paste CSV into Paste CSV data. Files and pasted text are read at once. After typing changes, select Read columns. Check Delimiter and First row is a header. Changing either reads the input again.
Choose what counts as a duplicate
Leave Compare on Whole row, or choose Selected columns and tick the columns that identify a record, such as an email column. Pick First occurrence or Last occurrence.
Remove and save
Select Remove duplicates. Check the counts and the Removed records list, then select Download CSV or Copy CSV.
Example: six rows, two repeats
Load example gives six data rows. Rows 3 and 5 repeat rows 1 and 2, including a note with a line break inside quotes. Remove duplicates with the defaults keeps 4 rows and removes 2, and the Removed records list shows which kept record each one matched. The ids 001 to 004 keep their leading zeros.
Comparison and order
By default, field strings must match exactly, including case and whitespace. Whole rows must also have the same number of fields. A missing field is different from an empty field, even when matching selected columns.
Trim removes leading and trailing JavaScript whitespace for comparison only. Ignore case uses JavaScript Unicode lowercase, without locale-specific matching or Unicode normalization: ß does not match SS, Turkish İ does not match i, and a precomposed é does not match e followed by a combining accent. Number-like text is never parsed, so 1, 1.0 and 01 stay different. Quoted and unquoted forms of the same text are equal. First/last means the first/last matching data record; the header is never deduplicated. The surviving records keep their original relative order.
Field values and export
Leading zeros, large numbers, quoted delimiters and quoted newlines stay strings. Duplicate and blank headers remain positional. Short rows retain their field counts. The preview labels empty and missing cells separately; these labels and preview row numbers are not exported.
Typed and pasted text uses your browser's LF line endings. Choose file to preserve the original line breaks inside quoted fields.
Output uses UTF-8, the detected or selected delimiter, quoted fields, doubled inner quotes and CRLF record separators. Original quoting and record separators are normalized; an initial BOM is omitted. No formula prefixes are added. Spreadsheets may interpret formulas, dates or numbers: import columns as text when needed.
Questions
How do I remove duplicates based on one column?
Set Compare to Selected columns, use Select none, then tick that one column. Rows with the same value in it count as duplicates, even when other columns differ. Keep decides whether the first or the last of them stays.
Can it ignore case and extra spaces?
Yes. Tick Ignore case, Trim whitespace for comparison or both. They affect the match only: the rows you keep are saved with their original text. To change the text itself, use CSV Clean Cells.
Which files can I use?
UTF-8 CSV or TSV with double-quoted fields. Auto-detect tries comma, semicolon, tab and pipe; choose the Delimiter yourself if the columns look wrong. An unclosed quote, invalid UTF-8 or a UTF-16 file stops with an error, and a quote error names the record.
Is there a row or file size limit?
The tool sets no cap; your browser's memory is the limit. The kept preview shows 25 rows and 8 columns at a time. Use Next rows and Next columns to see the rest, or scroll a wide table sideways. Removed records shows the first 100 removals and their first 8 columns. Copy CSV and Download CSV include every kept row and column.
What happens with an empty file or blank rows?
An empty file produces an empty download. A header-only file keeps its header and has no data rows to compare. Blank records count as values and can match each other. A final line break ends the preceding record without adding another blank record.
Can I repeat or cancel duplicate removal?
Changing a comparison option clears the result. Select Remove duplicates again to use the original input with the new criteria. Cancel stops reading or removing duplicates and keeps your input. Select Read columns to continue. If you cancel a replacement file, the previous input stays ready. A replacement file that cannot be read also keeps the previous result. Reset clears the input, options and result. It cannot erase downloads or clipboard contents.
Is my CSV uploaded?
No. The file is read and compared in your browser, and nothing is uploaded or stored. Reset clears the input, the options and the result.