Remove duplicated rows of a csv or tsv file

Print duplicates: $ sort file.csv | uniq -d Create a new file without duplicates: $ awk !seen[$0]++ file.csv > no_dup.csv