Sorting and Removing Duplicate Lines

sort

Sort lines of text files.

uniq

Remove duplicate lines from a sorted file.

cat *.txt | sort | uniq > result-file