Tool suggestion: Remove duplicate lines

[gregorni]

This would be practical for if you have a long list that might contain duplicate entries. I imagine the tool could be separated into two parts: one that only keeps one of all the duplicate lines, and another tool that just removes all the lines that have duplicates.