// http://vim.wikia.com/wiki/Uniq_-_Removing_duplicate_lines
:sort u
or
g/^\(.*\)$\n\1$/d
or
g/\%(^\1$\n\)\@<=\(.*\)$/d
g//d <-- Delete the lines matching the regexp
\@<= <-- If the bit following matches, make sure the bit preceding this symbol directly precedes the match
\(.*\)$ <-- Match the line into subst register 1
\%( ) <--- Group without placing in a subst register.
^\1$\n <--- Match subst register 1 followed by end of line and the new line between the 2 lines
This does a uniq on the first word in the line, and deletes all but the first line:
g/\%(^\1\>.*$\n\)\@<=\(\k\+\).*$/d