用Python给文件去重

import sys
list01 = []
file=sys.argv[1]
newfile=sys.argv[2]
for i in open(file):
    if i in list01:
        continue
    list01.append(i)
with open(newfile, 'w') as handle:
    handle.writelines(list01)

使用方法 

python main.py file.txt newfile.txt