linux过滤相同内容,[转载]linux uniq命令:(过滤重复部分显示文件内容)

1 girl took bat home

排序后再显示

============================================

[root@stu100 ~]# uniq -d test

boy took bat home

boy took bat home

dog brought hat home

-d选项仅显示文件中连续重复出现的行。

============================================

[root@stu100 ~]# uniq -u test

girl took bat home

-u选项显示文件中没有连续出现的行。

============================================

[root@stu100 ~]# uniq -f 2 -s 2 test

boy took bat home

忽略每行的前2个字段，忽略第二 个空白字符和第三个字段的首字符，结果at home

============================================

[root@stu100 ~]# uniq -f 1 test

boy took bat home

dog brought hat home

忽 略每行的第一个字段，这样boy ，girl开头的行看起来是连续重复的行。

============================================

[root@stu100 ~]# uniq -D test

boy took bat home

boy took bat home

boy took bat home

boy took bat home

dog brought hat home

dog brought hat home

dog brought hat home

显示所有重复的行，每个重复的行都显示