三剑客
Steve Blenheim:238-923-7366:95 Latham Lane, Easton, PA 83755:11/12/56:20300 Betty Boop:245-836-8357:635 Cutesy Lane, Hollywood, CA 91464:6/23/23:14500 Igor Chevsky:385-375-8395:3567 Populus Place, Caldwell, NJ 23875:6/18/68:23400 Norma Corder:397-857-2735:74 Pine Street, Dearborn, MI 23874:3/28/45:245700 Jennifer Cowan:548-834-2348:583 Laurel Ave., Kingsville, TX 83745:10/1/35:58900 Jon DeLoach:408-253-3122:123 Park St., San Jose, CA 04086:7/25/53:85100 Karen Evich:284-758-2857:23 Edgecliff Place, Lincoln, NB 92086:7/25/53:85100 Karen Evich:284-758-2867:23 Edgecliff Place, Lincoln, NB 92743:11/3/35:58200 Karen Evich:284-758-2867:23 Edgecliff Place, Lincoln, NB 92743:11/3/35:58200 Fred Fardbarkle:674-843-1385:20 Parak Lane, DeLuth, MN 23850:4/12/23:780900 Fred Fardbarkle:674-843-1385:20 Parak Lane, DeLuth, MN 23850:4/12/23:780900 Lori Gortz:327-832-5728:3465 Mirlo Street, Peabody, MA 34756:10/2/65:35200 Paco Gutierrez:835-365-1284:454 Easy Street, Decatur, IL 75732:2/28/53:123500 Ephram Hardy:293-259-5395:235 CarltonLane, Joliet, IL 73858:8/12/20:56700 James Ikeda:834-938-8376:23445 Aster Ave., Allentown, NJ 83745:12/1/38:45000 Barbara Kertz:385-573-8326:832 Ponce Drive, Gary, IN 83756:12/1/46:268500 Lesley Kirstin:408-456-1234:4 Harvard Square, Boston, MA 02133:4/22/62:52600 William Kopf:846-836-2837:6937 Ware Road, Milton, PA 93756:9/21/46:43500 Sir Lancelot:837-835-8257:474 Camelot Boulevard, Bath, WY 28356:5/13/69:24500 Jesse Neal:408-233-8971:45 Rose Terrace, San Francisco, CA 92303:2/3/36:25000 Zippy Pinhead:834-823-8319:2356 Bizarro Ave., Farmount, IL 84357:1/1/67:89500 Arthur Putie:923-835-8745:23 Wimp Lane, Kensington, DL 38758:8/31/69:126000 Popeye Sailor:156-454-3322:945 Bluto Street, Anywhere, USA 29358:3/19/35:22350 Jose Santiago:385-898-8357:38 Fife Way, Abilene, TX 39673:1/5/58:95600 Tommy Savage:408-724-0140:1222 Oxbow Court, Sunnyvale, CA 94087:5/19/66:34200 Yukio Takeshida:387-827-1095:13 Uno Lane, Ashville, NC 23556:7/1/29:57000 Vinh Tranh:438-910-7449:8235 Maple Street
一、grep命令练习
-
显示所有包含San的行
grep 'San' file
2.显示所有以J开始的人名所在的行
grep '^J' file
3.显示所有以700结尾的行
grep '700$' file
4.显示所有不包括834的行
grep -v '834' file
5.显示所有生日在December的行
grep ':12/' file
6.显示所有电话号码的区号为498的行
grep ':498-' file
7.显示所有这样的行:它包含一个大写字母,后跟四个小写字母,一个冒号,一个空格,和一个大写字母
egrep '[A-Z][a-z]{4}: [A-Z]' file
8.显示姓以K或k开头的行
grep -i '^k' file
9.显示工资为六位数的行,并在前面加行号
egrep -n '[0-9]{6}$' file
10.显示包括Lincoln或lincoln的行,并且grep对大小写不敏感.
grep -i 'lincoln' file
二.sed命令大练习 1.把Jon的名字改成Jonathan.
sed -ri 's#Jon#Jonathan#' file
2.删除头三行
sed -i '1,3d' file
3.显示5-10行
sed -n '5,10p' file
4.删除包含Lane的行.
sed -i '/Lane/d' file
5.显示所有生日在November-December之间的行
sed -nr '/.*:(11|12)\/.*/p' file
6.把三个星号(***)添加到以Fred开头的行
sed -i '/^Fred/s#^#***#' file
7.用JOSE HAS RETIRED取代包含Jose的行
sed -i '/Jose/s#.*Jose.*#JOSE HAS RETIRED#' file
8.把Popeye的生日改成11/14/46
sed -i '/Popeye/s#3/19/35#11/14/46#' file
9.删除所有空白行
sed -i '/^$/d' file
三.awk命令大练习
Mike Harrington:[510] 548-1278:250:100:175 Christian Dobbins:[408] 538-2358:155:90:201 Susan Dalsass:[206] 654-6279:250:60:50 Archie McNichol:[206] 548-1348:250:100:175 Jody Savage:[206] 548-1278:15:188:150 Guy Quigley:[916] 343-6410:250:100:175 Dan Savage:[406] 298-7744:450:300:275 Nancy McNeil:[206] 548-1278:250:80:75 John Goldenrod:[916] 348-4278:250:100:175 Chet Main:[510] 548-5258:50:95:135 Tom Savage:[408] 926-3456:250:168:200 Elizabeth Stachelin:[916] 440-1763:175:75:300
1.显示所有电话号码
awk -F"[ :]" '{print $4}' file
2.显示Dan的电话号码
awk -F"[ :]" '/Dan/{print $4}' file
3.显示Susan的名字和电话号码
awk -F"[ :]" '/Susan/{print $1,$4}' file
4.显示所有以D开头的姓
awk -F"[ :]" '$2 ~ /^D/{print $2}' file
5.显示所有以一个C或E开头的名
awk -F"[ :]" '$1 ~ /^(C|E)/{print $1}' file
6.显示所有只有四个字符的名
awk -F"[ :]" '$1 ~ /\<....\>/{print $1}' file
7.显示所有区号为916的人名
awk -F"[ :]" '$3 ~ /\<916\>/{print $1}' file
8.显示Mike的捐款.显示每个值时都有以$开头.如$250$100$175
awk -F"[ :]" -v OFS="$" '/Mike/{print "$"$5,$6,$7}' file
9.显示姓,其后跟一个逗号和名,如Jody,Savage
awk -F"[ :]" '{print $1","$2}' file
企业实践作业: 1、获取根分区剩余大小
df -h |grep -w / | awk '{print "根分区剩余:"$4}'
2、获取当前机器ip地址
ifconfig ens33 | sed -n '/inet.*netmask/p' | awk '{print $2}'
3、统计出apache的access.log中访问量最多的5个IP
awk '{a[$1]++}END{for ( i in a) print a[i],i}' /var/log/httpd/access_log | sort -rn | head -5
4、打印/etc/passwd中UID大于500的用户名和uid
awk -F: '{if ($3 > 500) print $1,$3}' /etc/passwd
5、/etc/passwd 中匹配包含root或net或ucp的任意行
egrep '(root|net|udp)' /etc/passwd
6、处理以下文件内容,将域名取出并根据域名进行计数排序处理(百度搜狐面试题) test.txt
http://www.uplooking.com/index.html http://www.uplooking.com/1.html http://post.uplooking.com/index.html http://mp3.uplooking.com/index.html http://www.uplooking.com/3.html http://post.uplooking.com/2.html
awk -F"/" '{a[$3]++}END{for (i in a) print a[i],i}' file | sort -rn
7、输出记录最多的IP [腾讯面试题]:一个文本类型的文件,里面每行存放一个登陆者的IP(某些行是重复的),请输出登陆次数最多的用户。 Ip_input.txt的内容假设如下: 219.217.49.14 175.43.4.87 87.48.98.1 59.73.38.25 219.217.50.14 59.92.48.32 219.217.49.14 59.72.38.142 59.73.38.25 219.217.49.14
awk '{a[$1]++}END{for (i in a) print a[i],i}' file | sort -rn | head -1 | awk '{print $2}'
8、文件内容如下 1.1.1.1 11 1.1.1.1 22 1.1.1.1 33 1.1.1.1 44 2.2.2.2 11 2.2.2.2 22 2.2.2.2 33 2.2.2.2 44 要求使用awk将文件输出: 1.1.1.1 11 22 33 44 2.2.2.2 11 22 33 44
awk '{a[$1]=a[$1]" "$2}END{for (i in a) print i,a[i]}' file
9、把1 2 3 4 5 6按如下格式输出 1 2 3 4 5 6 如何实现
awk -v OFS="\n" '{print $1,$2,$3,$5,$5,$6}' file