(本节初步介绍正则表达式检索,讨论电影信息类的设计,以抓取吉林大学中心校区电影院当日影讯为例,仅作为一个练习,不讨论面向对象相关的技术)
$2.1 爬虫与正则表达式检索
$2.1.1 网络爬虫
网络爬虫对网页源代码进行分析,搜索有价值的信息(其中也包括更多的网页链接),通过不断读取对应网页中的有用信息,网络爬虫可以完成快速筛选多个网页中目标内容的任务.
有两个技术是编写网络爬虫所需要具备的
· 网络技术相关: 初步了解html等网页设计语言,初步了解网络协议等概念
· 搜索技术相关: 了解正则表达式的概念,能够从给定文本中检索符合一定格式的字段
对于前者,matlab提供了简洁的获取网页源代码的方式,即确保网络联通的情况下,使用
urlread('http://****')即可获取网页源代码,无需爬虫作者熟悉网络协议等知识,方便了网页信息的获得.
$2.1.2 正则表达式
(我们在C语言之类的通识课程中,学到过scanf之类的函数,有可能会介绍正则表达式,如果已经有相关的知识,可以跳过这部分)
正则表达式即符合一定规律(regular)的表达方式(expression).
我们所知道的最简单的文本检索方式是逐个字符匹配,多数文本编辑器都支持逐个字符的匹配检索,例如,在Windows的记事本中,使用快捷键 Ctrl+F 即可调出检索框,输入 woman 即可得到所有 woman 字串出现的位置. MS word 和 VC++6.0 的文本编辑部分也支持 Ctrl+F 的热键以及检索功能.
仍就上例而言,加入我们知道文本当中单词 woman 可能以其复数形式 women 出现,自然检索出的结果也应该包括这些复数形式出现的位置.这两个单词(字串)符合相同的规律: wom_n 下划线处为 a 或 e,因此我们可以考虑使用约定的规则表示出这种相似的格式,表示本例格式的正则表达式为 wom[ae]n, 下表为正则表达式常用的记号及含义:
| 表达式 | 含义 |
|---|---|
| [x,y,z] | 字母x或y或z |
| [A-Z] | 字母A到Z中的一个 |
| (z)+ | 若干个字母z,但至少为1个 |
| apple(s)* | apple或apples(或apple结尾有更多s) |
| \w | 任意1个非空白字符 |
| . | 任意一个字符,包括空格 |
| ^\n | 非回车符的任一字符 |
| \{ | 将大括号转义为大括号字符 |
下面就一段 时光网-吉大中心校区影城2017年5月15日的页面源代码进行分析
使用urlread(‘http://theater.mtime.com/China_Jilin_Province_Changchun/7256/‘)命令获取该页面的源代码,为抓取该影城的影讯,我们对如下代码段感兴趣:
"movies":[{"movieId":232932,"movieTitleCn":"摔跤吧！爸爸","movieTitleEn":"Dangal","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/05/05/095011.35177856.jpg","bigRating":8,"smallRating":6,"trailerId":65418,"director":"尼特什·提瓦瑞","actor":"阿米尔·汗","actor2":"法缇玛·萨那·纱卡","runtime":"169分钟(印度) / 140分钟(中国)","property":"喜剧/动作/家庭/剧情/运动/传记","viewProperty":"喜剧/动作/家庭/剧情..","movieDetailUrl":"http://movie.mtime.com/232932/","year":"2016"},{"movieId":216008,"movieTitleCn":"银河护卫队2","movieTitleEn":"Guardians of the Galaxy Vol. 2","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/01/164328.75628704.jpg","bigRating":7,"smallRating":9,"trailerId":65630,"director":"詹姆斯·古恩","actor":"克里斯·帕拉特","actor2":"佐伊·索尔达娜","runtime":"137分钟","property":"动作/冒险/科幻","viewProperty":"动作/冒险/科幻","movieDetailUrl":"http://movie.mtime.com/216008/","year":"2017"},{"movieId":216639,"movieTitleCn":"亚瑟王：斗兽争霸","movieTitleEn":"King Arthur: Legend of the Sword","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/02/090753.76849772.jpg","bigRating":7,"smallRating":2,"trailerId":65639,"director":"盖·里奇","actor":"查理·汉纳姆","actor2":"裘德·洛","runtime":"126分钟","property":"动作/冒险/剧情/奇幻","viewProperty":"动作/冒险/剧情/奇幻","movieDetailUrl":"http://movie.mtime.com/216639/","year":"2017"},{"movieId":234691,"movieTitleCn":"提着心吊着胆","movieTitleEn":"Absurd Accident","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/27/173951.68512730.jpg","bigRating":7,"smallRating":0,"trailerId":65337,"director":"李雨禾","actor":"高叶","actor2":"陈玺旭","runtime":"97 min","property":"剧情/喜剧","viewProperty":"剧情/喜剧","movieDetailUrl":"http://movie.mtime.com/234691/","year":"2017"},{"movieId":237670,"movieTitleCn":"麻烦家族","movieTitleEn":"What A Wonderful Family","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/05/08/120900.48696365.jpg","bigRating":5,"smallRating":9,"trailerId":65701,"director":"黄磊","actor":"黄磊","actor2":"海清","runtime":"103分钟","property":"喜剧","viewProperty":"喜剧","movieDetailUrl":"http://movie.mtime.com/237670/","year":"2017"},{"movieId":232603,"movieTitleCn":"拆弹专家","movieTitleEn":"Shock Wave","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/11/172134.83722960.jpg","bigRating":7,"smallRating":0,"trailerId":65535,"director":"邱礼涛","actor":"刘德华","actor2":"姜武","runtime":"120分钟","property":"动作/悬疑/犯罪","viewProperty":"动作/悬疑/犯罪","movieDetailUrl":"http://movie.mtime.com/232603/","year":"2017"},{"movieId":233371,"movieTitleCn":"记忆大师","movieTitleEn":"Battle of Memories","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/13/104224.22044736.jpg","bigRating":7,"smallRating":3,"trailerId":65491,"director":"陈正道","actor":"黄渤","actor2":"徐静蕾","runtime":"110分钟","property":"剧情/悬疑","viewProperty":"剧情/悬疑","movieDetailUrl":"http://movie.mtime.com/233371/","year":"2017"},{"movieId":241480,"movieTitleCn":"毒。诫","movieTitleEn":"Dealer Healer","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/24/133049.69960821.jpg","bigRating":7,"smallRating":0,"trailerId":65682,"director":"刘国昌","actor":"刘青云","actor2":"林家栋","runtime":"100分钟","property":"动作/剧情/犯罪","viewProperty":"动作/剧情/犯罪","movieDetailUrl":"http://movie.mtime.com/241480/","year":"2017"},{"movieId":215833,"movieTitleCn":"超凡战队","movieTitleEn":"Power Rangers","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/25/111538.60897966.jpg","bigRating":5,"smallRating":9,"trailerId":65593,"director":"迪恩·以色列特","actor":"达克雷·蒙特戈梅里","actor2":"娜奥米·斯科特","runtime":"124分钟","property":"动作/冒险/科幻","viewProperty":"动作/冒险/科幻","movieDetailUrl":"http://movie.mtime.com/215833/","year":"2017"}],"showtimes":[{"showtimeId":0,"movieId":232932,"realtime":new Date("May, 15 2017 09:10:00"),"version":"2D","language":"外语原版","movieEndTime":"预计11:30散场","hallId":29130,"hallName":"6号厅","seatCount":136,"isSale":false,"price":"","mtimePrice":0,"seatUrl":"#","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":0,"movieId":216008,"realtime":new Date("May, 15 2017 09:15:00"),"version":"3D","language":"英文版","movieEndTime":"预计11:31散场","hallId":29125,"hallName":"1号厅","seatCount":133,"isSale":false,"price":"","mtimePrice":0,"seatUrl":"#","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":0,"movieId":216639,"realtime":new Date("May, 15 2017 09:20:00"),"version":"3D","language":"英文版","movieEndTime":"预计11:27散场","hallId":29129,"hallName":"5号厅","seatCount":135,"isSale":false,"price":"","mtimePrice":0,"seatUrl":"#","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":0,"movieId":232603,"realtime":new Date("May, 15 2017 09:30:00"),"version":"2D","language":"中文版","movieEndTime":"预计11:30散场","hallId":29127,"hallName":"3号厅","seatCount":140,"isSale":false,"price":"","mtimePrice":0,"seatUrl":"#","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":0,"movieId":234691,"realtime":new Date("May, 15 2017 09:40:00"),"version":"2D","language":"中文版","movieEndTime":"预计11:17散场","hallId":29126,"hallName":"2号厅","seatCount":124,"isSale":false,"price":"","mtimePrice":0,"seatUrl":"#","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126123,"movieId":232932,"realtime":new Date("May, 15 2017 15:10:00"),"version":"2D","language":"外语原版","movieEndTime":"预计17:30散场","hallId":29131,"hallName":"7号厅","seatCount":270,"isSale":true,"price":"","mtimePrice":30,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504479/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126106,"movieId":216008,"realtime":new Date("May, 15 2017 15:20:00"),"version":"3D","language":"英文版","movieEndTime":"预计17:36散场","hallId":29126,"hallName":"2号厅","seatCount":124,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504461/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126105,"movieId":215833,"realtime":new Date("May, 15 2017 16:10:00"),"version":"3D","language":"英文版","movieEndTime":"预计18:15散场","hallId":29125,"hallName":"1号厅","seatCount":133,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504457/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126120,"movieId":232932,"realtime":new Date("May, 15 2017 16:20:00"),"version":"2D","language":"外语原版","movieEndTime":"预计18:40散场","hallId":29130,"hallName":"6号厅","seatCount":136,"isSale":true,"price":"","mtimePrice":28,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504476/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126113,"movieId":237670,"realtime":new Date("May, 15 2017 16:30:00"),"version":"2D","language":"中文版","movieEndTime":"预计18:13散场","hallId":29127,"hallName":"3号厅","seatCount":140,"isSale":true,"price":"","mtimePrice":38,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504468/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126110,"movieId":216639,"realtime":new Date("May, 15 2017 17:15:00"),"version":"3D","language":"英文版","movieEndTime":"预计19:22散场","hallId":29129,"hallName":"5号厅","seatCount":135,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504472/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126122,"movieId":232932,"realtime":new Date("May, 15 2017 17:45:00"),"version":"2D","language":"外语原版","movieEndTime":"预计20:05散场","hallId":29131,"hallName":"7号厅","seatCount":270,"isSale":true,"price":"","mtimePrice":30,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504480/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126115,"movieId":234691,"realtime":new Date("May, 15 2017 18:00:00"),"version":"2D","language":"中文版","movieEndTime":"预计19:37散场","hallId":29126,"hallName":"2号厅","seatCount":124,"isSale":true,"price":"","mtimePrice":28,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504464/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126112,"movieId":241480,"realtime":new Date("May, 15 2017 18:30:00"),"version":"2D","language":"中文版","movieEndTime":"预计20:10散场","hallId":29127,"hallName":"3号厅","seatCount":140,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504470/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126108,"movieId":216008,"realtime":new Date("May, 15 2017 18:40:00"),"version":"3D","language":"英文版","movieEndTime":"预计20:56散场","hallId":29125,"hallName":"1号厅","seatCount":133,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504459/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126119,"movieId":232932,"realtime":new Date("May, 15 2017 19:00:00"),"version":"2D","language":"外语原版","movieEndTime":"预计21:20散场","hallId":29130,"hallName":"6号厅","seatCount":136,"isSale":true,"price":"","mtimePrice":28,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504477/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126109,"movieId":216639,"realtime":new Date("May, 15 2017 19:40:00"),"version":"3D","language":"英文版","movieEndTime":"预计21:47散场","hallId":29129,"hallName":"5号厅","seatCount":135,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504473/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126107,"movieId":216008,"realtime":new Date("May, 15 2017 20:00:00"),"version":"3D","language":"英文版","movieEndTime":"预计22:16散场","hallId":29126,"hallName":"2号厅","seatCount":124,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504462/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126121,"movieId":232932,"realtime":new Date("May, 15 2017 20:20:00"),"version":"2D","language":"外语原版","movieEndTime":"预计22:40散场","hallId":29131,"hallName":"7号厅","seatCount":270,"isSale":true,"price":"","mtimePrice":35,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504481/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126111,"movieId":237670,"realtime":new Date("May, 15 2017 20:30:00"),"version":"2D","language":"中文版","movieEndTime":"预计22:13散场","hallId":29127,"hallName":"3号厅","seatCount":140,"isSale":true,"price":"","mtimePrice":38,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504469/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126102,"movieId":216008,"realtime":new Date("May, 15 2017 21:15:00"),"version":"3D","language":"英文版","movieEndTime":"预计23:31散场","hallId":29125,"hallName":"1号厅","seatCount":133,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504460/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126118,"movieId":232932,"realtime":new Date("May, 15 2017 21:40:00"),"version":"2D","language":"外语原版","movieEndTime":"预计00:00散场","hallId":29130,"hallName":"6号厅","seatCount":136,"isSale":true,"price":"","mtimePrice":23,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504478/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126100,"movieId":233371,"realtime":new Date("May, 15 2017 22:05:00"),"version":"2D","language":"中文版","movieEndTime":"预计00:04散场","hallId":29129,"hallName":"5号厅","seatCount":135,"isSale":true,"price":"","mtimePrice":33,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504474/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126099,"movieId":232603,"realtime":new Date("May, 15 2017 22:30:00"),"version":"2D","language":"中文版","movieEndTime":"预计00:30散场","hallId":29127,"hallName":"3号厅","seatCount":140,"isSale":true,"price":"","mtimePrice":18,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504467/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""},{"showtimeId":253126114,"movieId":234691,"realtime":new Date("May, 15 2017 22:40:00"),"version":"2D","language":"中文版","movieEndTime":"预计00:17散场","hallId":29126,"hallName":"2号厅","seatCount":124,"isSale":true,"price":"","mtimePrice":28,"seatUrl":"http://piao.mtime.com/onlineticket/showtime/1643504465/","isContinueShowtime":false,"continueMovies":[],"isMorrowShowtime":false,"specialTitle":""}]该代码段有如下特征:
·以 “movies”:[ 起始,以 ] 终止
·中间不包括换行符(是的,这就是上面的代码看上去一团糟的原因)
我们使用下列命令来获取这段内容:
key='"movies":\[[^\n]*\]';
info=regexp(urlread('http://theater.mtime.com/China_Jilin_Province_Changchun/7256/'),key,'match');我们将获得目标html代码,它被记录在元胞数组info中,之后我们需要从这个数组中提取出电影信息和场次信息,同样分析代码格式:
·电影信息:
{"movieId":232932,"movieTitleCn":"摔跤吧！爸爸","movieTitleEn":"Dangal","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/05/05/095011.35177856.jpg","bigRating":8,"smallRating":6,"trailerId":65418,"director":"尼特什·提瓦瑞","actor":"阿米尔·汗","actor2":"法缇玛·萨那·纱卡","runtime":"169分钟(印度) / 140分钟(中国)","property":"喜剧/动作/家庭/剧情/运动/传记","viewProperty":"喜剧/动作/家庭/剧情..","movieDetailUrl":"http://movie.mtime.com/232932/","year":"2016"}
{"movieId":216008,"movieTitleCn":"银河护卫队2","movieTitleEn":"Guardians of the Galaxy Vol. 2","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/01/164328.75628704.jpg","bigRating":7,"smallRating":9,"trailerId":65630,"director":"詹姆斯·古恩","actor":"克里斯·帕拉特","actor2":"佐伊·索尔达娜","runtime":"137分钟","property":"动作/冒险/科幻","viewProperty":"动作/冒险/科幻","movieDetailUrl":"http://movie.mtime.com/216008/","year":"2017"}
{"movieId":216639,"movieTitleCn":"亚瑟王：斗兽争霸","movieTitleEn":"King Arthur: Legend of the Sword","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/02/090753.76849772.jpg","bigRating":7,"smallRating":2,"trailerId":65639,"director":"盖·里奇","actor":"查理·汉纳姆","actor2":"裘德·洛","runtime":"126分钟","property":"动作/冒险/剧情/奇幻","viewProperty":"动作/冒险/剧情/奇幻","movieDetailUrl":"http://movie.mtime.com/216639/","year":"2017"}
{"movieId":234691,"movieTitleCn":"提着心吊着胆","movieTitleEn":"Absurd Accident","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/27/173951.68512730.jpg","bigRating":7,"smallRating":0,"trailerId":65337,"director":"李雨禾","actor":"高叶","actor2":"陈玺旭","runtime":"97 min","property":"剧情/喜剧","viewProperty":"剧情/喜剧","movieDetailUrl":"http://movie.mtime.com/234691/","year":"2017"}
{"movieId":237670,"movieTitleCn":"麻烦家族","movieTitleEn":"What A Wonderful Family","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/05/08/120900.48696365.jpg","bigRating":5,"smallRating":9,"trailerId":65701,"director":"黄磊","actor":"黄磊","actor2":"海清","runtime":"103分钟","property":"喜剧","viewProperty":"喜剧","movieDetailUrl":"http://movie.mtime.com/237670/","year":"2017"}
{"movieId":232603,"movieTitleCn":"拆弹专家","movieTitleEn":"Shock Wave","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/11/172134.83722960.jpg","bigRating":7,"smallRating":0,"trailerId":65535,"director":"邱礼涛","actor":"刘德华","actor2":"姜武","runtime":"120分钟","property":"动作/悬疑/犯罪","viewProperty":"动作/悬疑/犯罪","movieDetailUrl":"http://movie.mtime.com/232603/","year":"2017"}
{"movieId":233371,"movieTitleCn":"记忆大师","movieTitleEn":"Battle of Memories","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/13/104224.22044736.jpg","bigRating":7,"smallRating":3,"trailerId":65491,"director":"陈正道","actor":"黄渤","actor2":"徐静蕾","runtime":"110分钟","property":"剧情/悬疑","viewProperty":"剧情/悬疑","movieDetailUrl":"http://movie.mtime.com/233371/","year":"2017"}
{"movieId":241480,"movieTitleCn":"毒。诫","movieTitleEn":"Dealer Healer","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/24/133049.69960821.jpg","bigRating":7,"smallRating":0,"trailerId":65682,"director":"刘国昌","actor":"刘青云","actor2":"林家栋","runtime":"100分钟","property":"动作/剧情/犯罪","viewProperty":"动作/剧情/犯罪","movieDetailUrl":"http://movie.mtime.com/241480/","year":"2017"}
{"movieId":215833,"movieTitleCn":"超凡战队","movieTitleEn":"Power Rangers","coverSrc":"http://img31.mtime.cn/mt/[i5]2017/04/25/111538.60897966.jpg","bigRating":5,"smallRating":9,"trailerId":65593,"director":"迪恩·以色列特","actor":"达克雷·蒙特戈梅里","actor2":"娜奥米·斯科特","runtime":"124分钟","property":"动作/冒险/科幻","viewProperty":"动作/冒险/科幻","movieDetailUrl":"http://movie.mtime.com/215833/","year":"2017"}该代码段的格式特征可由如下正则表达式给出:
\{"movieId"[^\}]*\}依此格式检索,输出方式选择匹配(match),至此,我们就已经获得了该影院当天上映电影的信息,类似的我们还可以读取场次信息:
MovieList=regexp(info,'\{"movieId"[^\}]*\}','match');
ShowTimeList=regexp(info,'\{"showtimeId"[^\}]*\}','match');$2.1.3 爬取更多页面
如果我们能够获得某一html代码中指向其它页面的链接,就可能继续读取这些被指页面的源代码,这也是爬虫设计的基本思路,不同于页面抓取,爬虫可以自动访问更多的页面,这里我们不向下爬取过多的页面,只是做一个示范,在获取上述信息后,键入:
urlList{1}=regexp(MovieList,'"movieDetailUrl":"([^"])*"','tokens');其中正则表达式相关写法不必再叙,’tokens’输出模式将会直接把圆括号内的内容返回,这里返回了一个包含字串 http://movie.mtime.com/232932/ 的元胞数组,可以将这个字串传递给urlread函数,读取该电影详情页面.
(未完)
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
