web scraper——爬取知乎|微博用户数据模板【三】

最新推荐文章于 2024-08-09 22:48:01 发布

weixin_30657541

最新推荐文章于 2024-08-09 22:48:01 发布

阅读量1.3k

点赞数

文章标签：爬虫

原文链接：http://www.cnblogs.com/wangyang0210/p/11115690.html

版权

前言

在这里呢，我就只给模板，不写具体的教程啦，具体的可以参考我之前写的博文。
https://www.cnblogs.com/wangyang0210/p/10338574.html

模板

进入微博选择粉丝较多的博主
复制下面的模板导入站点即可
修改地址,编辑好名称,点击Import Sitemap即可

微博

{"_id":"weibo_chenglong","startUrl":["https://weibo.com/p/1006051234552257/follow?relate=fans&page=[1-5]"],"selectors":[{"id":"userinfo","type":"SelectorElement","parentSelectors":["_root"],"selector":"li.follow_item","multiple":true,"delay":6},{"id":"username","type":"SelectorText","parentSelectors":["userinfo"],"selector":"a.S_txt1","multiple":false,"regex":"","delay":0},{"id":"avatar","type":"SelectorImage","parentSelectors":["userinfo"],"selector":"img","multiple":false,"delay":0},{"id":"city","type":"SelectorText","parentSelectors":["userinfo"],"selector":"div.info_add span","multiple":false,"regex":"","delay":0}]}

知乎

{"_id":"zhihuranqiqigongzuoshi","startUrl":["https://www.zhihu.com/people/xie-ling-520/followers?page=[1-45]"],"selectors":[{"id":"list","type":"SelectorElement","parentSelectors":["_root"],"selector":"div.List-item","multiple":true,"delay":0},{"id":"username","type":"SelectorText","parentSelectors":["list"],"selector":"div.UserItem-title","multiple":false,"regex":"","delay":0},{"id":"avatar","type":"SelectorImage","parentSelectors":["list"],"selector":"img","multiple":false,"delay":0}]}

转载于:https://www.cnblogs.com/wangyang0210/p/11115690.html