![](https://img-blog.csdnimg.cn/20201014180756780.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
爬虫
ghostyusheng
God build us in his image. Now it is the time to make the real AI in our image!
展开
-
知乎标签详情页爬虫
#!/usr/bin/env pythonimport requestsimport MySQLdbimport reimport jsonimport threadingimport timefrom bs4 import BeautifulSoup# from lxml import etree# headers = {# 'Accept':'text/html,原创 2017-02-03 15:50:21 · 929 阅读 · 0 评论 -
nodejs 简易爬虫
用nodejs编写爬虫跟其他语言一样,比较简单,比较各个语言标准库都差不多,主要就是抓取页面,然后分析dom节点,获取数据。requests 经典的请求库,cherrio 像jquery一样解析dom的库。这里用csdn举例。var request = require('request');var promise = require('bluebird');const cheeri...原创 2018-11-21 23:08:31 · 191 阅读 · 0 评论