PyQuery抓取知乎热门话题问答

最新推荐文章于 2023-10-24 20:14:57 发布

vforlove

最新推荐文章于 2023-10-24 20:14:57 发布

阅读量371

点赞数

分类专栏：学习笔记

学习笔记专栏收录该内容

13 篇文章 0 订阅

订阅专栏

import requests
from pyquery import PyQuery as pq
url = 'https://www.zhihu.com/explore'
headers = {
    'User-Agent': 'Mozilla/4.0 (compatible; MSIE 5.5; Windows NT)'
}
html = requests.get(url, headers = headers).text
doc = pq(html)
items = doc('.explore-tab .feed-item').items()
for item in items:
    question = item.find('h2').text()
    author = item.find('.author-link').text()
    answer = pq(item.find('.content').html()).text().strip()+'\n'
    file = open('explore.txt', 'a', encoding='utf-8')
    file.write('\n'.join([question, author, answer]))
    file.write('\n' + '='*50 + '\n')
    file.close()