首先需要安装爬虫库requests和BeautifulSoup,可以使用pip进行安装。
代码如下:
import requests
from bs4 import BeautifulSoup
keyword = "整人"
url = "https://so.csdn.net/so/search/s.do?p=1&q=" + keyword
res = requests.get(url)
soup = BeautifulSoup(res.text, "html.parser")
for item in soup.select(".search-list .searc