注意不是
request，那是另一个模块。
requests 模块获取http回复十分方便，一句requests.get(url)即可搞定。
下面贴上从mliucixin.zuopinj.com/抓取刘慈欣小说全集的代码：
from re import findall
from time import sleep
import requests
end, start = 202227+1, 201980
num = end-start
with open('lcx.html', 'w', encoding='utf-8') as f:
last_novel = ''
for i in range(num):
r = requests.get(
'http://mliucixin.zuopinj.com/5561/%d.html' % (start+i))
text = r.text.replace('\r\n', '')
novel, chapter = findall(
pattern='<meta name="keywords" content="(.*?)" />', string=text)[0].split(',')
p = findall(pattern='<p>(.*?)</p>', string=text)[0]
if novel != last_novel:
f.write('<h1>%s</h1>\n' % novel)
last_novel = novel
f.write('<h2>%s</h2>\n' % chapter)
print('writing', start+i, novel, chapter)
f.write(p)
f.write('\n')
sleep(0.2)
几点说明：
- 该网站url十分简单，只需一个for循环改改变最后.html前的数字即可抓取全集。
end, start = 202227+1, 201980
num = end-start
for i in range(num):
r = requests.get('http://mliucixin.zuopinj.com/5561/%d.html' % (start+i))
抓到的网页大概是这样的：
<!doctype html>
<html
最低0.47元/天 解锁文章
8888
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
