Python爬虫学习之路（一）—— 使用Urllib爬取网页

1.快速体验之最基础使用:urllib.request.urlopen(url)

import urllib.request
url = "https://m.weibo.cn/"
file = urllib.request.urlopen(url)
data = file.read()
dataline = file.readline()

print(data)

2.以网页的形式保存

file = urllib.request.urlopen(url)
data = file.read()
dataline = file.readline()

fhandle = open("C:/Python3/web/review/weibo.html","wb")
fhandle.write(data)
fhandle.close()

filename = urllib.request.urlretrieve(url,filename="C:/Python3/web/review/weibo2.html")
urllib.request.urlcleanup()

2.headers

1.build_opener()