一个爬取豆瓣电影名称的例子:
import requests
from bs4 import BeautifulSoup
url2="https://movie.douban.com/top250?start=0&filter="
hs={'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36',}
res = requests.get(url2, headers=hs)
print(res.status_code)
text = res.text
#print(text)
soup = BeautifulSoup(text,'html.parser')
tags = soup('img')
for tag in tags:
result=tag['alt']+":"+tag['src']
print(result)
识别的结果如下: