初学python,需要补习相关英语词汇,找到一个词本网站开始想尝试一下爬虫爬取词本
历时4天,各种查资料,写出了第一个符合自己期望的python爬虫,纪念一下!
# -*- coding: utf-8 -*- import requests from bs4 import BeautifulSoup headers={ 'User-Agent':'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.90 Safari/537.36',} for i in range(10): url = "http://book.qsbdc.com/word_list.php?book_id=1895&&tag=all&&group_id=27603&&page_id={}".format(i*1) r = requests.get(url,headers=headers).text bs=BeautifulSoup(r,'html.parser') li1=bs.find_all('span',class_="hidden_1_1") for x in li1: print(x.text)