爬取网页的时候,爬取不到源码,显示
Javascript is required. Please enable javascript before you are allowed to see this page.去论坛里搜索了问题,发现好像只有我一个人有这个问题
下面是我的代码
// 请把代码文本粘贴到下方(请勿用图片代替代码)
def get_page(page):
url = 'http://cambb.cc/forum.php?'
data={
"mod":"forumdisplay",
"fid":"37",
'filter':'',
"orderby":"lastpost",
"page":page,
"t":"1892855",
}
headers={
'Accept-Encoding':'gzip,deflate',
'Accept-Language':'zh-CN,zh;q=0.9',
'User-Agent':'Mozilla/5.0(WindowsNT6.1;Win64;x64)AppleWebKit/537.36(KHTML,likeGecko)Chrome/69.0.3497.100Safari/537.36',
'Accept':'*/*',
'Referer':'http://cambb.c