1.分析
接下来再看一种加密,css加密,以大众点评为例。
访问网址https://www.dianping.com/,搜索关键词比如洗浴,得到如下:
这里的url复制出来之后是这样的:https://www.dianping.com/search/keyword/166/0_%E6%B4%97%E6%B5%B4
其实url中存在中文的话需要url编码和解密,所以需要模拟url编码
from urllib.parse import quote,unquote
wd = "洗浴"
print(quote(wd))
print(unquote("%E6%B4%97%E6%B5%B4"))
%E6%B4%97%E6%B5%B4
洗浴
接下来发送请求,获取响应,检查数据
import requests
from urllib.parse import quote,unquote
wd = "洗浴"
url = "https://www.dianping.com/search/keyword/166/0_{}".format(quote(wd))
headers = {
"user-agent": "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36",
}
response = requests.get(url=url,headers=headers)
print(response.content.decode("utf-8"))
这里页面中显示的奇怪的符号。在响应内容中再找一下。
@font-face {
font-family: "PingFangSC-Regular-address";
src: url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/5a43c7ad.eot");
src: url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/5a43c7ad.eot?#iefix") format("embedded-opentype"),url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/5a43c7ad.woff");
}
.address {
font-family: 'PingFangSC-Regular-address';
}
@font-face {
font-family: "PingFangSC-Regular-shopNum";
src: url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/ae260e6b.eot");
src: url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/ae260e6b.eot?#iefix") format("embedded-opentype"),url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/ae260e6b.woff");
}
.shopNum {
font-family: 'PingFangSC-Regular-shopNum';
}
@font-face {
font-family: "PingFangSC-Regular-tagName";
src: url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/ae260e6b.eot");
src: url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/ae260e6b.eot?#iefix") format("embedded-opentype"),url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/ae260e6b.woff");
}
.tagName {
font-family: 'PingFangSC-Regular-tagName';
}
@font-face {
font-family: "PingFangSC-Regular-reviewTag";
src: url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/a0a72153.eot");
src: url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/a0a72153.eot?#iefix") format("embedded-opentype"),url("//s3plus.meituan.net/v1/mss_73a511b8f91f43d0bdae92584ea6330b/font/a0a72153.woff");
}
.reviewTag