CSS SELECTOR

最新推荐文章于 2024-05-29 22:48:09 发布

learner_pu

最新推荐文章于 2024-05-29 22:48:09 发布

阅读量94

点赞数

分类专栏： python

本文链接：https://blog.csdn.net/qq_38408573/article/details/104486874

版权

python 专栏收录该内容

18 篇文章 0 订阅

订阅专栏


```python
import requests
from bs4 import BeautifulSoup

url = 'https://xueqiu.com/ask/square'

headers = {
    'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.116 Safari/537.36'
}
reponse = requests.get(url, headers = headers)

soup = BeautifulSoup(reponse.text, 'lxml')   # lxml是解析工具

# 定位标签
# 相当于xpath的//title
title_tag = soup.select('title')
print(title_tag)
# 获取tag中的内容
print(title_tag[0].text)

# XPATH://head/meta
# CSS SELECTOR:head > meta
meta_tag_list = soup.select('head > meta')
print(meta_tag_list)

# XPATH: //head/meta[@content]/@content
# CSS SELECTOR : head > meta[content]
meta_tag_list = soup.select('head > meta[content]')
print(meta_tag_list)
for meta_tag in meta_tag_list:
    # 通过字典的方式获取标签的属性值
    print(meta_tag['content'])

# XPATH: //div[@class = 'square-main']
# # CSS SELECTOR : div.square-main

# XPATH: //div[@id = 'head']
# # CSS SELECTOR : div#head