史上最全的BeautifulSoup解析（基本选择器，标准选择器，css选择器）

最新推荐文章于 2024-07-10 17:28:32 发布

Halosec_Wei

最新推荐文章于 2024-07-10 17:28:32 发布

阅读量1.5w

点赞数 18

分类专栏： python 文章标签： python爬虫 BeautifulSoup

本文链接：https://blog.csdn.net/qq_41686130/article/details/79856474

版权

本文详细介绍了BeautifulSoup库的标签选择器、标准选择器和CSS选择器的使用，包括find_all、find等方法以及如何获取属性和内容。建议使用lxml解析库，对于CSS选择器熟悉者推荐使用select()方法。

摘要由CSDN通过智能技术生成

#写在前面

基本使用

html = """
<html><head><title>The Dormouse's story</title></head>
<body>
<p class="title" name="dromouse"><b>The Dormouse's story</b></p>
<p class="story">Once upon a time there were three little sisters; and their names were
<a href="http://example.com/elsie" class="sister" id="link1"><!-- Elsie --></a>,
<a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
<a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
and they lived at the bottom of a well.</p>
<p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')#传入解析器
print(soup.prettify())#将代码的格式标准化
print(soup.title.string)#崎岖title标签内的文本

输出：

<html>
 <head>
  <title>
   The Dormouse's story
  </title>
 </head>
 <body>
  <p class="title" name="dromouse">
   <b>
    The Dormouse's story
   </b>
  </p>
  <p class="story">
   Once upon a time there were three little sisters; and their names were
   <a class="sister" href="http://example.com/elsie" id="link1">
    <!-- Elsie -->
   </a>
   ,
   <a class="sister" href="http://example.com/lacie" id="link2">
    Lacie
   </a>
   and
   <a class="sister" href="http://example.com/tillie" id="link3">
    Tillie
   </a>
   ;
and they lived at the bottom of a well.
  </p>
  <p class="story">
   ...
  </p>
 </body>
</html>

The Dormouse's story

标签选择器

示例代码如下：

html = """
<html><head><title>The Dormouse's story</title></head>
<body>
<p class="title" name="dromouse"><b>The Dormouse's story</b></p>
<p class="story">Once upon a time there were three little sisters; and their names were
<a href="http://example.com/elsie" class="sister" id="link1"><!-- Elsie --></a>,
<a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
<a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
and they lived at the bottom of a well.</p>
<p class="story">...</p>
"""

1，选择元素


from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')#传入解析器
print(soup.title)#将title标签里的内容包括其便签全部输出
print(type(soup.title))
print(soup.head)
print(soup.p)

输出结果如下：

<html>
 <head>
  <title>
   The Dormouse's story
  </title>
 </head>
 <body>
  <p class="title" name="dromouse">
   <b>
    The Dormouse's story
   </b>
  </p>
  <p class="story">
   Once upon a time there were three little sisters; and their names were
   <a class="sister" href="http://example.com/elsie" id="link1">
    <!-- Elsie -->
   </a>
   ,
   <a class="sister" href="http://example.com/lacie" id="link2">
    Lacie
   </a>
   and
   <a class="sister" href="http://example.com/tillie" id="link3">
    Tillie
   </a>
   ;
and they lived at the bottom of a well.
  </p>
  <p class="story">
   ...
  </p>
 </body>
</html>


The Dormouse's story

2， 获取名称

from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.title.name)#获取标签的名称

输出如下：

title

3，获取属性

from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.p.attrs['name'])#获取标签的属性
print(soup.p['name'])#获取标签的属性

输出如下：

dromouse
dromouse

4，获取内容

from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.p.string)#获取标签内的内容

输出如下：

The Dormouse's story

5，嵌套循环选择

from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.head.title.string)#层层迭代，获取head标签里的title标签里的文本

输出如下：

The Dormouse's story

6，子节点和子孙节点

#方法一：获取p标签里的所有子节点，以list保存
from bs4 import BeautifulSoup
soup = BeautifulSou

最低0.47元/天解锁文章

Halosec_Wei

关注

18
点赞
踩
80

收藏

觉得还不错? 一键收藏
2
评论
史上最全的BeautifulSoup解析（基本选择器，标准选择器，css选择器）

#写在前面基本使用html = """&lt;html&gt;&lt;head&gt;&lt;title&gt;The Dormouse's story&lt;/title&gt;&lt;/head&gt;&lt;body&gt;&lt;p class="title" name="dromouse"&gt;&lt;
复制链接

扫一扫

专栏目录