Python爬虫——BeautifulSoup库的基本使用

最新推荐文章于 2024-03-30 04:23:21 发布
最新推荐文章于 2024-03-30 04:23:21 发布
阅读量1.6k 收藏
点赞数 1
分类专栏： Python爬虫 文章标签： Python爬虫 BeautifulSoup BeautifulSoup库 爬虫 解析
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qiao39gs/article/details/86563633
版权

目录

基本使用

标签选择器

选择元素

获取名称

获取属性

获取内容

嵌套选择

子节点和子孙节点

父节点和祖先节点

兄弟节点

标准选择器

name

attrs

用attrs:

不用attrs（更加方便）:

text

find(name,attrs,recursive,text,**kwargs)

find_parents() find_parent()

find_next_siblings() find_next_sibling()

find_previous_siblings() find_previous_sibling()

find_all_next() find_next()

find_all_previous() 和 find_previous()

CSS选择器

迭代选择

获取属性

获取内容

总结

灵活又方便的网页解析库，处理高效，支持多种解析器。利用它不用编写正则表达式即可方便地实现网页信息的提取。

作用：解析网页

解析器

使用方法

优势

劣势

Python标准库

BeautifulSoup(markup,'html.parser')

Python的内置标准库，执行速度适中，文档容错能力强

Python 2.7.3 or 3.2.2前的版本中文容错能力差

lxml HTML解析库

BeautifulSoup(markup,'lxml')

速度快，文档容错能力强

需要安装C语言库

lxml XML解析库

BeautifulSoup(markup,'xml')

速度快，唯一支持XML的解析器

需要安装C语言库

html5lib

BeautifulSoup(markup,'html5lib')

最好的容错性，以浏览器的方式解析文档，生成HTML5格式的文档

速度慢，不依赖外部扩展

 

基本使用

from bs4 import BeautifulSoup
html = """网页代码"""
soup = BeautifulSoup(html,'lxml')
print(soup.prettify())#格式化html并自动补全
print(soup.title.string)#打印title

标签选择器

选择元素

from bs4 import BeautifulSoup
html = """网页代码"""
soup = BeautifulSoup(html,'lxml')
print(soup.title)
#输出title标签中的内容和title标签
print(type(soup.title))
#<class 'bs4.element.Tag'>
print(soup.head)
#打印head标签中的内容和head标签
print(soup.p)
#打印第一个p标签中的内容和p标签

获取名称

from bs4 import BeautifulSoup
html = """网页代码"""
soup = BeautifulSoup(html,'lxml')
print(soup.title.name)#打印标签的名称

获取属性

html = """
<html><head><title>The Dormouse's story</title></head>
    <body>
    <p class="title" name="dromouse"><b>The Dormouse's story</b></p>
    <p class="story">Once upon a time there were three little sisters; and their names were
    <a href="http://example.com/elsie" class="sister" id="link1"><!-- Elsie --></a>,
    <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
    <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
    and they lived at the bottom of a well.</p>
    <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html,'lxml')
print(soup.p.attrs['name'])
print(soup.p['name'])

运行结果：

dromouse
dromouse

获取内容

html = """
<html><head><title>The Dormouse's story</title></head>
    <body>
    <p class="title" name="dromouse"><b>The Dormouse's story</b></p>
    <p class="story">Once upon a time there were three little sisters; and their names were
    <a href="http://example.com/elsie" class="sister" id="link1"><!-- Elsie --></a>,
    <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
    <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
    and they lived at the bottom of a well.</p>
    <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html,'lxml')
print(soup.p.string)

运行结果：

The Dormouse's story

嵌套选择

html = """
<html><head><title>The Dormouse's story</title></head>
    <body>
    <p class="title" name="dromouse"><b>The Dormouse's story</b></p>
    <p class="story">Once upon a time there were three little sisters; and their names were
    <a href="http://example.com/elsie" class="sister" id="link1"><!-- Elsie --></a>,
    <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
    <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
    and they lived at the bottom of a well.</p>
    <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html,'lxml')
print(soup.head.title.string)

运行结果：

The Dormouse's story

子节点和子孙节点

例一：

html = """
<html>
    <head>
        <title>The Dormouse's story</title>
    </head>
    <body>
        <p class="story">
            Once upon a time there were three little sisters; and their names were
            <a href="http://example.com/elsie" class="sister" id="link1">
                <span>Elsie</span>
            </a>
            <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a>
            and
            <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>
            and they lived at the bottom of a well.
        </p>
        <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.p.contents)#获取所有子节点

运行结果：

['\n            Once upon a time there were three little sisters; and their names were\n            ', <a class="sister" href="http://example.com/elsie" id="link1">
<span>Elsie</span>
</a>, '\n', <a class="sister" href="http://example.com/lacie" id="link2">Lacie</a>, ' \n            and\n            ', <a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>, '\n            and they lived at the bottom of a well.\n        ']

返回结果形式为列表

例二：

html = """
<html>
    <head>
        <title>The Dormouse's story</title>
    </head>
    <body>
        <p class="story">
            Once upon a time there were three little sisters; and their names were
            <a href="http://example.com/elsie" class="sister" id="link1">
                <span>Elsie</span>
            </a>
            <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a>
            and
            <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>
            and they lived at the bottom of a well.
        </p>
        <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.p.children)#获取所有子节点
for i, child in enumerate(soup.p.children):
#enumerate():返回节点内容和索引
    print(i, child)

返回结果为迭代器

例三：

html = """
<html>
    <head>
        <title>The Dormouse's story</title>
    </head>
    <body>
        <p class="story">
            Once upon a time there were three little sisters; and their names were
            <a href="http://example.com/elsie" class="sister" id="link1">
                <span>Elsie</span>
            </a>
            <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a>
            and
            <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>
            and they lived at the bottom of a well.
        </p>
        <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.p.descendants)#获取所有子孙节点
for i, child in enumerate(soup.p.descendants):
    print(i, child)

父节点和祖先节点

html = """
<html>
    <head>
        <title>The Dormouse's story</title>
    </head>
    <body>
        <p class="story">
            Once upon a time there were three little sisters; and their names were
            <a href="http://example.com/elsie" class="sister" id="link1">
                <span>Elsie</span>
            </a>
            <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a>
            and
            <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>
            and they lived at the bottom of a well.
        </p>
        <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.a.parent)#将a标签的父节点打印输出

 

html = """
<html>
    <head>
        <title>The Dormouse's story</title>
    </head>
    <body>
        <p class="story">
            Once upon a time there were three little sisters; and their names were
            <a href="http://example.com/elsie" class="sister" id="link1">
                <span>Elsie</span>
            </a>
            <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a>
            and
            <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>
            and they lived at the bottom of a well.
        </p>
        <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(list(enumerate(soup.a.parents)))#输出所有祖先节点

兄弟节点

html = """
<html>
    <head>
        <title>The Dormouse's story</title>
    </head>
    <body>
        <p class="story">
            Once upon a time there were three little sisters; and their names were
            <a href="http://example.com/elsie" class="sister" id="link1">
                <span>Elsie</span>
            </a>
            <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a>
            and
            <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>
            and they lived at the bottom of a well.
        </p>
        <p class="story">...</p>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(list(enumerate(soup.a.next_siblings)))#获取a标签后的兄弟节点
print(list(enumerate(soup.a.previous_siblings)))#获取a标签前面的兄弟节点

运行结果：

[(0, '\n'), (1, <a class="sister" href="http://example.com/lacie" id="link2">Lacie</a>), (2, ' \n            and\n            '), (3, <a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>), (4, '\n            and they lived at the bottom of a well.\n        ')]
[(0, '\n            Once upon a time there were three little sisters; and their names were\n            ')]

标准选择器

find_all(name,attrs,recursive,text,**kwargs)

作用：根据标签名，属性，内容查找文档

name

根据标签名查找

例一：

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.find_all('ul'))#把ul标签提取出来
print(type(soup.find_all('ul')[0]))

运行结果：

[<ul class="list" id="list-1">
<li class="element">Foo</li>
<li class="element">Bar</li>
<li class="element">Jay</li>
</ul>, <ul class="list list-small" id="list-2">
<li class="element">Foo</li>
<li class="element">Bar</li>
</ul>]
<class 'bs4.element.Tag'>

例二：

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
for ul in soup.find_all('ul'):
    print(ul.find_all('li'))

运行结果：

[<li class="element">Foo</li>, <li class="element">Bar</li>, <li class="element">Jay</li>]
[<li class="element">Foo</li>, <li class="element">Bar</li>]

attrs

用attrs:

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1" name="elements">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.find_all(attrs={'id': 'list-1'}))
print(soup.find_all(attrs={'name': 'elements'}))

运行结果：

[<ul class="list" id="list-1" name="elements">
<li class="element">Foo</li>
<li class="element">Bar</li>
<li class="element">Jay</li>
</ul>]
[<ul class="list" id="list-1" name="elements">
<li class="element">Foo</li>
<li class="element">Bar</li>
<li class="element">Jay</li>
</ul>]

以字典方式传递查找

键名——属性名    键值——属性值

不用attrs（更加方便）:

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.find_all(id='list-1'))
print(soup.find_all(class_='element'))#class为关键字，需加_

运行结果：

[<ul class="list" id="list-1">
<li class="element">Foo</li>
<li class="element">Bar</li>
<li class="element">Jay</li>
</ul>]
[<li class="element">Foo</li>, <li class="element">Bar</li>, <li class="element">Jay</li>, <li class="element">Foo</li>, <li class="element">Bar</li>]

text

根据文本内容进行选择

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.find_all(text='Foo'))

运行结果：

['Foo', 'Foo']

直接打印text而不是打印标签

作用：内容匹配

find(name,attrs,recursive,text,**kwargs)

find返回单个元素，find_all返回所有元素

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.find('ul'))
print(type(soup.find('ul')))
print(soup.find('page'))

运行结果：

<ul class="list" id="list-1">
<li class="element">Foo</li>
<li class="element">Bar</li>
<li class="element">Jay</li>
</ul>
<class 'bs4.element.Tag'>
None

find_parents() find_parent()

find_parents()返回所有祖先节点，find_parent()返回直接父节点

 

find_next_siblings() find_next_sibling()

find_next_siblings()返回后面所有兄弟节点，find_next_sibling()返回后面第一个兄弟节点

 

find_previous_siblings() find_previous_sibling()

find_previous_siblings()返回前面所有兄弟节点，find_previous_sibling()返回前面第一个兄弟节点

 

find_all_next() find_next()

find_all_next()返回节点后所有符合条件的节点, find_next()返回第一个符合条件的节点

 

find_all_previous() 和 find_previous()

find_all_previous()返回节点后所有符合条件的节点, find_previous()返回第一个符合条件的节点

 

CSS选择器

通过select()直接传入CSS选择器即可完成选择

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
print(soup.select('.panel .panel-heading'))
print(soup.select('ul li'))
print(soup.select('#list-2 .element'))
print(type(soup.select('ul')[0]))

运行结果：

[<div class="panel-heading">
<h4>Hello</h4>
</div>]
[<li class="element">Foo</li>, <li class="element">Bar</li>, <li class="element">Jay</li>, <li class="element">Foo</li>, <li class="element">Bar</li>]
[<li class="element">Foo</li>, <li class="element">Bar</li>]
<class 'bs4.element.Tag'>

迭代选择

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
for ul in soup.select('ul'):
    print(ul.select('li'))

运行结果：

[<li class="element">Foo</li>, <li class="element">Bar</li>, <li class="element">Jay</li>]
[<li class="element">Foo</li>, <li class="element">Bar</li>]

获取属性

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
for ul in soup.select('ul'): 
    print(ul['id'])#方法一
    print(ul.attrs['id'])#方法二

运行结果：

list-1
list-1
list-2
list-2

获取内容

html='''
<div class="panel">
    <div class="panel-heading">
        <h4>Hello</h4>
    </div>
    <div class="panel-body">
        <ul class="list" id="list-1">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
            <li class="element">Jay</li>
        </ul>
        <ul class="list list-small" id="list-2">
            <li class="element">Foo</li>
            <li class="element">Bar</li>
        </ul>
    </div>
</div>
'''
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'lxml')
for li in soup.select('li'):
    print(li.get_text())

运行结果：

Foo
Bar
Jay
Foo
Bar

总结

  • 推荐使用lxml解析库，必要时使用html.parser（代码非常混乱时）

  • 标签选择筛选功能弱但是速度快

  • 建议使用find()、find_all() 查询匹配单个结果或者多个结果

  • 如果对CSS选择器熟悉建议使用select()

  • 记住常用的获取属性和文本值的方法


 

rjbp40ht
关注
专栏目录
Python爬虫包 BeautifulSoup 学习（七） children等应用
Mr.Phoebe的专栏
01-20 9215
所使用的html为：html_doc = """ <html> <head><title>The Dormouse's story</title></head> <p class="title"><b>The Dormouse's story</b></p> <p class="story">Once upon a time there were three little sisters; a
Python爬虫——BeautifulSoup，获取HTML中文档，标签等内容
Rain778的博客
09-24 7260
BeautifulSoup，获取HTML中文档，标签等内容
使用BeautifuSoup4的爬虫
洪流之源
05-24 289
我们以腾讯社招页面来做演示：http://hr.tencent.com/position.php?&amp;start=10#a使用BeautifuSoup4解析器，将招聘网页上的职位名称、职位类别、招聘人数、工作地点、发布时间，以及每个职位详情的点击链接存储出来。from bs4 import BeautifulSoup import urllib.request import json ...
BeautifulSoup库之find、findAll和children、descendants
anmo1221的博客
09-02 9157
BeautifulSoup库提供了一些方法和属性去解析HTML，将HTML页面映射成一棵树。 一、其中findAll函数通过标签的名称和属性来查找标签，返回一个列表 例如： from urllib.request import urlopen from bs4 import BeautifulSoup html = urlopen("http://www.pythonscraping.co
BeautifulSoup中标签的contens和children属性的区别
qq_41324067的博客
06-04 1615
这二者的区别是一个列表，一个是迭代器 it=soup.body.contents type(it) Out[116]: list 所以对应children对象而言，可以使用next()函数 it=soup.body.children next(it) Out[106]: '\n' next(it) Out[107]: <p class="title"><b>The Dorm...
python3 beautifulsoup 检测是否存在children 元素
____
08-18 9263
官方的提示是说 x.childrens 或 x.contents ，但是会将回车 换行给包含进来。如果直接用x.find_all() 遇到 table 会导致报错，因为没有next_elements ，以下是正确的方法。 len(x.find_all(lambda x: x.name != '', recursive=False)) == 0
Python爬虫入门——BeautifulSoup库
m0_59485658的博客
12-24 933
这篇来演示如何使用BeautifulSoup模块来从HTML文本中提取我们想要的数据。
Python爬虫——BeautifulSoup4
qq_46147573的博客
06-12 362
Python爬虫——BeautifulSoup41.bs4简介1.1 基本概念1.2 安装2.bs4的使用2.1 基本操作2.2 对象3.遍历树3.1 遍历子节点3.2 遍历父节点3.3 遍历兄弟节点4.搜索树5.find_all()和find()6.修改文档树
python爬虫实例——基于BeautifulSoup与urllib.request
08-12
总之，理解并掌握`urllib.request`和`BeautifulSoup`的使用是Python爬虫初学者的基础课。通过实践这样的实例，你可以更深入地了解网络请求的原理，学习如何解析和提取HTML中的有用信息，从而为后续更复杂的爬虫项目...
python基础爬虫——BeautifulSoup使用css语法查找元素
felldeng的博客
01-24 1488
人生不能放弃，就算是停电 很不幸，公司停电，刚刚打的代码全没有了 但还是要面对现实 加油!!!,不以物喜不以己悲 今天的学习目标是：beautifulsoup中使用css语法元素 使用css语法查找元素，需要使用css语法规则 使用方法 tag.select(css) 其返回值为一个列表，即使只有一个值 tag是一个bs4.element.Tag对象，即HTML中的一个element节点元素，select是查找方法 css是类似于css语法的一个字符串 soup.select(‘a’)查找文档中所有的元素节
第五章Python循环习题及答案--中文
12-26
第五章Python循环习题及答案--中文
Python全栈开发-Python爬虫-06 爬虫框架Beautiful Soup详解
kc44601的博客
06-27 580
BeautifulSoup详解 一. 简介 BeautifulSoup是一个高效的网页解析库，可以从HTML或XML文件中提取数据 支持不同的解析器，比如，对HTML解析，对XML解析，对HTML5解析 就是一个非常强大的工具，爬虫利器 一个灵感又方便的网页解析库，处理高效，支持多种解析器 利用它就不用编写正则表达式也能方便的实现网页信息的抓取 二. 解析库 解析器 使用方法 优势 劣势 Python标准库 BeautifulSoup(markup, “html.parser”) Pytho
BeautifulSoup中children函数和desscendants函数的区别
ShiLihepan的博客
06-15 1390
我们将通过下面的举例来说明两个函数的区别首先打开一个网页https://blog.csdn.net/xiaohukun/article/details/77679134这是一篇博客，审查元素，选取如下图元素使用children函数，代码为from urllib import requestfrom bs4 import BeautifulSoupif __name__ == '__main__':...
Python BeautifulSoup基础总结
凯耐的博客
02-02 982
（一）BeautifulSoup4简介 Beautiful Soup 是一个可以从HTML或XML文件中提取数据的Python库，它能够通过你喜欢的转换器实现惯用的文档导航、查找、修改文档的方式。Beautiful Soup会帮你节省数小时甚至数天的工作时间。 使用BeautifulSoup 构建一个BeautifulSoup对象需要两个参数，第一个参数解析文本字符串，第二个参数告诉Be...
python beautiful soup库的用法
weixin_34127717的博客
03-09 3103
参考：http://cuiqingcai.com/1319.html Beautiful Soup 4.2.0 文档 1. Beautiful Soup 简介 简单来说，Beautiful Soup是python的一个库，最主要的功能是从网页抓取数据。官方解释如下： Beautiful Soup提供一些简单的、python式的函数用来处理导航、搜索...
BeautifulSoup中contents、children以及descendants的区别
、Lu的博客
06-29 1万+
.contents 返回的是一个 (子节点)的列表，将<tag>所有儿子节点存入列表 。 .children返回的是一个 遍历 (子节点)的迭代器，与.contents类似，用于循环遍历儿子节点。 .descendants 返回的是一个 (子孙节点)的迭代器，包含所有子孙节点，用于循环遍历。 ...
Python之BeautifulSoup库详解
qq_33807380的博客
03-04 4333
BeautifulSoup是一个灵活方便的网页解析库，处理高效，能够自动的将输入文档转换为Unicode编码，输出文档转换为utf-8编码，且支持多种解析器。其最主要的功能是从网页抓取数据。
python爬虫 - BeautifulSoup（2）子孙节点（.children .descendants）和父节点(.parents)
热门推荐
Chard的博客
02-20 1万+
3. 1子节点和子孙节点 soup.body.h1# 选中body 标签下的h1，这个h1 标签是body标签的子节点 同理，soup.div.find_all(‘img’)会找到所有div里面的img标签。 .children 和.descendants 对比代码如下： html = urlopen('http://www.pythonscraping.com/pages/page...
BeautifulSoup的基本使用，不可思议
最新发布
m0_60635245的博客
03-30 967
如果你也是看准了Python，想自学Python，在这里为大家准备了丰厚的免费。
Python爬虫：BeautifulSoup教程——查看SLA模板与命令详解
这篇文章深入讲解了如何使用Python爬虫配合BeautifulSoup库来解析和操作AN5516系列光接入局端机的SLA模板查看命令，并提供了一套完整的命令行操作指南，这对于IT专业人士和网络管理员来说是非常实用的技术分享。
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值