BeautifulSoup 是用来对网页进行数据查找和提取的一个库。
更多使用方法可以参考文档:Beautiful Soup 4.2.0 文档
安装
Python3安装BeautifulSoup和Python2不同,打开cmd,输入pip install bs4
即可。
使用
导入BeautifulSoup包应该用这样的语句:
from bs4 import BeautifulSoup
- 解析title
from bs4 import BeautifulSoup
html_doc = """
<html><head><title>The Dormouse's story</title></head>
<body>
<p class="title"><b>The Dormouse's story</b></p>
<p class="story">Once upon a time there were three little sisters; and their names were
<a href="http://example.com/elsie" class="sister" id="link1">Elsie</a>,
<a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
<a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
and they lived at the bottom of a well.</p>
<p class="story">...</p>
"""
soup = BeautifulSoup(html_doc,"lxml")
print(soup.title)
运行结果如下:
- 查找所有的标签
print(soup.find_all('a'))
- 得到文字内容
print(soup.get_text())
- 遍历子节点
print(soup.head.contents[0])
print(soup.head.contents[0].string)
运行结果如下: