Scraping HTML Data with BeautifulSoup

最新推荐文章于 2025-05-12 18:18:01 发布

*OASIS*

最新推荐文章于 2025-05-12 18:18:01 发布

阅读量284

点赞数 1

本文链接：https://blog.csdn.net/m0_73509997/article/details/128643007

版权

Python for Everybody 专栏收录该内容

11 篇文章

订阅专栏

该文章描述了一个Python编程作业，要求使用BeautifulSoup库解析HTML文件，提取<span>标签中的数字，将它们转换为整数并计算总和。样本数据包含一系列评论计数，学生需要找到特定格式的行并忽略其他数据。提供的代码示例展示了如何查找和处理<a>标签，但需修改以处理<span>标签。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Scraping Numbers from HTML using BeautifulSoup In this assignment you will write a Python program similar to http://www.py4e.com/code3/urllink2.py. The program will use urllib to read the HTML from the data files below, and parse the data, extracting numbers and compute the sum of the numbers in the file.

We provide two files for this assignment. One is a sample file where we give you the sum for your testing and the other is the actual data you need to process for the assignment.

Sample data: Welcome to the comments assignment from www.py4e.comhttp://py4e-data.dr-chuck.net/comments_42.html (Sum=2553)

You do not need to save these files to your folder since your program will read the data directly from the URL. Note: Each student will have a distinct data url for the assignment - so only use your own data url for analysis. Data Format

The file is a table of names and comment counts. You can ignore most of the data in the file except for lines like the following:

<tr><td>Modu</td><td><span class="comments">90</span></td></tr>
<tr><td>Kenzie</td><td><span class="comments">88</span></td></tr>
<tr><td>Hubert</td><td><span class="comments">87</span></td></tr>

You are to find all the <span> tags in the file and pull out the numbers from the tag and sum the numbers.

Look at the provided. It shows how to find all of a certain kind of tag, loop through the tags and extract the various aspects of the tags.sample codehttps://www.py4e.com/code3/urllink2.py?PHPSESSID=33548fb5b0e3960d9f437b5aa1577e60

...
# Retrieve all of the anchor tags
tags = soup('a')
for tag in tags:
   # Look at the parts of a tag
   print 'TAG:',tag
   print 'URL:',tag.get('href', None)
   print 'Contents:',tag.contents[0]
   print 'Attrs:',tag.attrs

You need to adjust this code to look for span tags and pull out the text content of the span tag, convert them to integers and add them up to complete the assignment.

Sample Execution

$ python3 solution.py
Enter - http://py4e-data.dr-chuck.net/comments_42.html
Count 50
Sum 2...

one possible sample:

from urllib.request import urlopen
from bs4 import BeautifulSoup
import ssl

# Ignore SSL certificate errors
ctx = ssl.create_default_context()
ctx.check_hostname = False
ctx.verify_mode = ssl.CERT_NONE

url = input('Enter - ') #http://py4e-data.dr-chuck.net/comments_42.html
html = urlopen(url, context=ctx).read()
soup = BeautifulSoup(html, 'html.parser')

tags = soup('span')
s = 0
count = 0
for tag in tags:
    comments = tag.contents[0]
    s += int(comments)
    count += 1
print('Count', count)
print('Sum', s)