python html_使用Python格式化HTML代码

I have a list of URLs in a column in a CSV-file. I would like to use Python to go through all the URLs, download a specific part of the HTML code from the URL and save it to the next column.

For example:

From this URL I would like to extract this div and write it to the next column.

VM−2N ist ein Hochleistungs−Verteilverstärker für Composite− oder SDI−Videosignale und unsymmetrisches Stereo−Audio. Das Eingangssignal wird entkoppelt und isoliert, anschließend wird das Signal an zwei identische Ausgänge verteilt.

Hohe Bandbreite — 400 MHz (–3 dB).

Desktop–Grösse — Kompakte Bauform, zwei Geräte können mithilfe des optionalen Rackadapters RK–1 in einem 19 Zoll Rack auf 1 HE nebeneinander montiert werden.

I have this code, the HTML code is saved in the variable html:

import csv

import urllib.request

with open("urls.csv", "r", newline="", encoding="cp1252") as f_input:

csv_reader = csv.reader(f_input, delimiter=";", quotechar="|")

header = next(csv_reader)

items = [row[0] for row in csv_reader]

with open("results.csv", "w", newline="") as f_output:

csv_writer = csv.writer(f_output, delimiter=";")

for item in items:

html = urllib.request.urlopen(item).read()

Currently the HTML-Code is pretty ugly. How could I delete everything out of the variable html except the div I would like to extract?

解决方案

Given that all of your webpages are have the same structure you can parse the html with this code. It will look for the first div with the id product_bullets_section. An id in html should be unique but the given website has two equal id's so we obtain the first one through slicing and convert the parsed div back to a string containing your html.

import csv

import urllib.request

from bs4 import BeautifulSoup

with open("urls.csv", "r", newline="", encoding="cp1252") as f_input:

csv_reader = csv.reader(f_input, delimiter=";", quotechar="|")

header = next(csv_reader)

items = [row[0] for row in csv_reader]

items = ['https://www.kramerav.com/de/Product/VM-2N']

with open("results.csv", "w", newline="") as f_output:

csv_writer = csv.writer(f_output, delimiter=";")

for item in items:

html = urllib.request.urlopen(item).read()

the_div = str(BeautifulSoup(html).select('div#product_bullets_section')[0])