第三章作业

最新推荐文章于 2023-12-05 14:55:44 发布

孤王之路

最新推荐文章于 2023-12-05 14:55:44 发布

阅读量101

点赞数

文章标签：数据库 java 开发语言

本文链接：https://blog.csdn.net/weixin_53367299/article/details/127736349

版权

需要下载mysql

import requests
from lxml import etree
url='http://www.tipdm.com/tipdm/gsjj/'
headers={
        'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.51 Safari/537.36',
        }
response=requests.get(url,headers=headers)
content=response.content.decode('utf-8')
print(content)
html=etree.HTML(content)
result1=html.xpath('//div//section[@class="tag issue clearfix"]//a/text()')
result1=[x.strip() for x in result1]
result2=html.xpath('//div//section[@class="tag issue clearfix"]//a/@href')
result2=[x.strip() for x in result2]
##数据库
import pymysql
db = pymysql.connect(
        host='localhost',
        user='root',
        password='123456',
        database='test',
        port=3306
        )

#创建cursor
cursor = db.cursor()
sql1='''create table if not exists html_text ( id int(100) primary key auto_increment,result1 varchar(200) not null,result2 varchar(200) not null) 
'''
cursor.execute(sql1)
#写SQL语句
for i,j in zip(result1,result2):
    sql = """
    insert into html_text(result1, result2)
    values(%s,%s)
    """
    #执行sql语句
    cursor.execute(sql,(i,j))
    #提交
    db.commit()
#关闭
cursor.close()