python 通过csv数据对比mysql数据,存在更新,不存在保留

 想过很多总方法,这种方法最实在,有兴趣的可以看下,思路:先读取csv,在去数据库数据库读取,存在就直接写入数据,不存在着直接复制原来的数据。还有一个没有时间去告,读取csv文件为null,写入新的csv文件默认为“nan”值。

def mysqlread(ISBN):
    # print(tables)
     # 打开数据库连接

    db = pymysql.connect("xxx.xxx.xx.xxx", "**", "**", "**")
    # 使用cursor()方法获取操作游标 
    cursor = db.cursor()
    # SQL 查询
    sql =  sql = "select replace(ISBN,'-','') as 'ISBN','' as '供应商产品ID',dj as '定价',BookName as '书名','' as '最新印次' ,cbd as '出版地',Publishing_house as '出版者',nr as '内容提要','' as '读者范围',ztffl as '中图分类','' as '字数',bc as '版次','' as '责任编辑',author as '著者','' as '译者','' as '编者','' as '定价单位','' as '版权登记号','' as '教材征订号',zdfs as '装帧','' as '成书高度','' as '成书高度单位','' as '成书宽度','' as '成书宽度单位','' as '成书厚度','' as '成书厚度单位','' as '单个重量','' as '单个重量单位','' as '附件类型','' as '附件数量',CBookName as '丛套书题名','' as '丛套书顺序号','' as '附属丛套书题名', '' as '并列丛套书题名','' as '丛套书作者','' as '副书名','' as '并列书名','' as '引进版图书原题名','' as '作者(提供者)简介',zwyz as '语种','' as '正文页数','' as '图幅数','' as '关键词','' as '营销分类','' as '目录信息','' as '合作出版者','' as '原书出版者','' as '原出版地',case WHEN LENGTH(cbsj)=7 THEN CONCAT(REPLACE(cbsj,'.',''),'01') WHEN LENGTH(cbsj)=6 THEN CONCAT(REPLACE(cbsj,'.','0'),'01') WHEN LENGTH(cbsj)=5 THEN REPLACE(cbsj,'.','0101') ELSE  cbsj END  as '出版时间','' as '商品介质'from cipInfo_JX where  replace(ISBN,'-','')='{}'  ORDER BY cip DESC"
    
    sql=sql.format(ISBN)
   
    try:
        # 执行sql语句
        cursor.execute(sql.encode('utf-8'))
        # result = cursor.fetchall()## 获取所有查询数据
        result = cursor.fetchone()# 获取单条查询数据
        
    except:
        # 如果发生错误则回滚
        db.rollback()
    finally:      
        # 关闭数据库连接
        db.close()
    return result
def MianStart(filename):
   with open(filename,mode='a+',newline='',encoding='utf_8_sig') as f:
        write = csv.writer(f,dialect='excel')
        write.writerow(['ISBN','供应商产品ID','定价','书名','最新印次','出版地','出版者','内容提要','读者范围','中图分类','字数','版次','责任编辑','著者','译者','编者 ','定价单位','版权登记号','教材征订号','装帧','成书高度','成书高度单位','成书宽度','成书宽度单位','成书厚度','成书厚度单位','单个重量','单个重量单位','附件类型','附件数量','丛套书题名','丛套书顺序号','附属丛套书题名','并列丛套书题名','丛套书作者','副书名','并列书名','引进版图书原题名','作者(提供者)简介','语种','正文页数','图幅数','关键词','营销分类','目录信息','合作出版者','原书出版者','原出版地','出版时间','商品介质'])
        pData = pd.read_csv(r"./wys.csv", header=0, encoding='utf-8')
        for i in range(0,len(pData)):
            data=mysqlread(pData.at[i,'ISBN'])
            print(pData.at[i,'ISBN'])
            if data!=None:
                write.writerow(data)
            else:
                write.writerow(pData.loc[i])
        # for item in data:
        #     write.writerow(item)

    
   



if __name__ == "__main__":
    MianStart(os.path.abspath(os.curdir)+"\\xxxx"+time.strftime("%Y%m%d%H%M%S", time.localtime())+'.csv')#生成到当前目录下面
    



 

  • 1
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Python中,将CSV数据导入MySQL数据库通常涉及两个主要步骤:首先读取CSV文件,然后使用Python的SQL库(如`pandas`和`mysql-connector-python`)将数据插入到MySQL表中。以下是简要的步骤: 1. **安装必要的库**: 首先确保已安装`pandas`用于处理CSV文件和`mysql-connector-python`用于数据库操作。如果没有,可以通过pip安装: ```bash pip install pandas mysql-connector-python ``` 2. **读取CSV文件**: 使用`pandas`的`read_csv`函数加载CSV数据: ```python import pandas as pd csv_data = pd.read_csv('your_file.csv') # 替换为你的CSV文件路径 ``` 3. **连接到MySQL数据库**: ```python import mysql.connector cnx = mysql.connector.connect( host='your_host', user='your_username', password='your_password', database='your_database' ) ``` 将`your_host`, `your_username`, `your_password`, 和 `your_database`替换为实际的数据库连接信息。 4. **创建或选择表**: 如果表不存在,先创建;如果存在,选择它: ```python cursor = cnx.cursor() if not exists_table_query: # 根据实际情况编写检查表是否存在或创建表的SQL create_table_sql = 'CREATE TABLE your_table_name (columns...)' cursor.execute(create_table_sql) cursor.execute('USE your_database') ``` 5. **插入数据**: 使用`cursor`对象执行SQL INSERT语句: ```python columns = ', '.join(csv_data.columns) placeholders = ', '.join('%s' for _ in csv_data.columns) insert_query = f"INSERT INTO your_table_name ({columns}) VALUES ({placeholders})" data_to_insert = [tuple(row) for row in csv_data.values] cursor.executemany(insert_query, data_to_insert) ``` 6. **提交事务并关闭连接**: ```python cnx.commit() cursor.close() cnx.close() ``` 完成以上步骤后,CSV数据就成功导入到MySQL数据库了。如果你需要定期进行此操作,还可以考虑编写脚本或者使用更高级的数据处理工具(如`sqlalchemy`)。
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值