mysql添加字典子项,如何使用executemany在MySQL中插入Python字典列表

I'm currently using MySQL and Python to scrape data from the web. Specifically, I am scraping table data and inserting it into my database. My current solution works, but I feel it is extremely inefficient and will most likely lock up my database if I don't rewrite the code. Here is what I currently use (partial code):

itemBank = []

for row in rows:

itemBank.append((tempRow2,tempRow1,tempRow3,tempRow4)) #append data

#itemBank List of dictionaries representing data from each

row of the table. i.e.

('Item_Name':"Tomatoes",'Item_Price':"10",'Item_In_Stock':"10",'Item_Max':"30")

for item in itemBank:

tempDict1 = item[0]

tempDict2 = item[1]

tempDict3 = item[2]

tempDict4 = item[3]

q = """ INSERT IGNORE INTO

TABLE1

(

Item_Name,

Item_Price,

Item_In_Stock,

Item_Max,

Observation_Date

) VALUES (

"{0}",

"{1}",

"{2}",

"{3}",

"{4}"

)

""".format(tempDict1['Item_Name'],tempDict2['Item_Price'],tempDict3['Item_In_Stock'],

tempDict4['Item_Max'],getTimeExtra)

try:

x.execute(q)

conn.commit()

except:

conn.rollback()

Executing each row of the table is cumbersome. I've tried using executemany, but I can't seem to figure out how to access the values of the dictionaries correctly.

So, how can I use executemany here to insert into the database given the structure of my data?

解决方案itemBank = []

for row in rows:

itemBank.append((

tempRow2['Item_Name'],

tempRow1['Item_Price'],

tempRow3['Item_In_Stock'],

tempRow4['Item_Max'],

getTimeExtra

)) #append data

q = """ insert ignore into TABLE1 (

Item_Name, Item_Price, Item_In_Stock, Item_Max, Observation_Date )

values (%s,%s,%s,%s,%s)

"""

try:

x.executemany(q, itemBank)

conn.commit()

except:

conn.rollback()

Hope it will help you

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值