sql python r_使用Python或R将非常大的sql文件导出到csv中

您可以批量读取SQL数据库并将其写入文件,而不是一次读取整个数据库.感谢

How to add pandas data to an existing csv file?如何添加到现有的CSV文件.

import sqlite3

import pandas as pd

# Open the file

f = open('output.csv', 'w')

# Create a connection and get a cursor

connection = sqlite3.connect('mydata.sql')

cursor = connection.cursor()

# Execute the query

cursor.execute('select * from mydata')

# Get data in batches

while True:

# Read the data

df = pd.DataFrame(cursor.fetchmany(1000))

# We are done if there are no data

if len(df) == 0:

break

# Let's write to the file

else:

df.to_csv(f, header=False)

# Clean up

f.close()

cursor.close()

connection.close()