python将dataframe导出为csv,将大型DataFrame输出到CSV文件的最快方法是什么？

For python / pandas I find that df.to_csv(fname) works at a speed of ~1 mln rows per min. I can sometimes improve performance by a factor of 7 like this:

def df2csv(df,fname,myformats=[],sep=','):

"""

# function is faster than to_csv

# 7 times faster for numbers if formats are specified,

# 2 times faster for strings.

# Note - be careful. It doesn't add quotes and doesn't check

# for quotes or separators inside elements

# We've seen output time going down from 45 min to 6 min

# on a simple numeric 4-col dataframe with 45 million rows.

"""

if len(df.columns) <= 0:

return

Nd = len(df.columns)

Nd_1 = Nd - 1

formats = myformats[:] # take a copy to modify it

Nf = len(formats)

# make sure