php导出csv超时,php – 处理非常大的csv文件没有超时和内存错误

我已经用

fgetcsv读取一个120MB的csv流式(这是正确的英语吗？)。它逐行读取，然后我将每行插入数据库。这样一来，在每次迭代中只有一行被保留在内存中。脚本仍然需要20分钟。跑步。也许我下次尝试Python …不要试图加载一个巨大的csv文件到一个数组，这真的会消耗大量的内存。

// WDI_GDF_Data.csv (120.4MB) are the World Bank collection of development indicators:

// http://data.worldbank.org/data-catalog/world-development-indicators

if(($handle = fopen('WDI_GDF_Data.csv', 'r')) !== false)

{

// get the first row, which contains the column-titles (if necessary)

$header = fgetcsv($handle);

// loop through the file line-by-line

while(($data = fgetcsv($handle)) !== false)

{

// resort/rewrite data and insert into DB here

// try to use conditions sparingly here, as those will cause slow-performance

// I don't know if this is really necessary, but it couldn't harm;

// see also: http://php.net/manual/en/features.gc.php

unset($data);

}

fclose($handle);

}