php读取的json文件比较大,使用PHP讀取多個大型JSON文件的最佳方法是什么

I am writing a PHP script (to be run from command line) to parse hundreds of large JSON files. All of these files are in a directory. Initially I was reading the files one by one and parsing them in the same script, but ran out of memory quickly. The other way to do it is to have two scripts, one to read the directory, get the list of files and call another script with the file name to be parsed as arguments. Is there any other way to do it?

我正在編寫一個PHP腳本(從命令行運行)來解析數百個大型JSON文件。所有這些文件都在一個目錄中。最初我是逐個讀取文件並在同一個腳本中解析它們,但是內存很快耗盡。另一種方法是使用兩個腳本,一個用於讀取目錄,獲取文件列表並調用另一個腳本,並將文件名稱作為參數進行解析。還有其他辦法嗎?

Also, is there any way to parallelize this?

另外,有沒有辦法並行化這個?

1 个解决方案

#1

1

Try unsetting variables after you are done with them, that should free memory allocated to those variables.

在完成變量后嘗試取消設置變量,這應該釋放分配給這些變量的內存。

Edit: better yet, as I read, you assign null to those variables, that frees memory faster, and more efficiently:

編輯:更好的是,在我閱讀時,您為這些變量分配null,這樣可以更快,更高效地釋放內存:

$myNoLongerUsedVar = null;