博主分享了在使用PHP Everyman驱动将60000条数据从MySQL迁移到Neo4j时遇到的性能问题。数据插入速度约为每3秒10-15条，寻求加速方案。建议使用批量导入工具以提高效率，并探讨了设置Neo4j唯一索引以避免重复数据的方法。在实验中，发现每批750到1250条数据的导入速度最佳，但JSON解码对CPU负载较大。
I have a dataset of 60000 items in mysql and i'm trying to insert it into neo4j. The insertion is taking place but it's taking a long time( approx. 10-15 per 3 sec). Is there any way i can speed it up? also is there any way i could give something such as unique key in neo4j so duplication indexes won't get indexed? I'm new to neo4j.
I'm using neo4j 1.8 with PHP Everyman driver.
解决方案
As mentioned above, the preferred option is the batch importer.
If you need to go through the PHP client, here I've put up an example that uses the REST batch api:
http://phpfiddle.org/main/code/mu3-sgk
You can test the rows/batch what works best for your system.
For my laptop it's 750, for my test-server it's 1250.
The json_decode that happens is heavy on the CPU.
2539
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
