python处理文件中有多个json对象_python json文件比较_使用python ijson读取具有多个json对象的大型json文...

I'm trying to parse a large (~100MB) json file using ijson package which allows me to interact with the file in an efficient way. However, after writing some code like this,

with open(filename, 'r') as f:

parser = ijson.parse(f)

for prefix, event, value in parser:

if prefix == "name":

print(value)

I found that the code parses only the first line and not the rest of the lines from the file!!

Here is how a portion of my json file looks like:

{"name":"accelerator_pedal_position","value":0,"timestamp":1364323939.012000}

{"name":"engine_speed","value":772,"timestamp":1364323939.027000}

{"name":"vehicle_speed","value":0,"timestamp":1364323939.029000}

{"name":"accelerator_pedal_position","value":0,"timestamp":1364323939.035000}

In my opinion, I think ijson parses only one json object.

Can someone please suggest how to work around this?

解决方案

Since the provided chunk looks more like a set of lines each composing an independent JSON, it should be parsed accordingly:

# each JSON is small, there's no need in iterative processing

import json

with open(filename, 'r') as f:

for line in f:

data = json.loads(line)

# data[u'name'], data[u'engine_speed'], data[u'timestamp'] now

# contain correspoding values