字典写入Json文件,代码如下:
import json
sparkConfDict = {
'defaultMaxSplitBytes': defaultMaxSplitBytes,
'openCostInBytes': openCostInBytes,
'defaultParallelism': defaultParallelism
}
jsonStr = json.dumps(sparkConfDict)
# 写入到json文件中
with open('results/sparkConf.json', 'w') as json_file:
json_file.write(jsonStr)
从Json文件读取,并转化为字典:
import json
f = open('results/sparkConf.json', 'r')
content = f.read()
f.close()
#转化为字典
sparkConfDict = json.loads(content)
defaultMaxSplitBytes = (sparkConfDict["defaultMaxSplitBytes"])
openCostInBytes = (sparkConfDict["openCostInBytes"])
defaultParallelism = (sparkConfDict["defaultParallelism"])
注意Import json即可。