找到json文件
/usr/local/spark/examples/src/main/resources/people.json
编写应用程序jsontext.py
frompyspark import SparkContext
importjson
sc=SparkContext('local','JSONAPP')
inputFile="file:///usr/local/spark/examples/src/main/resources/people.json"
jsonStrs=sc.textFile(inputFile)
result=jsonStrs.map(lambdas : json.loads(s))
result.foreach(print)
spark-submmit运行显示结果
root@master:~/pysparkfile#spark-submit --master yarn /root/pysparkfile/jsontext.py
SLF4J:Class path contains multiple SLF4J bindings.
SLF4J:Found binding in[jar:file:/usr/local/spark/jars/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J:Found binding in [jar:file:/usr/local/hadoop-2.7.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.cla