SparkSession

最新推荐文章于 2023-09-20 23:18:23 发布

luoganttcc

最新推荐文章于 2023-09-20 23:18:23 发布

阅读量820

点赞数

分类专栏： spark

本文链接：https://blog.csdn.net/luoganttcc/article/details/79449029

版权

spark 专栏收录该内容

56 篇文章 1 订阅

订阅专栏


from pyspark.sql import SparkSession

'''
spark = SparkSession \
    .builder \
    .master("192.168.10.182:7077") \
    .appName("Python Spark SQL basic example") \
    .config("spark.some.config.option", "some-value") \
    .getOrCreate()

'''
import time
tt=time.time()   
spark = SparkSession.builder \
     .master("local") \
     .appName("Word Count") \
     .config("spark.some.config.option", "some-value") \
     .getOrCreate()

df = spark.read.json("people.json")

df.show()

print(time.time()-tt)