jupyter 省略号解决:
df = spark.sql("""
select * from xxx
""")
df.show(n=10, truncate=False, vertical=True)
sparkmagic 配置资源
%%configure -f
{"name":"remotesparkmagics-sample", "executorMemory": "4G", "executorCores":4 }
sparkmagic其他配置
%%configure -f
{"conf":{"spark.jars.packages": "com.databricks:spark-csv_2.10:1.4.0" } }
spark缓存配置
%%configure -f
{"conf" : { "spark.catalog.uncacheTable": "tableName"}}