spark学习
spark相关知识点的学习
liuyunshengsir
全栈工程师
展开
-
安装pyspark kernel
编辑 mkdir ~/.ipython/kernels/pyspark vim ~/.ipython/kernels/pyspark/kernel.json kernel.json 内容 { "display_name": "pySpark", "language": "python", "argv": [ "/var/local/anaconda2/bin/python", "...原创 2019-05-21 20:31:16 · 506 阅读 · 0 评论 -
spark-2.2.2的安装部署
1.编写Dockerfile FROM centos6.5:v1 LABEL author.email="578888218@qq.com" #jdk #增加jdk ADD jdk-8u171-linux-x64.tar.gz /etc/java/jdk RUN ln -s /etc/java/jdk/jdk1.8.0_171 /etc/java/jdk/jdk1.8 #安装环境变...原创 2018-12-14 19:02:08 · 521 阅读 · 0 评论