sparkR安装步骤:R3.3.0版本!!!!
1) 下载:amplab-extras-SparkR-pkg-9694d8e.zip
放到服务器:/software
cd /software
unzip amplab-extras-SparkR-pkg-9694d8e.zip
cd /software/amplab-extras-SparkR-pkg-9694d8e
安装:
./install-dev.sh
2) 安装过程遇到的问题:
问题一:报错如下:
[root@liygtest amplab-extras-SparkR-pkg-9694d8e]# ./install-dev.sh
* installing *source* package ‘SparkR’ ...
** libs
** arch -
./sbt/sbt assembly
Attempting to fetch sbt ----卡着了一会!!
curl: (6) Couldn't resolve host 'dl.bintray.com'
curl: (6) Couldn't resolve host 'repo.typesafe.com'
Launching sbt from sbt/sbt-launch-0.13.6.jar
Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar
make: *** [target/scala-2.10/sparkr-assembly-0.1.jar] Error 1
ERROR: compilation failed for package ‘SparkR’
* removing ‘/software/amplab-extras-SparkR-pkg-9694d8e/lib/SparkR’
解决方法:配置linux服务器联网,重新执行!! 重新执行:./install-dev.sh 需要等很长时间下载包和安装!!!本人等了:3个小时!!
问题二:报错如下:
curl: (6) Couldn't resolve host 'dl.bintray.com'
curl: (6) Couldn't resolve host 'repo.typesafe.com'
Launching sbt from sbt/sbt-launch-0.13.6.jar
Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar
make: *** [target/scala-2.10/sparkr-assembly-0.1.jar] Error 1
ERROR: compilation failed for package ‘SparkR’
解决方法同上:配置linux服务器联网,重新执行!! 重新执行:./install-dev.sh 需要等很长时间下载包和安装!!!本人等了:3个小时!!
下载失败多试几次!!!
问题三:报错如下:
failure: repodata/0df25bc891cf4fe556465fc69e7a7c23ead0e3a277824757c1318bf3a20cc1bc-filelists.sqlite.bz2 from RHEL67: [Errno 256] No more mirrors to try.
解决方法: 挂着iso镜像文件,使得yum源可用:mount -o loop /software/rhel-server-6.5-x86_64-dvd.iso /mnt
重新执行:./install-dev.sh