折腾sparkR

最新推荐文章于 2018-05-15 18:27:52 发布

textboy

最新推荐文章于 2018-05-15 18:27:52 发布

阅读量571

点赞数

分类专栏： linux 文章标签： sparkR

本文链接：https://blog.csdn.net/textboy/article/details/48153341

版权

linux 专栏收录该内容

33 篇文章 0 订阅

订阅专栏

2016-01-26

基于spark1.4.0，一切都简单了，以前版本的sparkR要另行安装，诸多前置，现在只要安了R和Spark，sparkR就可用了。

(1) R安装见《linux centOS下安装R》

(2) spark 安装见《centos单机安装Spark1.4.0》

(3) 最后，

cd $SPARK_HOME

./bin/sparkR

简单多得去了~~~

-------------------------------------------------------------------------------------

2015-09-01

SparkR安装失败，记下些参考，留待有缘人~~~

yum -y install libcurl libcurl-devel
yum -y install libxml2 libxml2-devel

install.packages('RCurl')

wget http://repos.fedorapeople.org/repos/dchen/apache-maven/epel-apache-maven.repo -O /etc/yum.repos.d/epel-apache-maven.repo
yum -y install apache-maven
MAVEN_HOME
http://blog.csdn.net/zdnlp/article/details/7457596

curl https://bintray.com/sbt/rpm/rpm | sudo tee /etc/yum.repos.d/bintray-sbt-rpm.repo
yum -y install sbt
whereis sbt
cp /usr/share/sbt-launcher-packaging/bin/sbt-launch.jar /usr/bin
vi /usr/bin/sbt
SBT_OPTS="-Xms512M -Xmx1536M -Xss1M -XX:+CMSClassUnloadingEnabled -XX:MaxPermSize=256M"
java $SBT_OPTS -jar `dirname $0`/sbt-launch.jar "$@"
chmod u+x /usr/bin/sbt
sbt

install_github("amplab-extras/SparkR-pkg", subdir="pkg")

traceback()

http://www.cnblogs.com/hseagle/p/3998853.html?utm_source=tuicool
http://www.infoq.com/cn/news/2014/01/amplab-launch-sparkr

http://www.94cto.com/index/Article/content/id/253.html
http://www.cnblogs.com/shanzhizi/archive/2012/07/09/2583739.html (ftp://xmlsoft.org/libxml2/)
http://wenku.baidu.com/link?url=vRj7MvMdOesiF9mkBcMatBKgNNGjNaS9-itZMxA5NFZX8M299HbOqj6vIQdbcWDFtWzh5lhuZMZRhq_sEDX6bv2Nzwx-4xAsh0BErsRyeOO
http://blog.csdn.net/learneraiqi/article/details/46372901

http://amplab-extras.github.io/SparkR-pkg/

http://blog.csdn.net/wa2003/article/details/46635353

https://github.com/amplab-extras/SparkR-pkg