sbt构建Scala项目_helloworld

最新推荐文章于 2024-05-28 23:30:47 发布
最新推荐文章于 2024-05-28 23:30:47 发布
阅读量1.3k 收藏
点赞数
分类专栏： Scala
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/shaguabufadai/article/details/77241318
版权

1.

$mkdir ~/simpleapp
$mkdir ~/simpleapp/src
$mkdir ~/simpleapp/src/main
$mkdir ~/simpleapp/src/main/scala
$vim SimpleApp.scala   #内容如下

2.SimpleApp.Scala

object SimpleApp{
        def main(args: Array[String]){
                println("Hello World!")
        } 
}

3. 创建simple.sbt

$cd ~/simpleapp
$vim ./simple.sbt      #内容如下

4.

simple.sbt内容如下：每一行之间空一行。scala version 和 Spark版本信息根据所安装的spark所写。笔者安装的是spark1.6.0和scala 2.11.4。

name :="Simple Project"

version :="1.0"

scalaVersion := "2.11.4"

libraryDependencies +="org.apache.spark" %% "spark-core" % "1.6.0"

5.配置环境变量，编译和运行

$vim ~/.bashrc 		#在开头添加如下内容：export PATH=/usr/local/sbt:$PATH
$source ~/.bashrc         #使之生效
$cd ~/simpleapp
$sbt compile           #编译，等待很久，天朝龟速
$sbt package           #打包
$/usr/local/src/spark-1.6.0-bin-hadoop2.6/bin/spark-submit --class "SimpleApp" /usr/local/spark/mycode/simpleapp/target/scala-2.11/simple-project_2.11-1.0.jar   #将生成的jar包通过spark-summit提交到spark中执行

截图

这里写图片描述

这里写图片描述

这里写图片描述

这里写图片描述

这里写图片描述

这里写图片描述

这里写图片描述

实践完整流程

[root@master ~]# cd /usr/local/spark/
[root@master spark]# ls
mycode
[root@master spark]# cd mycode/
[root@master mycode]# ls
wordcount
[root@master mycode]# mkdir simpleapp
[root@master mycode]# ls
simpleapp  wordcount
[root@master mycode]# mkdir /simpleapp/src/main/scala 
mkdir: cannot create directory `/simpleapp/src/main/scala': No such file or directory
[root@master mycode]# cd simpleapp/
[root@master simpleapp]# ls
[root@master simpleapp]# mkdir /simpleapp/src/main/scala      
mkdir: cannot create directory `/simpleapp/src/main/scala': No such file or directory
[root@master simpleapp]# mkdir /src/main/scala          
mkdir: cannot create directory `/src/main/scala': No such file or directory
[root@master simpleapp]# mkdir src
[root@master simpleapp]# ls
src
[root@master simpleapp]# cd src
[root@master src]# ls
[root@master src]# mkdir main
[root@master src]# ls
main
[root@master src]# cd ma
bash: cd: ma: No such file or directory
[root@master src]# cd main
[root@master main]# ls
[root@master main]# mkdir scala                     
[root@master main]# ls
scala
[root@master main]# cd scala/
[root@master scala]# ls
[root@master scala]# vim SimpleApp.scala
[root@master scala]# cd /usr/local/spark/mycode/simpleapp/
[root@master simpleapp]# ls
src
[root@master simpleapp]# vim simple.sbt
[root@master simpleapp]# vim ~/.bashrc
[root@master simpleapp]# vim ~/.bashrc
[root@master simpleapp]# source ~/.bashrc
[root@master simpleapp]# ls
simple.sbt  src
[root@master simpleapp]# sbt compile
[info] Set current project to Simple Project (in build file:/usr/local/spark/mycode/simpleapp/)
[info] Updating {file:/usr/local/spark/mycode/simpleapp/}simpleapp...
[info] Resolving org.sonatype.oss#oss-parent;7 ...
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-library/2.11.4/scala-library-2.11.4.jar ...
[info]  [SUCCESSFUL ] org.scala-lang#scala-library;2.11.4!scala-library.jar (51237ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-core_2.11/1.6.0/spark-core_2.11-1.6.0.jar ...
[info]  [SUCCESSFUL ] org.apache.spark#spark-core_2.11;1.6.0!spark-core_2.11.jar (85228ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.7/avro-mapred-1.7.7-hadoop2.jar ...
[info]  [SUCCESSFUL ] org.apache.avro#avro-mapred;1.7.7!avro-mapred.jar (4195ms)
[info] downloading https://repo1.maven.org/maven2/com/twitter/chill_2.11/0.5.0/chill_2.11-0.5.0.jar ...
[info]  [SUCCESSFUL ] com.twitter#chill_2.11;0.5.0!chill_2.11.jar (4098ms)
[info] downloading https://repo1.maven.org/maven2/com/twitter/chill-java/0.5.0/chill-java-0.5.0.jar ...
[info]  [SUCCESSFUL ] com.twitter#chill-java;0.5.0!chill-java.jar (2634ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/xbean/xbean-asm5-shaded/4.4/xbean-asm5-shaded-4.4.jar ...
[info]  [SUCCESSFUL ] org.apache.xbean#xbean-asm5-shaded;4.4!xbean-asm5-shaded.jar(bundle) (3137ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-client/2.2.0/hadoop-client-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-client;2.2.0!hadoop-client.jar (2445ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-launcher_2.11/1.6.0/spark-launcher_2.11-1.6.0.jar ...
[info]  [SUCCESSFUL ] org.apache.spark#spark-launcher_2.11;1.6.0!spark-launcher_2.11.jar (2710ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-network-common_2.11/1.6.0/spark-network-common_2.11-1.6.0.jar ...
[info]  [SUCCESSFUL ] org.apache.spark#spark-network-common_2.11;1.6.0!spark-network-common_2.11.jar (14646ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-network-shuffle_2.11/1.6.0/spark-network-shuffle_2.11-1.6.0.jar ...
[info]  [SUCCESSFUL ] org.apache.spark#spark-network-shuffle_2.11;1.6.0!spark-network-shuffle_2.11.jar (2778ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-unsafe_2.11/1.6.0/spark-unsafe_2.11-1.6.0.jar ...
[info]  [SUCCESSFUL ] org.apache.spark#spark-unsafe_2.11;1.6.0!spark-unsafe_2.11.jar (2929ms)
[info] downloading https://repo1.maven.org/maven2/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar ...
[info]  [SUCCESSFUL ] net.java.dev.jets3t#jets3t;0.7.1!jets3t.jar (4947ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/curator/curator-recipes/2.4.0/curator-recipes-2.4.0.jar ...
[info]  [SUCCESSFUL ] org.apache.curator#curator-recipes;2.4.0!curator-recipes.jar(bundle) (3959ms)
[info] downloading https://repo1.maven.org/maven2/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar ...
[info]  [SUCCESSFUL ] org.eclipse.jetty.orbit#javax.servlet;3.0.0.v201112011016!javax.servlet.jar(orbit) (3373ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar ...
[info]  [SUCCESSFUL ] org.apache.commons#commons-lang3;3.3.2!commons-lang3.jar (5418ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar ...
[info]  [SUCCESSFUL ] org.apache.commons#commons-math3;3.4.1!commons-math3.jar (19438ms)
[info] downloading https://repo1.maven.org/maven2/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar ...
[info]  [SUCCESSFUL ] com.google.code.findbugs#jsr305;1.3.9!jsr305.jar (2973ms)
[info] downloading https://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.7.10/slf4j-api-1.7.10.jar ...
[info]  [SUCCESSFUL ] org.slf4j#slf4j-api;1.7.10!slf4j-api.jar (3006ms)
[info] downloading https://repo1.maven.org/maven2/org/slf4j/jul-to-slf4j/1.7.10/jul-to-slf4j-1.7.10.jar ...
[info]  [SUCCESSFUL ] org.slf4j#jul-to-slf4j;1.7.10!jul-to-slf4j.jar (2706ms)
[info] downloading https://repo1.maven.org/maven2/org/slf4j/jcl-over-slf4j/1.7.10/jcl-over-slf4j-1.7.10.jar ...
[info]  [SUCCESSFUL ] org.slf4j#jcl-over-slf4j;1.7.10!jcl-over-slf4j.jar (3136ms)
[info] downloading https://repo1.maven.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar ...
[info]  [SUCCESSFUL ] log4j#log4j;1.2.17!log4j.jar(bundle) (6156ms)
[info] downloading https://repo1.maven.org/maven2/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar ...
[info]  [SUCCESSFUL ] org.slf4j#slf4j-log4j12;1.7.10!slf4j-log4j12.jar (3987ms)
[info] downloading https://repo1.maven.org/maven2/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar ...
[info]  [SUCCESSFUL ] com.ning#compress-lzf;1.0.3!compress-lzf.jar(bundle) (2882ms)
[info] downloading https://repo1.maven.org/maven2/org/xerial/snappy/snappy-java/1.1.2/snappy-java-1.1.2.jar ...
[info]  [SUCCESSFUL ] org.xerial.snappy#snappy-java;1.1.2!snappy-java.jar(bundle) (6870ms)
[info] downloading https://repo1.maven.org/maven2/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar ...
[info]  [SUCCESSFUL ] net.jpountz.lz4#lz4;1.3.0!lz4.jar (4138ms)
[info] downloading https://repo1.maven.org/maven2/org/roaringbitmap/RoaringBitmap/0.5.11/RoaringBitmap-0.5.11.jar ...
[info]  [SUCCESSFUL ] org.roaringbitmap#RoaringBitmap;0.5.11!RoaringBitmap.jar(bundle) (4865ms)
[info] downloading https://repo1.maven.org/maven2/commons-net/commons-net/2.2/commons-net-2.2.jar ...
[info]  [SUCCESSFUL ] commons-net#commons-net;2.2!commons-net.jar (4230ms)
[info] downloading https://repo1.maven.org/maven2/com/typesafe/akka/akka-remote_2.11/2.3.11/akka-remote_2.11-2.3.11.jar ...
[info]  [SUCCESSFUL ] com.typesafe.akka#akka-remote_2.11;2.3.11!akka-remote_2.11.jar (11298ms)
[info] downloading https://repo1.maven.org/maven2/com/typesafe/akka/akka-slf4j_2.11/2.3.11/akka-slf4j_2.11-2.3.11.jar ...
[info]  [SUCCESSFUL ] com.typesafe.akka#akka-slf4j_2.11;2.3.11!akka-slf4j_2.11.jar (3381ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-library/2.11.7/scala-library-2.11.7.jar ...
[info]  [SUCCESSFUL ] org.scala-lang#scala-library;2.11.7!scala-library.jar (53741ms)
[info] downloading https://repo1.maven.org/maven2/org/json4s/json4s-jackson_2.11/3.2.10/json4s-jackson_2.11-3.2.10.jar ...
[info]  [SUCCESSFUL ] org.json4s#json4s-jackson_2.11;3.2.10!json4s-jackson_2.11.jar (4376ms)
[info] downloading https://repo1.maven.org/maven2/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar ...
[info]  [SUCCESSFUL ] com.sun.jersey#jersey-server;1.9!jersey-server.jar(bundle) (26961ms)
[info] downloading https://repo1.maven.org/maven2/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar ...
[info]  [SUCCESSFUL ] com.sun.jersey#jersey-core;1.9!jersey-core.jar(bundle) (6170ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/mesos/mesos/0.21.1/mesos-0.21.1-shaded-protobuf.jar ...
[info]  [SUCCESSFUL ] org.apache.mesos#mesos;0.21.1!mesos.jar (41837ms)
[info] downloading https://repo1.maven.org/maven2/io/netty/netty-all/4.0.29.Final/netty-all-4.0.29.Final.jar ...
[info]  [SUCCESSFUL ] io.netty#netty-all;4.0.29.Final!netty-all.jar (52881ms)
[info] downloading https://repo1.maven.org/maven2/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar ...
[info]  [SUCCESSFUL ] com.clearspring.analytics#stream;2.7.0!stream.jar (6544ms)
[info] downloading https://repo1.maven.org/maven2/io/dropwizard/metrics/metrics-core/3.1.2/metrics-core-3.1.2.jar ...
[info]  [SUCCESSFUL ] io.dropwizard.metrics#metrics-core;3.1.2!metrics-core.jar(bundle) (7632ms)
[info] downloading https://repo1.maven.org/maven2/io/dropwizard/metrics/metrics-jvm/3.1.2/metrics-jvm-3.1.2.jar ...
[info]  [SUCCESSFUL ] io.dropwizard.metrics#metrics-jvm;3.1.2!metrics-jvm.jar(bundle) (4003ms)
[info] downloading https://repo1.maven.org/maven2/io/dropwizard/metrics/metrics-json/3.1.2/metrics-json-3.1.2.jar ...
[info]  [SUCCESSFUL ] io.dropwizard.metrics#metrics-json;3.1.2!metrics-json.jar(bundle) (3229ms)
[info] downloading https://repo1.maven.org/maven2/io/dropwizard/metrics/metrics-graphite/3.1.2/metrics-graphite-3.1.2.jar ...
[info]  [SUCCESSFUL ] io.dropwizard.metrics#metrics-graphite;3.1.2!metrics-graphite.jar(bundle) (3780ms)
[info] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.4.4/jackson-databind-2.4.4.jar ...
[info]  [SUCCESSFUL ] com.fasterxml.jackson.core#jackson-databind;2.4.4!jackson-databind.jar(bundle) (45077ms)
[info] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/module/jackson-module-scala_2.11/2.4.4/jackson-module-scala_2.11-2.4.4.jar ...
[info]  [SUCCESSFUL ] com.fasterxml.jackson.module#jackson-module-scala_2.11;2.4.4!jackson-module-scala_2.11.jar(bundle) (27843ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar ...
[info]  [SUCCESSFUL ] org.apache.ivy#ivy;2.4.0!ivy.jar (26478ms)
[info] downloading https://repo1.maven.org/maven2/oro/oro/2.0.8/oro-2.0.8.jar ...
[info]  [SUCCESSFUL ] oro#oro;2.0.8!oro.jar (3452ms)
[info] downloading https://repo1.maven.org/maven2/org/tachyonproject/tachyon-client/0.8.2/tachyon-client-0.8.2.jar ...
[info]  [SUCCESSFUL ] org.tachyonproject#tachyon-client;0.8.2!tachyon-client.jar (51867ms)
[info] downloading https://repo1.maven.org/maven2/net/razorvine/pyrolite/4.9/pyrolite-4.9.jar ...
[info]  [SUCCESSFUL ] net.razorvine#pyrolite;4.9!pyrolite.jar (3693ms)
[info] downloading https://repo1.maven.org/maven2/net/sf/py4j/py4j/0.9/py4j-0.9.jar ...
[info]  [SUCCESSFUL ] net.sf.py4j#py4j;0.9!py4j.jar (3637ms)
[info] downloading https://repo1.maven.org/maven2/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar ...
[info]  [SUCCESSFUL ] org.spark-project.spark#unused;1.0.0!unused.jar (2668ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/avro/avro-ipc/1.7.7/avro-ipc-1.7.7-tests.jar ...
[info]  [SUCCESSFUL ] org.apache.avro#avro-ipc;1.7.7!avro-ipc.jar (10147ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/avro/avro-ipc/1.7.7/avro-ipc-1.7.7.jar ...
[info]  [SUCCESSFUL ] org.apache.avro#avro-ipc;1.7.7!avro-ipc.jar (10557ms)
[info] downloading https://repo1.maven.org/maven2/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar ...
[info]  [SUCCESSFUL ] org.codehaus.jackson#jackson-core-asl;1.9.13!jackson-core-asl.jar (5672ms)
[info] downloading https://repo1.maven.org/maven2/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar ...
[info]  [SUCCESSFUL ] org.codehaus.jackson#jackson-mapper-asl;1.9.13!jackson-mapper-asl.jar (28623ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/avro/avro/1.7.7/avro-1.7.7.jar ...
[info]  [SUCCESSFUL ] org.apache.avro#avro;1.7.7!avro.jar(bundle) (17475ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar ...
[info]  [SUCCESSFUL ] org.apache.commons#commons-compress;1.4.1!commons-compress.jar (6782ms)
[info] downloading https://repo1.maven.org/maven2/org/tukaani/xz/1.0/xz-1.0.jar ...
[info]  [SUCCESSFUL ] org.tukaani#xz;1.0!xz.jar (3939ms)
[info] downloading https://repo1.maven.org/maven2/com/esotericsoftware/kryo/kryo/2.21/kryo-2.21.jar ...
[info]  [SUCCESSFUL ] com.esotericsoftware.kryo#kryo;2.21!kryo.jar(bundle) (11311ms)
[info] downloading https://repo1.maven.org/maven2/com/esotericsoftware/reflectasm/reflectasm/1.07/reflectasm-1.07-shaded.jar ...
[info]  [SUCCESSFUL ] com.esotericsoftware.reflectasm#reflectasm;1.07!reflectasm.jar (4424ms)
[info] downloading https://repo1.maven.org/maven2/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar ...
[info]  [SUCCESSFUL ] com.esotericsoftware.minlog#minlog;1.2!minlog.jar (3240ms)
[info] downloading https://repo1.maven.org/maven2/org/objenesis/objenesis/1.2/objenesis-1.2.jar ...
[info]  [SUCCESSFUL ] org.objenesis#objenesis;1.2!objenesis.jar (4058ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/2.2.0/hadoop-common-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-common;2.2.0!hadoop-common.jar (35511ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/2.2.0/hadoop-hdfs-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-hdfs;2.2.0!hadoop-hdfs.jar (31626ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapreduce-client-app/2.2.0/hadoop-mapreduce-client-app-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-mapreduce-client-app;2.2.0!hadoop-mapreduce-client-app.jar (4875ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-api/2.2.0/hadoop-yarn-api-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-yarn-api;2.2.0!hadoop-yarn-api.jar (20063ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapreduce-client-core/2.2.0/hadoop-mapreduce-client-core-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-mapreduce-client-core;2.2.0!hadoop-mapreduce-client-core.jar (17900ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.2.0/hadoop-mapreduce-client-jobclient-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.2.0!hadoop-mapreduce-client-jobclient.jar (2857ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-annotations/2.2.0/hadoop-annotations-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-annotations;2.2.0!hadoop-annotations.jar (3114ms)
[info] downloading https://repo1.maven.org/maven2/commons-cli/commons-cli/1.2/commons-cli-1.2.jar ...
[info]  [SUCCESSFUL ] commons-cli#commons-cli;1.2!commons-cli.jar (2485ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/commons/commons-math/2.1/commons-math-2.1.jar ...
[info]  [SUCCESSFUL ] org.apache.commons#commons-math;2.1!commons-math.jar (6439ms)
[info] downloading https://repo1.maven.org/maven2/xmlenc/xmlenc/0.52/xmlenc-0.52.jar ...
[info]  [SUCCESSFUL ] xmlenc#xmlenc;0.52!xmlenc.jar (2491ms)
[info] downloading https://repo1.maven.org/maven2/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar ...
[info]  [SUCCESSFUL ] commons-httpclient#commons-httpclient;3.1!commons-httpclient.jar (5813ms)
[info] downloading https://repo1.maven.org/maven2/commons-codec/commons-codec/1.4/commons-codec-1.4.jar ...
[info]  [SUCCESSFUL ] commons-codec#commons-codec;1.4!commons-codec.jar (3669ms)
[info] downloading https://repo1.maven.org/maven2/commons-lang/commons-lang/2.5/commons-lang-2.5.jar ...
[info]  [SUCCESSFUL ] commons-lang#commons-lang;2.5!commons-lang.jar (6585ms)
[info] downloading https://repo1.maven.org/maven2/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar ...
[info]  [SUCCESSFUL ] commons-configuration#commons-configuration;1.6!commons-configuration.jar (4999ms)
[info] downloading https://repo1.maven.org/maven2/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar ...
[info]  [SUCCESSFUL ] com.google.protobuf#protobuf-java;2.5.0!protobuf-java.jar(bundle) (14392ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-auth/2.2.0/hadoop-auth-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-auth;2.2.0!hadoop-auth.jar (4528ms)
[info] downloading https://repo1.maven.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar ...
[info]  [SUCCESSFUL ] commons-collections#commons-collections;3.2.1!commons-collections.jar (25209ms)
[info] downloading https://repo1.maven.org/maven2/commons-digester/commons-digester/1.8/commons-digester-1.8.jar ...
[info]  [SUCCESSFUL ] commons-digester#commons-digester;1.8!commons-digester.jar (7711ms)
[info] downloading https://repo1.maven.org/maven2/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar ...
[info]  [SUCCESSFUL ] commons-beanutils#commons-beanutils-core;1.8.0!commons-beanutils-core.jar (12529ms)
[info] downloading https://repo1.maven.org/maven2/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar ...
[info]  [SUCCESSFUL ] commons-beanutils#commons-beanutils;1.7.0!commons-beanutils.jar (6691ms)
[info] downloading https://repo1.maven.org/maven2/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar ...
[info]  [SUCCESSFUL ] org.mortbay.jetty#jetty-util;6.1.26!jetty-util.jar (10569ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapreduce-client-common/2.2.0/hadoop-mapreduce-client-common-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-mapreduce-client-common;2.2.0!hadoop-mapreduce-client-common.jar (13826ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.2.0/hadoop-mapreduce-client-shuffle-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.2.0!hadoop-mapreduce-client-shuffle.jar (2666ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-common/2.2.0/hadoop-yarn-common-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-yarn-common;2.2.0!hadoop-yarn-common.jar (30814ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-client/2.2.0/hadoop-yarn-client-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-yarn-client;2.2.0!hadoop-yarn-client.jar (6747ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-server-common/2.2.0/hadoop-yarn-server-common-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-yarn-server-common;2.2.0!hadoop-yarn-server-common.jar (4828ms)
[info] downloading https://repo1.maven.org/maven2/com/google/inject/guice/3.0/guice-3.0.jar ...
[info]  [SUCCESSFUL ] com.google.inject#guice;3.0!guice.jar (16207ms)
[info] downloading https://repo1.maven.org/maven2/com/sun/jersey/jersey-test-framework/jersey-test-framework-grizzly2/1.9/jersey-test-framework-grizzly2-1.9.jar ...
[info]  [SUCCESSFUL ] com.sun.jersey.jersey-test-framework#jersey-test-framework-grizzly2;1.9!jersey-test-framework-grizzly2.jar (3762ms)
[info] downloading https://repo1.maven.org/maven2/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar ...
[info]  [SUCCESSFUL ] com.sun.jersey#jersey-json;1.9!jersey-json.jar(bundle) (3290ms)
[info] downloading https://repo1.maven.org/maven2/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar ...
[info]  [SUCCESSFUL ] com.sun.jersey.contribs#jersey-guice;1.9!jersey-guice.jar (2593ms)
[info] downloading https://repo1.maven.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar ...
[info]  [SUCCESSFUL ] javax.inject#javax.inject;1!javax.inject.jar (2445ms)
[info] downloading https://repo1.maven.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.jar ...
[info]  [SUCCESSFUL ] aopalliance#aopalliance;1.0!aopalliance.jar (2892ms)
[info] downloading https://repo1.maven.org/maven2/org/sonatype/sisu/inject/cglib/2.2.1-v20090111/cglib-2.2.1-v20090111.jar ...
[info]  [SUCCESSFUL ] org.sonatype.sisu.inject#cglib;2.2.1-v20090111!cglib.jar (3758ms)
[info] downloading https://repo1.maven.org/maven2/asm/asm/3.1/asm-3.1.jar ...
[info]  [SUCCESSFUL ] asm#asm;3.1!asm.jar (2666ms)
[info] downloading https://repo1.maven.org/maven2/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar ...
[info]  [SUCCESSFUL ] org.codehaus.jettison#jettison;1.1!jettison.jar(bundle) (3076ms)
[info] downloading https://repo1.maven.org/maven2/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar ...
[info]  [SUCCESSFUL ] com.sun.xml.bind#jaxb-impl;2.2.3-1!jaxb-impl.jar (9734ms)
[info] downloading https://repo1.maven.org/maven2/org/codehaus/jackson/jackson-jaxrs/1.8.3/jackson-jaxrs-1.8.3.jar ...
[info]  [SUCCESSFUL ] org.codehaus.jackson#jackson-jaxrs;1.8.3!jackson-jaxrs.jar (3521ms)
[info] downloading https://repo1.maven.org/maven2/org/codehaus/jackson/jackson-xc/1.8.3/jackson-xc-1.8.3.jar ...
[info]  [SUCCESSFUL ] org.codehaus.jackson#jackson-xc;1.8.3!jackson-xc.jar (3399ms)
[info] downloading https://repo1.maven.org/maven2/stax/stax-api/1.0.1/stax-api-1.0.1.jar ...
[info]  [SUCCESSFUL ] stax#stax-api;1.0.1!stax-api.jar (2660ms)
[info] downloading https://repo1.maven.org/maven2/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar ...
[info]  [SUCCESSFUL ] javax.xml.bind#jaxb-api;2.2.2!jaxb-api.jar (3460ms)
[info] downloading https://repo1.maven.org/maven2/javax/activation/activation/1.1/activation-1.1.jar ...
[info]  [SUCCESSFUL ] javax.activation#activation;1.1!activation.jar (3240ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-server-nodemanager/2.2.0/hadoop-yarn-server-nodemanager-2.2.0.jar ...
[info]  [SUCCESSFUL ] org.apache.hadoop#hadoop-yarn-server-nodemanager;2.2.0!hadoop-yarn-server-nodemanager.jar (8666ms)
[info] downloading https://repo1.maven.org/maven2/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar ...
[info]  [SUCCESSFUL ] org.fusesource.leveldbjni#leveldbjni-all;1.8!leveldbjni-all.jar(bundle) (14929ms)
[info] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.4.4/jackson-annotations-2.4.4.jar ...
[info]  [SUCCESSFUL ] com.fasterxml.jackson.core#jackson-annotations;2.4.4!jackson-annotations.jar(bundle) (3030ms)
[info] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-core/2.4.4/jackson-core-2.4.4.jar ...
[info]  [SUCCESSFUL ] com.fasterxml.jackson.core#jackson-core;2.4.4!jackson-core.jar(bundle) (4439ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/curator/curator-framework/2.4.0/curator-framework-2.4.0.jar ...
[info]  [SUCCESSFUL ] org.apache.curator#curator-framework;2.4.0!curator-framework.jar(bundle) (4644ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar ...
[info]  [SUCCESSFUL ] org.apache.zookeeper#zookeeper;3.4.5!zookeeper.jar (34298ms)
[info] downloading https://repo1.maven.org/maven2/com/google/guava/guava/14.0.1/guava-14.0.1.jar ...
[info]  [SUCCESSFUL ] com.google.guava#guava;14.0.1!guava.jar(bundle) (41202ms)
[info] downloading https://repo1.maven.org/maven2/org/apache/curator/curator-client/2.4.0/curator-client-2.4.0.jar ...
[info]  [SUCCESSFUL ] org.apache.curator#curator-client;2.4.0!curator-client.jar(bundle) (4075ms)
[info] downloading https://repo1.maven.org/maven2/jline/jline/0.9.94/jline-0.9.94.jar ...
[info]  [SUCCESSFUL ] jline#jline;0.9.94!jline.jar (5335ms)
[info] downloading https://repo1.maven.org/maven2/com/typesafe/akka/akka-actor_2.11/2.3.11/akka-actor_2.11-2.3.11.jar ...
[info]  [SUCCESSFUL ] com.typesafe.akka#akka-actor_2.11;2.3.11!akka-actor_2.11.jar (56369ms)
[info] downloading https://repo1.maven.org/maven2/io/netty/netty/3.8.0.Final/netty-3.8.0.Final.jar ...
[info]  [SUCCESSFUL ] io.netty#netty;3.8.0.Final!netty.jar(bundle) (31749ms)
[info] downloading https://repo1.maven.org/maven2/org/uncommons/maths/uncommons-maths/1.2.2a/uncommons-maths-1.2.2a.jar ...
[info]  [SUCCESSFUL ] org.uncommons.maths#uncommons-maths;1.2.2a!uncommons-maths.jar (4050ms)
[info] downloading https://repo1.maven.org/maven2/com/typesafe/config/1.2.1/config-1.2.1.jar ...
[info]  [SUCCESSFUL ] com.typesafe#config;1.2.1!config.jar(bundle) (7230ms)
[info] downloading https://repo1.maven.org/maven2/org/json4s/json4s-core_2.11/3.2.10/json4s-core_2.11-3.2.10.jar ...
[info]  [SUCCESSFUL ] org.json4s#json4s-core_2.11;3.2.10!json4s-core_2.11.jar (19684ms)
[info] downloading https://repo1.maven.org/maven2/org/json4s/json4s-ast_2.11/3.2.10/json4s-ast_2.11-3.2.10.jar ...
[info]  [SUCCESSFUL ] org.json4s#json4s-ast_2.11;3.2.10!json4s-ast_2.11.jar (3151ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/scalap/2.11.0/scalap-2.11.0.jar ...
[info]  [SUCCESSFUL ] org.scala-lang#scalap;2.11.0!scalap.jar (13404ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-compiler/2.11.0/scala-compiler-2.11.0.jar ...
[info]  [SUCCESSFUL ] org.scala-lang#scala-compiler;2.11.0!scala-compiler.jar (78021ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/modules/scala-xml_2.11/1.0.1/scala-xml_2.11-1.0.1.jar ...
[info]  [SUCCESSFUL ] org.scala-lang.modules#scala-xml_2.11;1.0.1!scala-xml_2.11.jar(bundle) (6189ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.1/scala-parser-combinators_2.11-1.0.1.jar ...
[info]  [SUCCESSFUL ] org.scala-lang.modules#scala-parser-combinators_2.11;1.0.1!scala-parser-combinators_2.11.jar(bundle) (4916ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-reflect/2.11.2/scala-reflect-2.11.2.jar ...
[info]  [SUCCESSFUL ] org.scala-lang#scala-reflect;2.11.2!scala-reflect.jar (30237ms)
[info] downloading https://repo1.maven.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar ...
[info]  [SUCCESSFUL ] commons-io#commons-io;2.4!commons-io.jar (3371ms)
[info] downloading https://repo1.maven.org/maven2/org/tachyonproject/tachyon-underfs-hdfs/0.8.2/tachyon-underfs-hdfs-0.8.2.jar ...
[info]  [SUCCESSFUL ] org.tachyonproject#tachyon-underfs-hdfs;0.8.2!tachyon-underfs-hdfs.jar (3023ms)
[info] downloading https://repo1.maven.org/maven2/org/tachyonproject/tachyon-underfs-s3/0.8.2/tachyon-underfs-s3-0.8.2.jar ...
[info]  [SUCCESSFUL ] org.tachyonproject#tachyon-underfs-s3;0.8.2!tachyon-underfs-s3.jar (4850ms)
[info] downloading https://repo1.maven.org/maven2/org/tachyonproject/tachyon-underfs-local/0.8.2/tachyon-underfs-local-0.8.2.jar ...
[info]  [SUCCESSFUL ] org.tachyonproject#tachyon-underfs-local;0.8.2!tachyon-underfs-local.jar (2344ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-compiler/2.11.4/scala-compiler-2.11.4.jar ...
[info]  [SUCCESSFUL ] org.scala-lang#scala-compiler;2.11.4!scala-compiler.jar (85830ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-reflect/2.11.4/scala-reflect-2.11.4.jar ...
[info]  [SUCCESSFUL ] org.scala-lang#scala-reflect;2.11.4!scala-reflect.jar (36602ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/modules/scala-xml_2.11/1.0.2/scala-xml_2.11-1.0.2.jar ...
[info]  [SUCCESSFUL ] org.scala-lang.modules#scala-xml_2.11;1.0.2!scala-xml_2.11.jar(bundle) (5747ms)
[info] downloading https://repo1.maven.org/maven2/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.2/scala-parser-combinators_2.11-1.0.2.jar ...
[info]  [SUCCESSFUL ] org.scala-lang.modules#scala-parser-combinators_2.11;1.0.2!scala-parser-combinators_2.11.jar(bundle) (4301ms)
[info] downloading https://repo1.maven.org/maven2/jline/jline/2.12/jline-2.12.jar ...
[info]  [SUCCESSFUL ] jline#jline;2.12!jline.jar (3375ms)
[info] Done updating.
[warn] Scala version was updated by one of library dependencies:
[warn]  * org.scala-lang:scala-library:(2.11.4, 2.11.0, 2.11.5, 2.11.2) -> 2.11.7
[warn] To force scalaVersion, add the following:
[warn]  ivyScala := ivyScala.value map { _.copy(overrideScalaVersion = true) }
[warn] Run 'evicted' to see detailed eviction warnings
[info] Compiling 1 Scala source to /usr/local/spark/mycode/simpleapp/target/scala-2.11/classes...
[info] 'compiler-interface' not yet compiled for Scala 2.11.4. Compiling...
[info] Attempting to fetch org.scala-sbt % compiler-interface % 0.13.11. This operation may fail.
[info] Resolving org.scala-sbt#interface;0.13.11 ...
[info] downloading https://repo.typesafe.com/typesafe/ivy-releases/org.scala-sbt/compiler-interface/0.13.11/srcs/compiler-interface-sources.jar ...
[info]  [SUCCESSFUL ] org.scala-sbt#compiler-interface;0.13.11!compiler-interface.jar(src) (10028ms)
sbt appears to be exiting abnormally.
  The log file for this session is at /tmp/sbt2579544973412404769.log
java.lang.OutOfMemoryError: PermGen space
Error during sbt execution: java.lang.OutOfMemoryError: PermGen space
[root@master simpleapp]# sbt package 
[info] Set current project to Simple Project (in build file:/usr/local/spark/mycode/simpleapp/)
[info] Compiling 1 Scala source to /usr/local/spark/mycode/simpleapp/target/scala-2.11/classes...
[info] 'compiler-interface' not yet compiled for Scala 2.11.4. Compiling...
[info]   Compilation completed in 37.108 s
[info] Packaging /usr/local/spark/mycode/simpleapp/target/scala-2.11/simple-project_2.11-1.0.jar ...
[info] Done packaging.
[success] Total time: 45 s, completed Aug 15, 2017 9:27:46 PM
[root@master simpleapp]# /usr/local/src/spark-1.6.0-bin-hadoop2.6/bin/spark-submit --class "SimpleApp" /usr/local/spark/mycode/simpleapp/target/scala-2.11/simple-project_2.11-1.0.jar
Hello World!
[root@master simpleapp]#
Robin_just
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
SBT构建Scala项目
删繁就简三秋树
11-16 952
1.配置sbt环境变量 a. 解压sbt-1.5.5.zip 到D:\scala\ b. 配置环境变量 c.配置sbtconfig 在sbt/bin下有个sbt.bat，查看该bat文件。可以了解到该文件依赖于conf/sbtconfig.txt。 在conf/sbtconfig.txt中添加： -Dfile.encoding=UTF8 -Dsbt.boot.directory=d:/sbt_repo/boot/ -Dsbt.ivy.home=d:/sbt_repo/ &...
SBT（Scala Build Tool）系列教程-使用sbt构建第一个简单的HelloWorld程序
匆匆过客
04-10 1119
一．如何使用sbt构建第一个简单的HelloWorld程序   1）创建约定好的文件夹 切换到项目的跟目录下，我的项目为hello，输入如下命令，创建约定的文件夹   其中/src/main/resources   存放jar、配置文件等 /src/main/scala       存放scala编写的代码文件     /src/main/java       存放java编写的代码
利用 sbt 创建 scala 项目
klcola的专栏
01-15 371
利用 sbt 命令行可以创建一个 scala 模板项目，该命令为 sbt new scala/scala-seed.g8 sbt 会自动下载项目模板，并提升用户输入自定义的项目名称，非常简单。
Chisel入门——在windows下vscode搭建|部署Scala2.13.3开发环境|用Chisel点亮FPGA小灯等实验
最新发布
weixin_68811361的博客
05-28 1333
Chisel入门——在windows下vscode搭建|部署Scala2.13.3开发环境|用Chisel点亮FPGA小灯等实验
SBT build HelloWorld
weixin_33804582的博客
03-16 195
SBT build HelloWorld focus on : 什么是 SBT ? SBT 项目工程目录 SBT 编译打包 Scala HelloWorld 1-1 SBT, What? SBT 是 Simple Build Tool 的简称. SBT 可以认为是 Scala 世界的 maven。 SBT的着迷特性，比如： DSL ...
sbt安装、配置、運行(scala sbt helloworld)
微电子学与固体电子学-俞驰
11-12 782
下载sbt-1.1.6.tgz --------------------------------------------------------------------------------------------------------------------------------------------------- .bashrc export PATH=~/bigdata/sb...
scala-sbt-helloworld.zip
08-28
在本教程中，我们将深入探讨如何使用VSCode（Visual Studio Code）创建一个名为"Scala-SBT-Helloworld"的Scala项目，并通过sbt进行管理。 首先，我们需要确保已经安装了以下软件： 1. **Scala SDK**: Scala运行环境...
scala-maven:使用Maven作为构建工具的Hello-world Scala项目
05-17
使用Maven的Scala的Hello-world项目 示例项目显示了如何使用maven而不是SBT来构建和运行Scala代码 它利用了maven插件 （用于编译和运行）和 （用于运行单元测试） 编译中 可以使用标准命令mvn compile 跑步 要运行该...
ev3.helloworld:Scala 中的 Mindstorms EV3 Hello World
07-01
运行sbt assembly创建可执行的helloworld.jar文件 通过 USB 线连接 EV3 跑. deploy.sh . deploy.sh通过 USB 连接部署到 EV3 Brick 在 leJOS 下的 EV3 Programs上选择Programs > helloworld.jar > Execute program
akka-web-template:一个基于 sbt 的 scala Akka 项目，它设置了一个支持 REST 和 Comet 的 web 项目
06-01
阿卡网页模板这是一个基于 sbt 的 scala Akka 项目，它设置了一个具有 REST 和 Comet 支持的 Web 项目。 它包括一个简单的 hello-world 风格的演示应用程序和一个 actor 引导类。 它的灵感来自 efleming969 的 。 ...
play-scala-hello-world-tutorial：在Scala中播放的Hello World教程
02-06
【Play Scala Hello World 教程】是初学者进入Scala编程和Play Framework开发的绝佳起点。Play Framework是一个开源的Web应用框架，它基于JVM（Java虚拟机）并以Scala和Java语言为中心，提供了构建现代、反应式Web...
Scala语言入门之Hello world
家辉自留地
05-08 723
Scala语言入门之Hello  world作者：家辉，日期：2018-05-08，CSDN博客：http://blog.csdn.net/gobitan摘要：Scala是Scalable Language的缩写，意为可扩展的语言。Scala是一门多范式语言，同时支持面向对象和函数式编程。近些年Scala在大数据领域应用较多。写此博文为training用。第一步：环境搭建说明：本文的操作系统基于C...
Ubuntu+Spark+IDEA+SBT+scala项目搭建流程记录
yellowpig1210的专栏
04-06 2382
环境配置： 自行配置好IDEA、jdk 在spark官网下载spark-2.1.0-bin-hadoop2.7.tgz并解压，运行spark-shell检验是否可用 IDEA中添加SBT、scala插件 学习步骤建议：尽管网上很多写好的算法代码，spark初学者还是应从基本操作学起。否则用别人的代码跑，报错都不知道错在哪里 1.在spark-shell中尝试简单的scala代
scala sbt资料
u010091867的博客
03-02 234
sbt的安装以及用sbt编译打包scala编写的spark程序 http://blog.csdn.net/a532672728/article/details/72477591 Linux手动安装sbt步骤 http://blog.csdn.net/wangkai_123456/article/details/53907795 Spark快速入门之SBT安装 http://blog.cs...
scala构建工具sbt使用介绍
weixin_30245867的博客
01-31 252
sbt工具下载及说明： https://www.scala-sbt.org/0.13/docs/zh-cn/Installing-sbt-on-Windows.html sbt是交互式构建工具，使用scala定义任务并执行它们 目录下启动 sbt，然后执行 run 命令进入到 sbt 的交互式命令 $ mkdir hello $ cd hello $ echo 'object Hi { ...
scala及sbt安装简介
文思源想的技术空间
02-28 5830
1 scala及sbt安装简述 Scala 是一门多范式（multi-paradigm）的编程语言，设计初衷是要集成面向对象编程和函数式编程的各种特性。 因为目前接触的几个比较重要的框架包括akka、kafaka以及spark都和scala有或多或少的关系，所以还是决定好好了解一下scala语法做到知己知彼。 但是说实话，初接触scala后发现，其项目构建是个比较麻烦的事情，虽然sbt这个工具也比...
10_大数据之spark_note
ChanZany的博客
03-31 1002
spark 1 Spark概述 Spark最初由美国加州伯克利大学（UCBerkeley）的AMP实验室于2009年开发，是基于内存计算的大数据并行计算框架，可用于构建大型的、低延迟的数据分析应用程序 2013年Spark加入Apache孵化器项目后发展迅猛，如今已成为Apache软件基金会最重要的三大分布式计算系统开源项目之一（Hadoop、Spark、Storm） Spark在201...
13.Linux下sbt编译打包Spark程序 和 Maven编译打包Scala程序
ghw666666666的博客
10-23 1375
README文件中包含“a”和“b”的行数，并打印结果。这段代码的作用是计算/usr/local/通过spark-submit运行程序。
spark入门，提交一个 SimpleApp jar包到linux上的spark
天涯枫尘
01-22 2771
spark中文文档没出来前，学习英文很痛苦，分享下自己的学习，好了，上内容，搞完继续去看传说中的english！ 一、前提条件 linux 安装 scala   和 spark scala 二、创建一个maven项目 SimpleApp.java 主要注意的是文件路径，这里用的是spark 自带的样例数据 README.md package com.sparke
SBT构建工具详解：从入门到精通
一旦SBT安装完毕，你可以通过创建一个简单的项目，如"HelloWorld"，来开始学习。这涉及创建项目目录结构，包括`src/main/scala`或`src/main/java`目录来存放源代码，以及一个基础的构建定义文件，例如`build.sbt`。...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值