1：下载
wget http://d3kbcqa49mib13.cloudfront.net/spark-1.2.0.tgz
[jifeng@feng02 hadoop]$ wget http://d3kbcqa49mib13.cloudfront.net/spark-1.2.0.tgz
--2015-02-06 20:41:10-- http://d3kbcqa49mib13.cloudfront.net/spark-1.2.0.tgz
正在解析主机 d3kbcqa49mib13.cloudfront.net... 54.192.159.99, 54.230.158.182, 54.192.156.54, ...
正在连接 d3kbcqa49mib13.cloudfront.net|54.192.159.99|:80... 已连接。
已发出 HTTP 请求，正在等待回应... 200 OK
长度：10290089 (9.8M) [application/x-compressed]
正在保存至: “spark-1.2.0.tgz”
5% [===> ] 548,334 170K/s eta(英国中部时
99% [==========================================================================> ] 10,257,174 189K/s eta(英国中部时
100%[===========================================================================>] 10,290,089 188K/s in 74s
2015-02-06 20:42:25 (136 KB/s) - 已保存 “spark-1.2.0.tgz” [10290089/10290089])2:编译
mvn -Pyarn -Phadoop-2.4.1 -Dhadoop.version=2.4.1 -Phive -DskipTests clean package
用这个命令报错，试了几次都有错误
Downloading: https://repo.spring.io/libs-release/xalan/xalan/2.7.1/xalan-2.7.1.jar
Downloading: https://repo.spring.io/libs-release/org/seleniumhq/selenium/selenium-firefox-driver/2.42.2/selenium-firefox-driver-2.42.2.jar
Downloaded: https://repo.spring.io/libs-release/org/seleniumhq/selenium/selenium-firefox-driver/2.42.2/selenium-firefox-driver-2.42.2.jar (2471 KB at 83.9 KB/sec)
Downloaded: https://repo.spring.io/libs-release/xalan/xalan/2.7.1/xalan-2.7.1.jar (3102 KB at 88.5 KB/sec)
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-core_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-core_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-core_2.10 ---
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar (222 KB at 4.6 KB/sec)
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (default) @ spark-core_2.10 ---
[WARNING] Parameter tasks is deprecated, use target instead
[INFO] Executing tasks
main:
[unzip] Expanding: /home/jifeng/hadoop/spark-1.2.0/python/lib/py4j-0.8.2.1-src.zip into /home/jifeng/hadoop/spark-1.2.0/python/build
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-core_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 11 resources
[INFO] Copying 23 resources
[INFO] Copying 7 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-core_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 402 Scala sources and 33 Java sources to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [27:40 min]
[INFO] Spark Project Networking .......................... SUCCESS [30:09 min]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [ 10.915 s]
[INFO] Spark Project Core ................................ SKIPPED
[INFO] Spark Project Bagel ............................... SKIPPED
[INFO] Spark Project GraphX .............................. SKIPPED
[INFO] Spark Project Streaming ........................... SKIPPED
[INFO] Spark Project Catalyst ............................ SKIPPED
[INFO] Spark Project SQL ................................. SKIPPED
[INFO] Spark Project ML Library .......................... SKIPPED
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Parent POM ..................... SKIPPED
[INFO] Spark Project YARN Stable API ..................... SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project YARN Shuffle Service ................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:30 h
[INFO] Finished at: 2015-02-09T22:49:50+08:00
[INFO] Final Memory: 51M/356M
[INFO] ------------------------------------------------------------------------
---------------------------------------------------
constituent[0]: file:/usr/local/apache-maven-3.2.1/lib/cdi-api-1.0.jar
constituent[1]: file:/usr/local/apache-maven-3.2.1/lib/commons-cli-1.2.jar
constituent[2]: file:/usr/local/apache-maven-3.2.1/lib/maven-plugin-api-3.2.1.jar
constituent[3]: file:/usr/local/apache-maven-3.2.1/lib/javax.inject-1.jar
constituent[4]: file:/usr/local/apache-maven-3.2.1/lib/maven-model-3.2.1.jar
constituent[5]: file:/usr/local/apache-maven-3.2.1/lib/slf4j-api-1.7.5.jar
constituent[6]: file:/usr/local/apache-maven-3.2.1/lib/plexus-sec-dispatcher-1.3.jar
constituent[7]: file:/usr/local/apache-maven-3.2.1/lib/commons-lang-2.6.jar
constituent[8]: file:/usr/local/apache-maven-3.2.1/lib/maven-settings-builder-3.2.1.jar
constituent[9]: file:/usr/local/apache-maven-3.2.1/lib/jsoup-1.7.2.jar
constituent[10]: file:/usr/local/apache-maven-3.2.1/lib/aopalliance-1.0.jar
constituent[11]: file:/usr/local/apache-maven-3.2.1/lib/jsr250-api-1.0.jar
constituent[12]: file:/usr/local/apache-maven-3.2.1/lib/sisu-guice-3.1.3-no_aop.jar
constituent[13]: file:/usr/local/apache-maven-3.2.1/lib/wagon-http-2.6-shaded.jar
constituent[14]: file:/usr/local/apache-maven-3.2.1/lib/maven-repository-metadata-3.2.1.jar
constituent[15]: file:/usr/local/apache-maven-3.2.1/lib/maven-embedder-3.2.1.jar
constituent[16]: file:/usr/local/apache-maven-3.2.1/lib/plexus-component-annotations-1.5.5.jar
constituent[17]: file:/usr/local/apache-maven-3.2.1/lib/aether-connector-wagon-0.9.0.M2.jar
constituent[18]: file:/usr/local/apache-maven-3.2.1/lib/slf4j-simple-1.7.5.jar
constituent[19]: file:/usr/local/apache-maven-3.2.1/lib/plexus-cipher-1.7.jar
constituent[20]: file:/usr/local/apache-maven-3.2.1/lib/commons-io-2.2.jar
constituent[21]: file:/usr/local/apache-maven-3.2.1/lib/guava-14.0.1.jar
constituent[22]: file:/usr/local/apache-maven-3.2.1/lib/plexus-interpolation-1.19.jar
constituent[23]: file:/usr/local/apache-maven-3.2.1/lib/wagon-file-2.6.jar
constituent[24]: file:/usr/local/apache-maven-3.2.1/lib/wagon-http-shared-2.6.jar
constituent[25]: file:/usr/local/apache-maven-3.2.1/lib/aether-api-0.9.0.M2.jar
constituent[26]: file:/usr/local/apache-maven-3.2.1/lib/maven-artifact-3.2.1.jar
constituent[27]: file:/usr/local/apache-maven-3.2.1/lib/aether-util-0.9.0.M2.jar
constituent[28]: file:/usr/local/apache-maven-3.2.1/lib/maven-model-builder-3.2.1.jar
constituent[29]: file:/usr/local/apache-maven-3.2.1/lib/maven-settings-3.2.1.jar
constituent[30]: file:/usr/local/apache-maven-3.2.1/lib/maven-aether-provider-3.2.1.jar
constituent[31]: file:/usr/local/apache-maven-3.2.1/lib/wagon-provider-api-2.6.jar
constituent[32]: file:/usr/local/apache-maven-3.2.1/lib/maven-core-3.2.1.jar
constituent[33]: file:/usr/local/apache-maven-3.2.1/lib/maven-compat-3.2.1.jar
constituent[34]: file:/usr/local/apache-maven-3.2.1/lib/aether-impl-0.9.0.M2.jar
constituent[35]: file:/usr/local/apache-maven-3.2.1/lib/org.eclipse.sisu.plexus-0.0.0.M5.jar
constituent[36]: file:/usr/local/apache-maven-3.2.1/lib/org.eclipse.sisu.inject-0.0.0.M5.jar
constituent[37]: file:/usr/local/apache-maven-3.2.1/lib/plexus-utils-3.0.17.jar
constituent[38]: file:/usr/local/apache-maven-3.2.1/lib/aether-spi-0.9.0.M2.jar
constituent[39]: file:/usr/local/apache-maven-3.2.1/conf/logging/
---------------------------------------------------
Exception in thread "main"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "main"
[jifeng@feng02 spark-1.2.0]$ mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.1 -Phive -DskipTests clean package
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Spark Project Parent POM
[INFO] Spark Project Networking
[INFO] Spark Project Shuffle Streaming Service
[INFO] Spark Project Core
[INFO] Spark Project Bagel
[INFO] Spark Project GraphX
[INFO] Spark Project Streaming
[INFO] Spark Project Catalyst
[INFO] Spark Project SQL
[INFO] Spark Project ML Library
[INFO] Spark Project Tools
[INFO] Spark Project Hive
[INFO] Spark Project REPL
[INFO] Spark Project YARN Parent POM
[INFO] Spark Project YARN Stable API
[INFO] Spark Project Assembly
[INFO] Spark Project External Twitter
[INFO] Spark Project External Flume Sink
[INFO] Spark Project External Flume
[INFO] Spark Project External MQTT
[INFO] Spark Project External ZeroMQ
[INFO] Spark Project External Kafka
[INFO] Spark Project Examples
[INFO] Spark Project YARN Shuffle Service
[INFO]
[INFO] Using the builder org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder with a thread count of 1
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Parent POM 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-parent ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-parent ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-parent ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-parent ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-parent ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-parent ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/src/test/scala added.
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-parent ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-parent ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-parent ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-parent ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-parent ---
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-parent ---
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-parent ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 48 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Networking 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-common_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/common/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-common_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/common/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-common_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/common/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 42 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-common_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 42 source files to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-common_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/common/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-common_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/common/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-common_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 7 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-common_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-common_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (test-jar-on-test-compile) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-tests.jar
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-common_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-common_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-common_2.10 ---
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/common/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/common/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-common_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/common/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/common/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 10 ms
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (default) @ spark-network-common_2.10 ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Shuffle Streaming Service 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-shuffle_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-shuffle_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-shuffle_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-shuffle_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 20 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-shuffle_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 20 source files to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-shuffle_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-shuffle_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-shuffle_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 11 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-shuffle_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 11 source files to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-shuffle_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-shuffle_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-shuffle_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-network-shuffle_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-shuffle_2.10 ---
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-shuffle_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-shuffle_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/shuffle/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 33 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Core 1.2.0
[INFO] ------------------------------------------------------------------------
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.pom
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.pom (6 KB at 2.4 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.1.2/httpcomponents-client-4.1.2.pom
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.1.2/httpcomponents-client-4.1.2.pom (12 KB at 18.5 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.pom
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.pom (8 KB at 12.1 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.1.2/httpcomponents-core-4.1.2.pom
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.1.2/httpcomponents-core-4.1.2.pom (10 KB at 15.9 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloaded: https://repo1.maven.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom (0 B at 0.0 KB/sec)
Downloading: https://repository.apache.org/content/repositories/releases/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://repository.jboss.org/nexus/content/repositories/releases/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://repo.eclipse.org/content/repositories/paho-releases/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: http://repository.mapr.com/maven/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
二月 10, 2015 11:04:34 上午 org.apache.maven.wagon.providers.http.httpclient.client.protocol.ResponseProcessCookies processCookies
警告: Cookie rejected: "[version: 0][name: rememberMe][value: deleteMe][domain: repository.mapr.com][path: /nexus][expiry: Tue Feb 10 11:04:34 CST 2015]". Illegal path attribute "/nexus". Path of origin: "/maven/org/sonatype/oss/oss-parent/3/oss-parent-3.pom"
Downloading: https://repo.spring.io/libs-release/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloaded: https://repo.spring.io/libs-release/org/sonatype/oss/oss-parent/3/oss-parent-3.pom (0 B at 0.0 KB/sec)
Downloading: https://oss.sonatype.org/content/repositories/orgspark-project-1085/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://oss.sonatype.org/content/repositories/orgspark-project-1089/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: http://download.java.net/maven/2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.jar
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.jar
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.jar (177 KB at 34.0 KB/sec)
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.jar (344 KB at 22.9 KB/sec)
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-core_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-core_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (default) @ spark-core_2.10 ---
[WARNING] Parameter tasks is deprecated, use target instead
[INFO] Executing tasks
main:
[unzip] Expanding: /home/jifeng/hadoop/spark-1.2.0/python/lib/py4j-0.8.2.1-src.zip into /home/jifeng/hadoop/spark-1.2.0/python/build
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-core_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 11 resources
[INFO] Copying 23 resources
[INFO] Copying 7 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-core_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 402 Scala sources and 33 Java sources to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes...
[ERROR]
while compiling: /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/broadcast/TorrentBroadcast.scala
during phase: typer
library version: version 2.10.4
compiler version: version 2.10.4
reconstructed args: -Xplugin:/home/jifeng/.m2/repository/org/scalamacros/paradise_2.10.4/2.0.1/paradise_2.10.4-2.0.1.jar -deprecation -feature -classpath /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes:/home/jifeng/.m2/repository/com/twitter/chill_2.10/0.5.0/chill_2.10-0.5.0.jar:/home/jifeng/.m2/repository/com/esotericsoftware/kryo/kryo/2.21/kryo-2.21.jar:/home/jifeng/.m2/repository/com/esotericsoftware/reflectasm/reflectasm/1.07/reflectasm-1.07-shaded.jar:/home/jifeng/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/jifeng/.m2/repository/org/objenesis/objenesis/1.2/objenesis-1.2.jar:/home/jifeng/.m2/repository/com/twitter/chill-java/0.5.0/chill-java-0.5.0.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-client/2.4.1/hadoop-client-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1.jar:/home/jifeng/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jifeng/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jifeng/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/jifeng/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jifeng/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/home/jifeng/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jifeng/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jifeng/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jifeng/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/home/jifeng/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/home/jifeng/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar:/home/jifeng/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/jifeng/.m2/repository/org/apache/avro/avro/1.7.6/avro-1.7.6.jar:/home/jifeng/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-auth/2.4.1/hadoop-auth-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/jifeng/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1.jar:/home/jifeng/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.1/hadoop-mapreduce-client-app-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.1/hadoop-mapreduce-client-common-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.4.1/hadoop-yarn-client-2.4.1.jar:/home/jifeng/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.4.1/hadoop-yarn-server-common-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.1/hadoop-mapreduce-client-shuffle-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.4.1/hadoop-yarn-api-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.1/hadoop-mapreduce-client-core-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.4.1/hadoop-yarn-common-2.4.1.jar:/home/jifeng/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jifeng/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jifeng/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/jifeng/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-annotations/2.4.1/hadoop-annotations-2.4.1.jar:/home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar:/home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar:/home/jifeng/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/home/jifeng/.m2/repository/commons-codec/commons-codec/1.5/commons-codec-1.5.jar:/home/jifeng/.m2/repository/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.jar:/home/jifeng/.m2/repository/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.jar:/home/jifeng/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/home/jifeng/.m2/repository/org/apache/curator/curator-recipes/2.4.0/curator-recipes-2.4.0.jar:/home/jifeng/.m2/repository/org/apache/curator/curator-framework/2.4.0/curator-framework-2.4.0.jar:/home/jifeng/.m2/repository/org/apache/curator/curator-client/2.4.0/curator-client-2.4.0.jar:/home/jifeng/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar:/home/jifeng/.m2/repository/jline/jline/0.9.94/jline-0.9.94.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-plus/8.1.14.v20131031/jetty-plus-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/orbit/javax.transaction/1.1.1.v201105210645/javax.transaction-1.1.1.v201105210645.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-webapp/8.1.14.v20131031/jetty-webapp-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-xml/8.1.14.v20131031/jetty-xml-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-servlet/8.1.14.v20131031/jetty-servlet-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-jndi/8.1.14.v20131031/jetty-jndi-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/orbit/javax.mail.glassfish/1.4.1.v201005082020/javax.mail.glassfish-1.4.1.v201005082020.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/orbit/javax.activation/1.1.0.v201105071233/javax.activation-1.1.0.v201105071233.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-security/8.1.14.v20131031/jetty-security-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-util/8.1.14.v20131031/jetty-util-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-server/8.1.14.v20131031/jetty-server-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-continuation/8.1.14.v20131031/jetty-continuation-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-http/8.1.14.v20131031/jetty-http-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-io/8.1.14.v20131031/jetty-io-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jifeng/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/home/jifeng/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/home/jifeng/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/jifeng/.m2/repository/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar:/home/jifeng/.m2/repository/org/slf4j/jul-to-slf4j/1.7.5/jul-to-slf4j-1.7.5.jar:/home/jifeng/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.5/jcl-over-slf4j-1.7.5.jar:/home/jifeng/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jifeng/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar:/home/jifeng/.m2/repository/com/ning/compress-lzf/1.0.0/compress-lzf-1.0.0.jar:/home/jifeng/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar:/home/jifeng/.m2/repository/net/jpountz/lz4/lz4/1.2.0/lz4-1.2.0.jar:/home/jifeng/.m2/repository/org/roaringbitmap/RoaringBitmap/0.4.5/RoaringBitmap-0.4.5.jar:/home/jifeng/.m2/repository/commons-net/commons-net/2.2/commons-net-2.2.jar:/home/jifeng/.m2/repository/org/spark-project/akka/akka-remote_2.10/2.3.4-spark/akka-remote_2.10-2.3.4-spark.jar:/home/jifeng/.m2/repository/org/spark-project/akka/akka-actor_2.10/2.3.4-spark/akka-actor_2.10-2.3.4-spark.jar:/home/jifeng/.m2/repository/com/typesafe/config/1.2.1/config-1.2.1.jar:/home/jifeng/.m2/repository/io/netty/netty/3.8.0.Final/netty-3.8.0.Final.jar:/home/jifeng/.m2/repository/org/spark-project/protobuf/protobuf-java/2.5.0-spark/protobuf-java-2.5.0-spark.jar:/home/jifeng/.m2/repository/org/uncommons/maths/uncommons-maths/1.2.2a/uncommons-maths-1.2.2a.jar:/home/jifeng/.m2/repository/org/spark-project/akka/akka-slf4j_2.10/2.3.4-spark/akka-slf4j_2.10-2.3.4-spark.jar:/home/jifeng/.m2/repository/org/json4s/json4s-jackson_2.10/3.2.10/json4s-jackson_2.10-3.2.10.jar:/home/jifeng/.m2/repository/org/json4s/json4s-core_2.10/3.2.10/json4s-core_2.10-3.2.10.jar:/home/jifeng/.m2/repository/org/json4s/json4s-ast_2.10/3.2.10/json4s-ast_2.10-3.2.10.jar:/home/jifeng/.m2/repository/com/thoughtworks/paranamer/paranamer/2.6/paranamer-2.6.jar:/home/jifeng/.m2/repository/org/scala-lang/scalap/2.10.4/scalap-2.10.4.jar:/home/jifeng/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar:/home/jifeng/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.3.1/jackson-databind-2.3.1.jar:/home/jifeng/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.3.0/jackson-annotations-2.3.0.jar:/home/jifeng/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.3.1/jackson-core-2.3.1.jar:/home/jifeng/.m2/repository/org/apache/mesos/mesos/0.18.1/mesos-0.18.1-shaded-protobuf.jar:/home/jifeng/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/home/jifeng/.m2/repository/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar:/home/jifeng/.m2/repository/com/codahale/metrics/metrics-core/3.0.0/metrics-core-3.0.0.jar:/home/jifeng/.m2/repository/com/codahale/metrics/metrics-jvm/3.0.0/metrics-jvm-3.0.0.jar:/home/jifeng/.m2/repository/com/codahale/metrics/metrics-json/3.0.0/metrics-json-3.0.0.jar:/home/jifeng/.m2/repository/com/codahale/metrics/metrics-graphite/3.0.0/metrics-graphite-3.0.0.jar:/home/jifeng/.m2/repository/org/tachyonproject/tachyon-client/0.5.0/tachyon-client-0.5.0.jar:/home/jifeng/.m2/repository/org/tachyonproject/tachyon/0.5.0/tachyon-0.5.0.jar:/home/jifeng/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar:/home/jifeng/.m2/repository/org/spark-project/pyrolite/2.0.1/pyrolite-2.0.1.jar:/home/jifeng/.m2/repository/net/sf/py4j/py4j/0.8.2.1/py4j-0.8.2.1.jar:/home/jifeng/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jifeng/.m2/repository/org/codehaus/groovy/groovy-all/2.3.7/groovy-all-2.3.7.jar -bootclasspath /home/jifeng/jdk1.7.0_45/jre/lib/resources.jar:/home/jifeng/jdk1.7.0_45/jre/lib/rt.jar:/home/jifeng/jdk1.7.0_45/jre/lib/sunrsasign.jar:/home/jifeng/jdk1.7.0_45/jre/lib/jsse.jar:/home/jifeng/jdk1.7.0_45/jre/lib/jce.jar:/home/jifeng/jdk1.7.0_45/jre/lib/charsets.jar:/home/jifeng/jdk1.7.0_45/jre/lib/jfr.jar:/home/jifeng/jdk1.7.0_45/jre/classes:/home/jifeng/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar -unchecked
last tree to typer: Ident(Boolean)
symbol: <none> (flags: )
symbol definition: <none>
symbol owners:
context owners: value $anonfun -> value is -> method unBlockifyObject -> object TorrentBroadcast -> package broadcast
== Enclosing template or block ==
Block(
// 7 statements
Apply(
"require"
// 2 arguments
"blocks"."nonEmpty"
"Cannot unblockify an empty array of blocks"
)
ValDef( // val is: <?>
0
"is"
<tpt>
Apply(
new SequenceInputStream."<init>"
Apply(
"asJavaEnumeration"
Apply(
"blocks"."iterator"."map"
Function( // val $anonfun: <notype>
ValDef( // block: java.nio.ByteBuffer
<param>
"block"
<tpt> // tree.tpe=java.nio.ByteBuffer
<empty>
)
Apply(
new ByteBufferInputStream."<init>"
"block"
)
)
)
)
)
)
ValDef( // val in: <?>
0
"in"
"InputStream"
Apply(
compressionCodec.map(((c) => c.compressedInputStream(is)))."getOrElse"
"is"
)
)
ValDef( // val ser: <?>
0
"ser"
<tpt>
Apply(
"serializer"."newInstance"
Nil
)
)
ValDef( // val serIn: <?>
0
"serIn"
<tpt>
Apply(
"ser"."deserializeStream"
"in"
)
)
ValDef( // val obj: <?>
0
"obj"
<tpt>
Apply(
TypeApply(
"serIn"."readObject"
"T"
)
Nil
)
)
Apply(
"serIn"."close"
Nil
)
"obj"
)
uncaught exception during compilation: java.lang.OutOfMemoryError
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [ 9.006 s]
[INFO] Spark Project Networking .......................... SUCCESS [ 11.639 s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [ 8.465 s]
[INFO] Spark Project Core ................................ SKIPPED
[INFO] Spark Project Bagel ............................... SKIPPED
[INFO] Spark Project GraphX .............................. SKIPPED
[INFO] Spark Project Streaming ........................... SKIPPED
[INFO] Spark Project Catalyst ............................ SKIPPED
[INFO] Spark Project SQL ................................. SKIPPED
[INFO] Spark Project ML Library .......................... SKIPPED
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Parent POM ..................... SKIPPED
[INFO] Spark Project YARN Stable API ..................... SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project YARN Shuffle Service ................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:00 min
[INFO] Finished at: 2015-02-10T11:05:46+08:00
[INFO] Final Memory: 51M/384M
[INFO] ------------------------------------------------------------------------
[ERROR] PermGen space -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError用这个./make-distribution.sh --tgz -Phadoop-2.4 -Pyarn -DskipTests -Dhadoop.version=2.4.1 -Phive
OK!
[jifeng@feng02 spark-1.2.0]$ ./make-distribution.sh --tgz -Phadoop-2.4 -Pyarn -DskipTests -Dhadoop.version=2.4.1 -Phive
***NOTE***: JAVA_HOME is not set to a JDK 6 installation. The resulting
distribution may not work well with PySpark and will not run
with Java 6 (See SPARK-1703 and SPARK-1911).
This test can be disabled by adding --skip-java-test.
Output from 'java -version' was:
java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)
Would you like to continue anyways? [y,n]: y
Spark version is 1.2.0
Making spark-1.2.0-bin-2.4.1.tgz
Tachyon Disabled
Building with...
$ mvn clean package -DskipTests -Phadoop-2.4 -Pyarn -DskipTests -Dhadoop.version=2.4.1 -Phive
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Spark Project Parent POM
[INFO] Spark Project Networking
[INFO] Spark Project Shuffle Streaming Service
[INFO] Spark Project Core
[INFO] Spark Project Bagel
[INFO] Spark Project GraphX
[INFO] Spark Project Streaming
[INFO] Spark Project Catalyst
[INFO] Spark Project SQL
[INFO] Spark Project ML Library
[INFO] Spark Project Tools
[INFO] Spark Project Hive
[INFO] Spark Project REPL
[INFO] Spark Project YARN Parent POM
[INFO] Spark Project YARN Stable API
[INFO] Spark Project Assembly
[INFO] Spark Project External Twitter
[INFO] Spark Project External Flume Sink
[INFO] Spark Project External Flume
[INFO] Spark Project External MQTT
[INFO] Spark Project External ZeroMQ
[INFO] Spark Project External Kafka
[INFO] Spark Project Examples
[INFO] Spark Project YARN Shuffle Service
[INFO]
[INFO] Using the builder org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder with a thread count of 1
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Parent POM 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-parent ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-parent ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-parent ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-parent ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-parent ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-parent ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/src/test/scala added.
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-parent ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-parent ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-parent ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-parent ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-parent ---
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-parent ---
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-parent ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 34 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Networking 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-common_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/common/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-common_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/common/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-common_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/common/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 42 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-common_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 42 source files to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-common_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/common/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-common_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/common/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-common_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 7 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-common_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-common_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (test-jar-on-test-compile) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-tests.jar
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-common_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-common_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-common_2.10 ---
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/common/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/common/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-common_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/common/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/common/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1 ms
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (default) @ spark-network-common_2.10 ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Shuffle Streaming Service 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-shuffle_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-shuffle_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-shuffle_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-shuffle_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 20 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-shuffle_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 20 source files to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-shuffle_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-shuffle_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-shuffle_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 11 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-shuffle_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 11 source files to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-shuffle_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-shuffle_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-shuffle_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-network-shuffle_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-shuffle_2.10 ---
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-shuffle_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-shuffle_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/shuffle/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Core 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-core_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/core/target
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/META-INF/NOTICE
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/META-INF/DEPENDENCIES
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/META-INF/LICENSE
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/META-INF
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/finalizer.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/java_collections.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/version.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/compat.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/java_gateway.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/__init__.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/protocol.py
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/spark-logo-77x50px-hd.png
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/additional-metrics.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/bootstrap-tooltip.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/jquery-1.11.1.min.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/spark_logo.png
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/initialize-tooltips.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/sorttable.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/bootstrap.min.css
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/webui.css
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/table.js
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/log4j-defaults.properties
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/tests.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/shell.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/traceback_utils.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/storagelevel.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/serializers.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/broadcast.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/java_gateway.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/daemon.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/__init__.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/accumulators.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/sql.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/resultiterable.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/rddsampler.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/statcounter.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/worker.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/cloudpickle.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/shuffle.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/files.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/rdd.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/conf.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/context.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/heapq3.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/join.py
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/antrun/build-main.xml
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/antrun
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources/META-INF/NOTICE
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources/META-INF/DEPENDENCIES
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources/META-INF/LICENSE
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources/META-INF
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/.plxarc
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/core/../python/build (includes = [], excludes = [])
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/finalizer.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/java_collections.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/version.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/compat.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/java_gateway.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/__init__.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_callback_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/py4j_callback_example.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_list_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_gateway_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/multithreadtest.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/__init__.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/byte_string_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_map_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/py4j_example.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/py4j_callback_example2.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_array_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_set_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/finalizer_test.py
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/protocol.py
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/python/build/py4j
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/python/build
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-core_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-core_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (default) @ spark-core_2.10 ---
[WARNING] Parameter tasks is deprecated, use target instead
[INFO] Executing tasks
main:
[unzip] Expanding: /home/jifeng/hadoop/spark-1.2.0/python/lib/py4j-0.8.2.1-src.zip into /home/jifeng/hadoop/spark-1.2.0/python/build
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-core_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 11 resources
[INFO] Copying 23 resources
[INFO] Copying 7 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-core_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 402 Scala sources and 33 Java sources to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/scheduler/TaskResultGetter.scala:50: inferred existential type (org.apache.spark.scheduler.DirectTaskResult[_$1], Int) forSome { type _$1 }, which cannot be expressed by wildcards, should be enabled
by making the implicit value scala.language.existentials visible.
This can be achieved by adding the import clause 'import scala.language.existentials'
or by setting the compiler option -language:existentials.
See the Scala docs for value scala.language.existentials for a discussion
why the feature should be explicitly enabled.
[WARNING] val (result, size) = serializer.get().deserialize[TaskResult[_]](serializedData) match {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkContext.scala:573: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewHadoopJob(hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkContext.scala:618: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewHadoopJob(hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkContext.scala:773: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewHadoopJob(conf)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkHadoopWriter.scala:168: constructor TaskID in class TaskID is deprecated: see corresponding Javadoc for more information.
[WARNING] new TaskAttemptID(new TaskID(jID.value, true, splitID), attemptID))
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkHadoopWriter.scala:189: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] outputPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala:103: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (!fs.getFileStatus(path).isDir) {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala:157: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] val logDirs = if (logStatus != null) logStatus.filter(_.isDir).toSeq else Seq[FileStatus]()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/input/PortableDataStream.scala:48: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (file.isDir) 0L else file.getLen
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/input/WholeTextFileInputFormat.scala:63: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (file.isDir) 0L else file.getLen
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala:56: constructor TaskAttemptID in class TaskAttemptID is deprecated: see corresponding Javadoc for more information.
[WARNING] new TaskAttemptID(jtIdentifier, jobId, isMap, taskId, attemptId)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/rdd/CheckpointRDD.scala:110: method getDefaultReplication in class FileSystem is deprecated: see corresponding Javadoc for more information.
[WARNING] fs.create(tempOutputPath, false, bufferSize, fs.getDefaultReplication, blockSize)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala:349: constructor TaskID in class TaskID is deprecated: see corresponding Javadoc for more information.
[WARNING] val taId = new TaskAttemptID(new TaskID(jobID, true, splitId), attemptId)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala:884: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewAPIHadoopJob(hadoopConf)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala:952: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewAPIHadoopJob(hadoopConf)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala:202: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] fileStatuses.filter(!_.isDir).map(_.getPath).toSeq
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/scheduler/InputFormatInfo.scala:106: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(conf)
[WARNING] ^
[WARNING] 17 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-core_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 33 source files to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-core_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-core_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-core_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 123 Scala sources and 4 Java sources to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/test-classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/FileSuite.scala:497: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(sc.hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/metrics/InputOutputMetricsSuite.scala:34: trait ShouldMatchers in package matchers is deprecated: Please use org.scalatest.Matchers instead.
[WARNING] class InputOutputMetricsSuite extends FunSuite with SharedSparkContext with ShouldMatchers {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/scheduler/EventLoggingListenerSuite.scala:177: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] assert(logDir.isDir)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/scheduler/ReplayListenerSuite.scala:124: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] assert(eventLogDir.isDir)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/util/FileLoggerSuite.scala:106: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] assert(fileSystem.getFileStatus(logDirPath).isDir)
[WARNING] ^
[WARNING] 5 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/core/src/test/java/org/apache/spark/JavaAPISuite.java使用或覆盖了已过时的 API。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/core/src/test/java/org/apache/spark/JavaAPISuite.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-core_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 4 source files to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-core_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/core/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-core_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-core_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-core_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-core_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/core/target/spark-core_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-dependency-plugin:2.9:copy-dependencies (copy-dependencies) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-core_2.10 ---
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Including com.google.guava:guava:jar:14.0.1 in the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.spark-project.spark:unused:jar:1.0.0 from the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/core/target/spark-core_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/core/target/spark-core_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/core/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/core/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-core_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/core/target/spark-core_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-core_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/core/scalastyle-output.xml
Processed 401 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 11690 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Bagel 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-bagel_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/bagel/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-bagel_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-bagel_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/bagel/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-bagel_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-bagel_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/bagel/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-bagel_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 2 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/bagel/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-bagel_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/bagel/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-bagel_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/bagel/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-bagel_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-bagel_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source to /home/jifeng/hadoop/spark-1.2.0/bagel/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-bagel_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-bagel_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-bagel_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-bagel_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-bagel_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-bagel_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-bagel_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-bagel_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-bagel_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-bagel_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-bagel_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/bagel/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/bagel/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-bagel_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-bagel_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-bagel_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/bagel/scalastyle-output.xml
Processed 2 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 421 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project GraphX 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-graphx_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/graphx/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-graphx_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-graphx_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/graphx/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-graphx_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-graphx_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/graphx/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-graphx_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 38 Scala sources and 5 Java sources to /home/jifeng/hadoop/spark-1.2.0/graphx/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala:124: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] var messages = g.mapReduceTriplets(sendMsg, mergeMsg)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala:141: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] messages = g.mapReduceTriplets(sendMsg, mergeMsg, Some((newVerts, activeDirection))).cache()
[WARNING] ^
[WARNING] two warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-graphx_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/jifeng/hadoop/spark-1.2.0/graphx/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-graphx_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-graphx_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-graphx_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 17 Scala sources to /home/jifeng/hadoop/spark-1.2.0/graphx/target/scala-2.10/test-classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:223: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val result = graph.mapReduceTriplets[Int](et => Iterator((et.dstId, et.srcAttr)), _ + _)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:287: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val neighborDegreeSums = starDeg.mapReduceTriplets(
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:297: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val numEvenNeighbors = vids.mapReduceTriplets(et => {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:311: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val numOddNeighbors = changedGraph.mapReduceTriplets(et => {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:345: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val neighborDegreeSums = reverseStarDegrees.mapReduceTriplets(
[WARNING] ^
[WARNING] 5 warnings found
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-graphx_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-graphx_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-graphx_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-graphx_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-graphx_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-graphx_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-graphx_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-graphx_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-graphx_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.jblas:jblas:jar:1.2.3 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-graphx_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-graphx_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/graphx/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/graphx/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-graphx_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-graphx_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-graphx_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/graphx/scalastyle-output.xml
Processed 38 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 819 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Streaming 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/streaming/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/streaming/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/streaming/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 80 Scala sources and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/streaming/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/streaming/src/main/scala/org/apache/spark/streaming/util/WriteAheadLogManager.scala:184: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (fileSystem.exists(logDirectoryPath) && fileSystem.getFileStatus(logDirectoryPath).isDir) {
[WARNING] ^
[WARNING] one warning found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/streaming/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/streaming/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 19 Scala sources and 5 Java sources to /home/jifeng/hadoop/spark-1.2.0/streaming/target/scala-2.10/test-classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/streaming/src/test/scala/org/apache/spark/streaming/util/WriteAheadLogSuite.scala:343: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (fileSystem.exists(logDirectoryPath) && fileSystem.getFileStatus(logDirectoryPath).isDir) {
[WARNING] ^
[WARNING] one warning found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java使用或覆盖了已过时的 API。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/jifeng/hadoop/spark-1.2.0/streaming/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (test-jar-on-test-compile) @ spark-streaming_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0-tests.jar
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/streaming/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/streaming/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/streaming/scalastyle-output.xml
Processed 80 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 670 ms
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ spark-streaming_2.10 ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Catalyst 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-catalyst_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-catalyst_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-catalyst_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-catalyst_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-catalyst_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-catalyst_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 67 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-catalyst_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-catalyst_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-catalyst_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-catalyst_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 22 Scala sources to /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-catalyst_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-catalyst_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (test-jar-on-test-compile) @ spark-catalyst_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0-tests.jar
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-catalyst_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-catalyst_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-catalyst_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-catalyst_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-catalyst_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-catalyst_2.10 ---
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-catalyst_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-catalyst_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/sql/catalyst/scalastyle-output.xml
Processed 67 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1836 ms
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ spark-catalyst_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0-tests.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project SQL 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-sql_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/sql/core/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-sql_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-sql_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-sql_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-sql_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-sql_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 66 Scala sources and 44 Java sources to /home/jifeng/hadoop/spark-1.2.0/sql/core/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetRelation.scala:182: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] val path = origPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:83: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(sc.hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:222: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(sqlContext.sparkContext.hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:275: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(conf)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:614: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] val path = origPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:615: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (!fs.exists(path) || !fs.getFileStatus(path).isDir) {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTestData.scala:220: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:368: method fromCaseClassString in object DataType is deprecated: Use DataType.fromJson instead
[WARNING] Try(DataType.fromJson(string)).getOrElse(DataType.fromCaseClassString(string)) match {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:387: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] val path = origPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:388: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (fs.exists(path) && !fs.getFileStatus(path).isDir) {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:432: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:438: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] val path = origPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:457: method readFooter in object ParquetFileReader is deprecated: see corresponding Javadoc for more information.
[WARNING] .map(ParquetFileReader.readFooter(conf, _))
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala:103: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] val childDirs = childrenOfPath.filter(s => s.isDir)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala:156: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(sparkContext.hadoopConfiguration)
[WARNING] ^
[WARNING] 15 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/java/org/apache/spark/sql/api/java/UserDefinedType.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-sql_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 44 source files to /home/jifeng/hadoop/spark-1.2.0/sql/core/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-sql_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-sql_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-sql_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 38 Scala sources and 5 Java sources to /home/jifeng/hadoop/spark-1.2.0/sql/core/target/scala-2.10/test-classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:288: postfix operator asc should be enabled
by making the implicit value scala.language.postfixOps visible.
This can be achieved by adding the import clause 'import scala.language.postfixOps'
or by setting the compiler option -language:postfixOps.
See the Scala docs for value scala.language.postfixOps for a discussion
why the feature should be explicitly enabled.
[WARNING] testData.select(sqrt('key)).orderBy('key asc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:293: postfix operator asc should be enabled
by making the implicit value scala.language.postfixOps visible.
[WARNING] testData.select(sqrt('value), 'key).orderBy('key asc, 'value asc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:293: postfix operator asc should be enabled
by making the implicit value scala.language.postfixOps visible.
[WARNING] testData.select(sqrt('value), 'key).orderBy('key asc, 'value asc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:305: postfix operator asc should be enabled
by making the implicit value scala.language.postfixOps visible.
[WARNING] testData.select(abs('key)).orderBy('key asc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:310: postfix operator desc should be enabled
by making the implicit value scala.language.postfixOps visible.
[WARNING] negativeData.select(abs('key)).orderBy('key desc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetQuerySuite.scala:457: abstract type T is unchecked since it is eliminated by erasure
[WARNING] assert(filter.get.isInstanceOf[T])
[WARNING] ^
[WARNING] abstract type T is unchecked since it is eliminated by erasure
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetQuerySuite.scala:336: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] 8 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/java/org/apache/spark/sql/api/java/JavaRowSuite.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-sql_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/jifeng/hadoop/spark-1.2.0/sql/core/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-sql_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-sql_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-sql_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-sql_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-sql_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-sql_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-sql_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-sql_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-catalyst_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-column:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-common:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-encoding:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-generator:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding com.twitter:parquet-hadoop:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-format:jar:2.2.0-rc1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-jackson:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.11 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.0 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-sql_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-sql_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/core/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/core/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-sql_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-sql_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-sql_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/sql/core/scalastyle-output.xml
Processed 66 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1153 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project ML Library 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-mllib_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/mllib/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-mllib_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-mllib_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/mllib/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-mllib_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-mllib_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 13 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-mllib_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 121 Scala sources and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/mllib/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-mllib_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/mllib/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-mllib_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/mllib/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-mllib_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-mllib_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 58 Scala sources and 16 Java sources to /home/jifeng/hadoop/spark-1.2.0/mllib/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/mllib/src/test/java/org/apache/spark/mllib/feature/JavaTfIdfSuite.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-mllib_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 16 source files to /home/jifeng/hadoop/spark-1.2.0/mllib/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-mllib_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-mllib_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-mllib_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-mllib_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-mllib_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-mllib_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-mllib_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-mllib_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-streaming_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-sql_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-catalyst_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-column:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-common:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-encoding:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-generator:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-hadoop:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-format:jar:2.2.0-rc1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-jackson:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.11 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.0 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.jblas:jblas:jar:1.2.3 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze_2.10:jar:0.10 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze-macros_2.10:jar:0.3.1 from the shaded jar.
[INFO] Excluding com.github.fommil.netlib:core:jar:1.1.2 from the shaded jar.
[INFO] Excluding net.sourceforge.f2j:arpack_combined_all:jar:0.1 from the shaded jar.
[INFO] Excluding net.sf.opencsv:opencsv:jar:2.3 from the shaded jar.
[INFO] Excluding com.github.rwl:jtransforms:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.spire-math:spire_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.spire-math:spire-macros_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-mllib_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-mllib_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/mllib/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/mllib/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-mllib_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-mllib_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-mllib_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/mllib/scalastyle-output.xml
Processed 121 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1190 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Tools 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-tools_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/tools/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-tools_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-tools_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/tools/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-tools_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-tools_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/tools/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-tools_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources to /home/jifeng/hadoop/spark-1.2.0/tools/target/scala-2.10/classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-tools_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-tools_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/tools/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-tools_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/tools/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-tools_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-tools_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-tools_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/tools/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-tools_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-tools_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-tools_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-tools_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/tools/target/spark-tools_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-tools_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-tools_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-streaming_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/tools/target/spark-tools_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/tools/target/spark-tools_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/tools/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-tools_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/tools/target/spark-tools_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-tools_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/tools/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 46 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Hive 1.2.0
[INFO] ------------------------------------------------------------------------
Downloading: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.5/avro-mapred-1.7.5.jar
Downloading: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.6/avro-mapred-1.7.6-hadoop2.jar
Downloaded: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.6/avro-mapred-1.7.6-hadoop2.jar (169 KB at 40.2 KB/sec)
Downloaded: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.5/avro-mapred-1.7.5.jar (167 KB at 34.6 KB/sec)
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-hive_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/sql/hive/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-hive_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-hive_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala added.
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-default-sources) @ spark-hive_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/hive/v0.13.1/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-hive_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-hive_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-hive_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 21 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/parquet/FakeParquetSerDe.scala:34: @deprecated now takes two arguments; see the scaladoc.
[WARNING] @deprecated("No code should depend on FakeParquetHiveSerDe as it is only intended as a " +
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala:141: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] val size = if (fileStatus.isDir) {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala:494: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] Utils.getContextOrSparkClassLoader).asInstanceOf[Class[Deserializer]],
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:73: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] relation.tableDesc.getDeserializerClass.asInstanceOf[Class[Deserializer]],
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:87: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] deserializerClass: Class[_ <: Deserializer],
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:121: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] (part, part.getDeserializer.getClass.asInstanceOf[Class[Deserializer]])).toMap
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:136: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] partitionToDeserializer: Map[HivePartition,
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:266: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] deserializer: Deserializer,
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala:63: trait Serializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] private def newSerializer(tableDesc: TableDesc): Serializer = {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala:64: trait Serializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] val serializer = tableDesc.getDeserializerClass.newInstance().asInstanceOf[Serializer]
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala:218: class UDAF in package exec is deprecated: see corresponding Javadoc for more information.
[WARNING] type UDFType = UDAF
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala:267: method initialize in class GenericUDTF is deprecated: see corresponding Javadoc for more information.
[WARNING] protected lazy val outputInspector = function.initialize(inputInspectors.toArray)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala:333: class UDAF in package exec is deprecated: see corresponding Javadoc for more information.
[WARNING] new GenericUDAFBridge(funcWrapper.createFunction[UDAF]())
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveWriterContainers.scala:142: constructor TaskID in class TaskID is deprecated: see corresponding Javadoc for more information.
[WARNING] new TaskAttemptID(new TaskID(jID.value, true, splitID), attemptID))
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/v0.13.1/src/main/scala/org/apache/spark/sql/hive/Shim13.scala:159: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] serdeClass: Class[_ <: Deserializer],
[WARNING] ^
[WARNING] 15 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-hive_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-hive_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/test/scala added.
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/hive/compatibility/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-hive_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9636 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-hive_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 24 Scala sources and 5 Java sources to /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/test/java/org/apache/spark/sql/hive/execution/UDFListListInt.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-hive_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.4:build-classpath (default) @ spark-hive_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-hive_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-hive_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-hive_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-hive_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-hive_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-hive_2.10 ---
[INFO]
[INFO] --- maven-dependency-plugin:2.4:copy-dependencies (copy-dependencies) @ spark-hive_2.10 ---
[INFO] datanucleus-core-3.2.10.jar already exists in destination.
[INFO] datanucleus-rdbms-3.2.9.jar already exists in destination.
[INFO] datanucleus-api-jdo-3.2.6.jar already exists in destination.
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-hive_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-sql_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-catalyst_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-column:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-common:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-encoding:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-generator:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-hadoop:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-format:jar:2.2.0-rc1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-jackson:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.0 from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-metastore:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-shims:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-common:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-0.20:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-common-secure:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-0.20S:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-0.23:jar:0.13.1a from the shaded jar.
[INFO] Excluding com.jolbox:bonecp:jar:0.8.0.RELEASE from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.4 from the shaded jar.
[INFO] Excluding commons-logging:commons-logging:jar:1.1.3 from the shaded jar.
[INFO] Excluding org.apache.derby:derby:jar:10.10.1.1 from the shaded jar.
[INFO] Excluding org.datanucleus:datanucleus-api-jdo:jar:3.2.6 from the shaded jar.
[INFO] Excluding org.datanucleus:datanucleus-core:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.datanucleus:datanucleus-rdbms:jar:3.2.9 from the shaded jar.
[INFO] Excluding javax.jdo:jdo-api:jar:3.0.1 from the shaded jar.
[INFO] Excluding javax.transaction:jta:jar:1.1 from the shaded jar.
[INFO] Excluding org.antlr:antlr-runtime:jar:3.4 from the shaded jar.
[INFO] Excluding org.antlr:stringtemplate:jar:3.2.1 from the shaded jar.
[INFO] Excluding antlr:antlr:jar:2.7.7 from the shaded jar.
[INFO] Excluding org.apache.thrift:libfb303:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.thrift:libthrift:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-exec:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-ant:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.apache.velocity:velocity:jar:1.5 from the shaded jar.
[INFO] Excluding oro:oro:jar:2.0.8 from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-common:jar:0.13.1a from the shaded jar.
[INFO] Excluding com.twitter:parquet-hadoop-bundle:jar:1.3.2 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding javolution:javolution:jar:5.5.1 from the shaded jar.
[INFO] Excluding org.antlr:ST4:jar:4.0.4 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-mapred:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.apache.ant:ant:jar:1.9.1 from the shaded jar.
[INFO] Excluding org.apache.ant:ant-launcher:jar:1.9.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.2 from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding com.googlecode.javaewah:JavaEWAH:jar:0.3.2 from the shaded jar.
[INFO] Excluding org.iq80.snappy:snappy:jar:0.2 from the shaded jar.
[INFO] Excluding org.json:json:jar:20090211 from the shaded jar.
[INFO] Excluding stax:stax-api:jar:1.0.1 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-serde:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.3 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-mapred:jar:hadoop2:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-ipc:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-ipc:jar:tests:1.7.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-hive_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-hive_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/hive/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/hive/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/hive/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-hive_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-hive_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-hive_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/sql/hive/scalastyle-output.xml
Processed 20 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 759 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project REPL 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-repl_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/repl/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-repl_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-repl_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/repl/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/repl/scala-2.10/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-repl_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-repl_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/repl/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-repl_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 13 Scala sources to /home/jifeng/hadoop/spark-1.2.0/repl/target/scala-2.10/classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-repl_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-repl_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/repl/src/test/scala added.
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/repl/scala-2.10/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-repl_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-repl_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 2 Scala sources to /home/jifeng/hadoop/spark-1.2.0/repl/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-repl_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-repl_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/repl/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-repl_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-repl_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-repl_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-repl_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/repl/target/spark-repl_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-repl_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-repl_2.10 ---
[INFO] Excluding org.scala-lang:jline:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.fusesource.jansi:jansi:jar:1.4 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-bagel_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-mllib_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-streaming_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.jblas:jblas:jar:1.2.3 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze_2.10:jar:0.10 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze-macros_2.10:jar:0.3.1 from the shaded jar.
[INFO] Excluding com.github.fommil.netlib:core:jar:1.1.2 from the shaded jar.
[INFO] Excluding net.sourceforge.f2j:arpack_combined_all:jar:0.1 from the shaded jar.
[INFO] Excluding net.sf.opencsv:opencsv:jar:2.3 from the shaded jar.
[INFO] Excluding com.github.rwl:jtransforms:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.spire-math:spire_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.spire-math:spire-macros_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.11 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.0 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/repl/target/spark-repl_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/repl/target/spark-repl_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/repl/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/repl/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-repl_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/repl/target/spark-repl_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-repl_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/repl/scalastyle-output.xml
Processed 1 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 49 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project YARN Parent POM 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ yarn-parent_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/yarn/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ yarn-parent_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ yarn-parent_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/common/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ yarn-parent_2.10 ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ yarn-parent_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ yarn-parent_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/src/test/scala added.
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/common/src/test/scala added.
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ yarn-parent_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ yarn-parent_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/yarn/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ yarn-parent_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ yarn-parent_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ yarn-parent_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ yarn-parent_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding com.google.inject.extensions:guice-servlet:jar:3.0 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding com.google.inject:guice:jar:3.0 from the shaded jar.
[INFO] Excluding javax.inject:javax.inject:jar:1 from the shaded jar.
[INFO] Excluding aopalliance:aopalliance:jar:1.0 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-server:jar:1.9 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-json:jar:1.9 from the shaded jar.
[INFO] Excluding org.codehaus.jettison:jettison:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-jaxrs:jar:1.8.3 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-xc:jar:1.8.3 from the shaded jar.
[INFO] Excluding com.sun.jersey.contribs:jersey-guice:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ yarn-parent_2.10 ---
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ yarn-parent_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/yarn/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/yarn/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 11 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project YARN Stable API 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-yarn_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-yarn_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-yarn_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/common/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-yarn_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-yarn_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/yarn/common/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-yarn_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 17 Scala sources to /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/scala-2.10/classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-yarn_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-yarn_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/src/test/scala added.
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/common/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-yarn_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-yarn_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 5 Scala sources to /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-yarn_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-yarn_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-yarn_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-yarn_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-yarn_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-yarn_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-yarn_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-yarn_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-yarn_2.10 ---
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.codehaus.jettison:jettison:jar:1.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding com.google.inject.extensions:guice-servlet:jar:3.0 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding com.google.inject:guice:jar:3.0 from the shaded jar.
[INFO] Excluding javax.inject:javax.inject:jar:1 from the shaded jar.
[INFO] Excluding aopalliance:aopalliance:jar:1.0 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-server:jar:1.9 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-json:jar:1.9 from the shaded jar.
[INFO] Excluding com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-jaxrs:jar:1.8.3 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-xc:jar:1.8.3 from the shaded jar.
[INFO] Excluding com.sun.jersey.contribs:jersey-guice:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-yarn_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-yarn_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-yarn_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-yarn_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-yarn_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/yarn/stable/scalastyle-output.xml
Processed 4 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 37 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Assembly 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-assembly_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/assembly/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-assembly_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-assembly_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/assembly/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-assembly_2.10 ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-assembly_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-assembly_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/assembly/src/test/scala added.
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-assembly_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-assembly_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/assembly/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-assembly_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-assembly_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-assembly_2.10 ---
[INFO] Including com.google.guava:guava:jar:14.0.1 in the shaded jar.
[INFO] Including org.apache.spark:spark-core_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including com.twitter:chill_2.10:jar:0.5.0 in the shaded jar.
[INFO] Including com.esotericsoftware.kryo:kryo:jar:2.21 in the shaded jar.
[INFO] Including com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 in the shaded jar.
[INFO] Including com.esotericsoftware.minlog:minlog:jar:1.2 in the shaded jar.
[INFO] Including org.objenesis:objenesis:jar:1.2 in the shaded jar.
[INFO] Including com.twitter:chill-java:jar:0.5.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-client:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-common:jar:2.4.1 in the shaded jar.
[INFO] Including xmlenc:xmlenc:jar:0.52 in the shaded jar.
[INFO] Including commons-collections:commons-collections:jar:3.2.1 in the shaded jar.
[INFO] Including commons-configuration:commons-configuration:jar:1.6 in the shaded jar.
[INFO] Including commons-digester:commons-digester:jar:1.8 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils:jar:1.7.0 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils-core:jar:1.8.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-auth:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-hdfs:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-annotations:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.spark:spark-network-common_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including net.java.dev.jets3t:jets3t:jar:0.9.0 in the shaded jar.
[INFO] Including commons-codec:commons-codec:jar:1.5 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpclient:jar:4.1.2 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpcore:jar:4.1.2 in the shaded jar.
[INFO] Including com.jamesmurty.utils:java-xmlbuilder:jar:0.4 in the shaded jar.
[INFO] Including org.apache.curator:curator-recipes:jar:2.4.0 in the shaded jar.
[INFO] Including org.apache.curator:curator-framework:jar:2.4.0 in the shaded jar.
[INFO] Including org.apache.curator:curator-client:jar:2.4.0 in the shaded jar.
[INFO] Including org.apache.zookeeper:zookeeper:jar:3.4.5 in the shaded jar.
[INFO] Including jline:jline:jar:0.9.94 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.apache.commons:commons-lang3:jar:3.3.2 in the shaded jar.
[INFO] Including org.apache.commons:commons-math3:jar:3.1.1 in the shaded jar.
[INFO] Including com.google.code.findbugs:jsr305:jar:1.3.9 in the shaded jar.
[INFO] Including org.slf4j:slf4j-api:jar:1.7.5 in the shaded jar.
[INFO] Including org.slf4j:jul-to-slf4j:jar:1.7.5 in the shaded jar.
[INFO] Including org.slf4j:jcl-over-slf4j:jar:1.7.5 in the shaded jar.
[INFO] Including log4j:log4j:jar:1.2.17 in the shaded jar.
[INFO] Including org.slf4j:slf4j-log4j12:jar:1.7.5 in the shaded jar.
[INFO] Including com.ning:compress-lzf:jar:1.0.0 in the shaded jar.
[INFO] Including org.xerial.snappy:snappy-java:jar:1.1.1.6 in the shaded jar.
[INFO] Including net.jpountz.lz4:lz4:jar:1.2.0 in the shaded jar.
[INFO] Including org.roaringbitmap:RoaringBitmap:jar:0.4.5 in the shaded jar.
[INFO] Including commons-net:commons-net:jar:2.2 in the shaded jar.
[INFO] Including org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including com.typesafe:config:jar:1.2.1 in the shaded jar.
[INFO] Including io.netty:netty:jar:3.8.0.Final in the shaded jar.
[INFO] Including org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark in the shaded jar.
[INFO] Including org.uncommons.maths:uncommons-maths:jar:1.2.2a in the shaded jar.
[INFO] Including org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including org.scala-lang:scala-library:jar:2.10.4 in the shaded jar.
[INFO] Including org.json4s:json4s-jackson_2.10:jar:3.2.10 in the shaded jar.
[INFO] Including org.json4s:json4s-core_2.10:jar:3.2.10 in the shaded jar.
[INFO] Including org.json4s:json4s-ast_2.10:jar:3.2.10 in the shaded jar.
[INFO] Including org.scala-lang:scalap:jar:2.10.4 in the shaded jar.
[INFO] Including org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 in the shaded jar.
[INFO] Including io.netty:netty-all:jar:4.0.23.Final in the shaded jar.
[INFO] Including com.clearspring.analytics:stream:jar:2.7.0 in the shaded jar.
[INFO] Including com.codahale.metrics:metrics-core:jar:3.0.0 in the shaded jar.
[INFO] Including com.codahale.metrics:metrics-jvm:jar:3.0.0 in the shaded jar.
[INFO] Including com.codahale.metrics:metrics-json:jar:3.0.0 in the shaded jar.
[INFO] Including com.codahale.metrics:metrics-graphite:jar:3.0.0 in the shaded jar.
[INFO] Including org.tachyonproject:tachyon-client:jar:0.5.0 in the shaded jar.
[INFO] Including org.tachyonproject:tachyon:jar:0.5.0 in the shaded jar.
[INFO] Including org.spark-project:pyrolite:jar:2.0.1 in the shaded jar.
[INFO] Including net.sf.py4j:py4j:jar:0.8.2.1 in the shaded jar.
[INFO] Including org.apache.spark:spark-bagel_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-mllib_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.jblas:jblas:jar:1.2.3 in the shaded jar.
[INFO] Including org.scalanlp:breeze_2.10:jar:0.10 in the shaded jar.
[INFO] Including org.scalanlp:breeze-macros_2.10:jar:0.3.1 in the shaded jar.
[INFO] Including com.github.fommil.netlib:core:jar:1.1.2 in the shaded jar.
[INFO] Including net.sourceforge.f2j:arpack_combined_all:jar:0.1 in the shaded jar.
[INFO] Including net.sf.opencsv:opencsv:jar:2.3 in the shaded jar.
[INFO] Including com.github.rwl:jtransforms:jar:2.4.0 in the shaded jar.
[INFO] Including org.spire-math:spire_2.10:jar:0.7.4 in the shaded jar.
[INFO] Including org.spire-math:spire-macros_2.10:jar:0.7.4 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-graphx_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-sql_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-catalyst_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.scalamacros:quasiquotes_2.10:jar:2.0.1 in the shaded jar.
[INFO] Including com.twitter:parquet-column:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-common:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-encoding:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-generator:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-hadoop:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-format:jar:2.2.0-rc1 in the shaded jar.
[INFO] Including com.twitter:parquet-jackson:jar:1.6.0rc3 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 in the shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 in the shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-core:jar:2.3.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-repl_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.scala-lang:jline:jar:2.10.4 in the shaded jar.
[INFO] Including org.fusesource.jansi:jansi:jar:1.4 in the shaded jar.
[INFO] Including org.scala-lang:scala-compiler:jar:2.10.4 in the shaded jar.
[INFO] Including org.scala-lang:scala-reflect:jar:2.10.4 in the shaded jar.
[INFO] Including org.apache.spark:spark-yarn_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 in the shaded jar.
[INFO] Including commons-lang:commons-lang:jar:2.6 in the shaded jar.
[INFO] Including com.google.protobuf:protobuf-java:jar:2.5.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 in the shaded jar.
[INFO] Including javax.xml.bind:jaxb-api:jar:2.2.2 in the shaded jar.
[INFO] Including javax.xml.stream:stax-api:jar:1.0-2 in the shaded jar.
[INFO] Including javax.activation:activation:jar:1.1 in the shaded jar.
[INFO] Including org.apache.commons:commons-compress:jar:1.4.1 in the shaded jar.
[INFO] Including org.tukaani:xz:jar:1.0 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-core:jar:1.9 in the shaded jar.
[INFO] Including commons-cli:commons-cli:jar:1.2 in the shaded jar.
[INFO] Including com.google.inject.extensions:guice-servlet:jar:3.0 in the shaded jar.
[INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar.
[INFO] Including com.google.inject:guice:jar:3.0 in the shaded jar.
[INFO] Including javax.inject:javax.inject:jar:1 in the shaded jar.
[INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-server:jar:1.9 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-json:jar:1.9 in the shaded jar.
[INFO] Including org.codehaus.jettison:jettison:jar:1.1 in the shaded jar.
[INFO] Including com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-jaxrs:jar:1.8.3 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-xc:jar:1.8.3 in the shaded jar.
[INFO] Including com.sun.jersey.contribs:jersey-guice:jar:1.9 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty:jar:6.1.26 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty-util:jar:6.1.26 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-client:jar:1.9 in the shaded jar.
[INFO] Including org.apache.spark:spark-hive_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.spark-project.hive:hive-metastore:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive:hive-shims:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-common:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-0.20:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-common-secure:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-0.20S:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-0.23:jar:0.13.1a in the shaded jar.
[INFO] Including com.jolbox:bonecp:jar:0.8.0.RELEASE in the shaded jar.
[INFO] Including commons-logging:commons-logging:jar:1.1.3 in the shaded jar.
[INFO] Including org.apache.derby:derby:jar:10.10.1.1 in the shaded jar.
[INFO] Including org.datanucleus:datanucleus-api-jdo:jar:3.2.6 in the shaded jar.
[INFO] Including org.datanucleus:datanucleus-core:jar:3.2.10 in the shaded jar.
[INFO] Including org.datanucleus:datanucleus-rdbms:jar:3.2.9 in the shaded jar.
[INFO] Including javax.jdo:jdo-api:jar:3.0.1 in the shaded jar.
[INFO] Including javax.transaction:jta:jar:1.1 in the shaded jar.
[INFO] Including org.antlr:antlr-runtime:jar:3.4 in the shaded jar.
[INFO] Including org.antlr:stringtemplate:jar:3.2.1 in the shaded jar.
[INFO] Including antlr:antlr:jar:2.7.7 in the shaded jar.
[INFO] Including org.apache.thrift:libfb303:jar:0.9.0 in the shaded jar.
[INFO] Including org.apache.thrift:libthrift:jar:0.9.0 in the shaded jar.
[INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar.
[INFO] Including org.spark-project.hive:hive-exec:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive:hive-ant:jar:0.13.1a in the shaded jar.
[INFO] Including org.apache.velocity:velocity:jar:1.5 in the shaded jar.
[INFO] Including oro:oro:jar:2.0.8 in the shaded jar.
[INFO] Including org.spark-project.hive:hive-common:jar:0.13.1a in the shaded jar.
[INFO] Including com.twitter:parquet-hadoop-bundle:jar:1.3.2 in the shaded jar.
[INFO] Including javolution:javolution:jar:5.5.1 in the shaded jar.
[INFO] Including org.antlr:ST4:jar:4.0.4 in the shaded jar.
[INFO] Including org.apache.avro:avro-mapred:jar:1.7.5 in the shaded jar.
[INFO] Including org.apache.ant:ant:jar:1.9.1 in the shaded jar.
[INFO] Including org.apache.ant:ant-launcher:jar:1.9.1 in the shaded jar.
[INFO] Including com.googlecode.javaewah:JavaEWAH:jar:0.3.2 in the shaded jar.
[INFO] Including org.iq80.snappy:snappy:jar:0.2 in the shaded jar.
[INFO] Including org.json:json:jar:20090211 in the shaded jar.
[INFO] Including stax:stax-api:jar:1.0.1 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the shaded jar.
[INFO] Including org.spark-project.hive:hive-serde:jar:0.13.1a in the shaded jar.
[INFO] Including org.apache.avro:avro:jar:1.7.6 in the shaded jar.
[INFO] Including com.thoughtworks.paranamer:paranamer:jar:2.3 in the shaded jar.
[INFO] Including org.apache.avro:avro-mapred:jar:hadoop2:1.7.6 in the shaded jar.
[INFO] Including org.apache.avro:avro-ipc:jar:1.7.6 in the shaded jar.
[INFO] Including org.apache.avro:avro-ipc:jar:tests:1.7.6 in the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[WARNING] commons-logging-1.1.3.jar, jcl-over-slf4j-1.7.5.jar define 6 overlappping classes:
[WARNING] - org.apache.commons.logging.impl.NoOpLog
[WARNING] - org.apache.commons.logging.impl.SimpleLog
[WARNING] - org.apache.commons.logging.LogFactory
[WARNING] - org.apache.commons.logging.LogConfigurationException
[WARNING] - org.apache.commons.logging.impl.SimpleLog$1
[WARNING] - org.apache.commons.logging.Log
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-column-1.6.0rc3.jar define 543 overlappping classes:
[WARNING] - parquet.io.PrimitiveColumnIO
[WARNING] - parquet.it.unimi.dsi.fastutil.longs.Long2IntSortedMap
[WARNING] - parquet.it.unimi.dsi.fastutil.longs.LongIterators$IntIteratorWrapper
[WARNING] - parquet.column.values.ValuesReader
[WARNING] - parquet.column.impl.ColumnReaderImpl$1
[WARNING] - parquet.column.ParquetProperties$WriterVersion
[WARNING] - parquet.schema.PrimitiveType$PrimitiveTypeName
[WARNING] - parquet.it.unimi.dsi.fastutil.longs.LongIterators$UnmodifiableListIterator
[WARNING] - parquet.it.unimi.dsi.fastutil.longs.LongIterator
[WARNING] - parquet.it.unimi.dsi.fastutil.doubles.AbstractDoubleList
[WARNING] - 533 more...
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-common-1.6.0rc3.jar define 7 overlappping classes:
[WARNING] - parquet.Ints
[WARNING] - parquet.ParquetRuntimeException
[WARNING] - parquet.Log$1
[WARNING] - parquet.Log
[WARNING] - parquet.bytes.BytesUtils
[WARNING] - parquet.Version
[WARNING] - parquet.Preconditions
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar, commons-collections-3.2.1.jar define 10 overlappping classes:
[WARNING] - org.apache.commons.collections.FastHashMap$EntrySet
[WARNING] - org.apache.commons.collections.ArrayStack
[WARNING] - org.apache.commons.collections.FastHashMap$1
[WARNING] - org.apache.commons.collections.FastHashMap$KeySet
[WARNING] - org.apache.commons.collections.FastHashMap$CollectionView
[WARNING] - org.apache.commons.collections.BufferUnderflowException
[WARNING] - org.apache.commons.collections.Buffer
[WARNING] - org.apache.commons.collections.FastHashMap$CollectionView$CollectionViewIterator
[WARNING] - org.apache.commons.collections.FastHashMap$Values
[WARNING] - org.apache.commons.collections.FastHashMap
[WARNING] kryo-2.21.jar, reflectasm-1.07-shaded.jar define 23 overlappping classes:
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Opcodes
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Frame
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Label
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.FieldWriter
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.AnnotationVisitor
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.FieldVisitor
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Item
[WARNING] - com.esotericsoftware.reflectasm.AccessClassLoader
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Edge
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.ClassVisitor
[WARNING] - 13 more...
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar define 82 overlappping classes:
[WARNING] - org.apache.commons.beanutils.WrapDynaBean
[WARNING] - org.apache.commons.beanutils.Converter
[WARNING] - org.apache.commons.beanutils.converters.IntegerConverter
[WARNING] - org.apache.commons.beanutils.locale.LocaleBeanUtilsBean
[WARNING] - org.apache.commons.beanutils.locale.converters.DecimalLocaleConverter
[WARNING] - org.apache.commons.beanutils.locale.converters.DoubleLocaleConverter
[WARNING] - org.apache.commons.beanutils.converters.ShortConverter
[WARNING] - org.apache.commons.beanutils.converters.StringArrayConverter
[WARNING] - org.apache.commons.beanutils.locale.LocaleConvertUtilsBean
[WARNING] - org.apache.commons.beanutils.LazyDynaClass
[WARNING] - 72 more...
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-jackson-1.6.0rc3.jar define 623 overlappping classes:
[WARNING] - parquet.org.codehaus.jackson.map.deser.impl.PropertyValue$Map
[WARNING] - parquet.org.codehaus.jackson.map.BeanPropertyDefinition
[WARNING] - parquet.org.codehaus.jackson.util.DefaultPrettyPrinter$Lf2SpacesIndenter
[WARNING] - parquet.org.codehaus.jackson.map.jsontype.impl.StdSubtypeResolver
[WARNING] - parquet.org.codehaus.jackson.map.ser.FilteredBeanPropertyWriter$MultiView
[WARNING] - parquet.org.codehaus.jackson.map.deser.std.PrimitiveArrayDeserializers$Base
[WARNING] - parquet.org.codehaus.jackson.map.ser.std.StdContainerSerializers
[WARNING] - parquet.org.codehaus.jackson.map.SerializationConfig$Feature
[WARNING] - parquet.org.codehaus.jackson.map.deser.impl.ValueInjector
[WARNING] - parquet.org.codehaus.jackson.map.deser.std.ThrowableDeserializer
[WARNING] - 613 more...
[WARNING] avro-mapred-1.7.6-hadoop2.jar, avro-mapred-1.7.5.jar define 121 overlappping classes:
[WARNING] - org.apache.avro.mapreduce.AvroKeyRecordReader
[WARNING] - org.apache.avro.mapred.AvroJob
[WARNING] - org.apache.avro.mapred.SequenceFileReader$5
[WARNING] - org.apache.avro.hadoop.io.AvroKeyValue$Iterator
[WARNING] - org.apache.avro.mapred.tether.TaskType
[WARNING] - org.apache.avro.hadoop.io.AvroSequenceFile
[WARNING] - org.apache.avro.mapreduce.AvroKeyValueInputFormat
[WARNING] - org.apache.avro.mapred.tether.TetherData
[WARNING] - org.apache.avro.mapred.tether.TetherInputFormat
[WARNING] - org.apache.avro.hadoop.util.AvroCharSequenceComparator
[WARNING] - 111 more...
[WARNING] javax.activation-1.1.0.v201105071233.jar, activation-1.1.jar define 17 overlappping classes:
[WARNING] - javax.activation.MimeType
[WARNING] - javax.activation.FileTypeMap
[WARNING] - javax.activation.FileDataSource
[WARNING] - javax.activation.DataContentHandler
[WARNING] - javax.activation.CommandObject
[WARNING] - javax.activation.MimetypesFileTypeMap
[WARNING] - javax.activation.CommandMap
[WARNING] - javax.activation.DataSource
[WARNING] - javax.activation.DataHandler
[WARNING] - javax.activation.MimeTypeParameterList
[WARNING] - 7 more...
[WARNING] stax-api-1.0-2.jar, stax-api-1.0.1.jar define 37 overlappping classes:
[WARNING] - javax.xml.stream.XMLOutputFactory
[WARNING] - javax.xml.stream.events.StartElement
[WARNING] - javax.xml.stream.events.Namespace
[WARNING] - javax.xml.stream.util.EventReaderDelegate
[WARNING] - javax.xml.stream.XMLInputFactory
[WARNING] - javax.xml.stream.events.Characters
[WARNING] - javax.xml.stream.XMLStreamReader
[WARNING] - javax.xml.stream.events.EntityReference
[WARNING] - javax.xml.stream.events.NotationDeclaration
[WARNING] - javax.xml.stream.XMLStreamWriter
[WARNING] - 27 more...
[WARNING] hadoop-yarn-api-2.4.1.jar, hadoop-yarn-common-2.4.1.jar define 3 overlappping classes:
[WARNING] - org.apache.hadoop.yarn.factories.package-info
[WARNING] - org.apache.hadoop.yarn.util.package-info
[WARNING] - org.apache.hadoop.yarn.factory.providers.package-info
[WARNING] parquet-format-2.2.0-rc1.jar, parquet-hadoop-bundle-1.3.2.jar define 197 overlappping classes:
[WARNING] - parquet.org.apache.thrift.protocol.TCompactProtocol$Types
[WARNING] - parquet.format.Encoding
[WARNING] - parquet.org.apache.thrift.TSerializer
[WARNING] - parquet.org.apache.thrift.protocol.TJSONProtocol
[WARNING] - parquet.format.ColumnChunk$_Fields
[WARNING] - parquet.format.ColumnMetaData$1
[WARNING] - parquet.org.apache.thrift.transport.TSeekableFile
[WARNING] - parquet.org.apache.thrift.TServiceClientFactory
[WARNING] - parquet.org.apache.thrift.transport.THttpClient
[WARNING] - parquet.org.apache.thrift.protocol.TProtocolUtil
[WARNING] - 187 more...
[WARNING] parquet-encoding-1.6.0rc3.jar, parquet-hadoop-bundle-1.3.2.jar define 183 overlappping classes:
[WARNING] - parquet.column.values.bitpacking.ByteBitPackingBE$Packer21
[WARNING] - parquet.column.values.bitpacking.OneBitPackingReader
[WARNING] - parquet.column.values.bitpacking.ByteBitPackingLE$Packer16
[WARNING] - parquet.column.values.bitpacking.OneBitPackingWriter
[WARNING] - parquet.column.values.bitpacking.ByteBitPackingLE$Packer29
[WARNING] - parquet.column.values.bitpacking.LemireBitPackingLE$Packer15
[WARNING] - parquet.column.values.bitpacking.BitPacking
[WARNING] - parquet.column.values.bitpacking.Packer
[WARNING] - parquet.column.values.bitpacking.LemireBitPackingLE$Packer23
[WARNING] - parquet.column.values.bitpacking.LemireBitPackingLE$Packer3
[WARNING] - 173 more...
[WARNING] jansi-1.4.jar, jline-2.10.4.jar define 23 overlappping classes:
[WARNING] - org.fusesource.jansi.Ansi$Erase
[WARNING] - org.fusesource.jansi.Ansi
[WARNING] - org.fusesource.jansi.AnsiOutputStream
[WARNING] - org.fusesource.jansi.internal.CLibrary
[WARNING] - org.fusesource.jansi.Ansi$2
[WARNING] - org.fusesource.jansi.WindowsAnsiOutputStream
[WARNING] - org.fusesource.jansi.AnsiRenderer$Code
[WARNING] - org.fusesource.jansi.AnsiConsole
[WARNING] - org.fusesource.jansi.Ansi$Attribute
[WARNING] - org.fusesource.jansi.Ansi$Color
[WARNING] - 13 more...
[WARNING] minlog-1.2.jar, kryo-2.21.jar define 2 overlappping classes:
[WARNING] - com.esotericsoftware.minlog.Log$Logger
[WARNING] - com.esotericsoftware.minlog.Log
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-hadoop-1.6.0rc3.jar define 90 overlappping classes:
[WARNING] - parquet.hadoop.codec.CodecConfig
[WARNING] - parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
[WARNING] - parquet.hadoop.example.GroupReadSupport
[WARNING] - parquet.hadoop.codec.CompressionCodecNotSupportedException
[WARNING] - parquet.hadoop.InternalParquetRecordWriter
[WARNING] - parquet.hadoop.metadata.FileMetaData
[WARNING] - parquet.hadoop.ParquetFileReader$Chunk
[WARNING] - parquet.hadoop.example.ExampleOutputFormat
[WARNING] - parquet.hadoop.ParquetInputFormat$1
[WARNING] - parquet.hadoop.ParquetFileWriter$STATE$2
[WARNING] - 80 more...
[WARNING] kryo-2.21.jar, objenesis-1.2.jar define 32 overlappping classes:
[WARNING] - org.objenesis.Objenesis
[WARNING] - org.objenesis.strategy.StdInstantiatorStrategy
[WARNING] - org.objenesis.instantiator.basic.ObjectStreamClassInstantiator
[WARNING] - org.objenesis.instantiator.sun.SunReflectionFactorySerializationInstantiator
[WARNING] - org.objenesis.instantiator.perc.PercSerializationInstantiator
[WARNING] - org.objenesis.instantiator.NullInstantiator
[WARNING] - org.objenesis.instantiator.jrockit.JRockitLegacyInstantiator
[WARNING] - org.objenesis.instantiator.gcj.GCJInstantiatorBase
[WARNING] - org.objenesis.ObjenesisException
[WARNING] - org.objenesis.instantiator.basic.ObjectInputStreamInstantiator$MockStream
[WARNING] - 22 more...
[WARNING] guava-14.0.1.jar, spark-core_2.10-1.2.0.jar define 5 overlappping classes:
[WARNING] - com.google.common.base.Optional$1$1
[WARNING] - com.google.common.base.Optional
[WARNING] - com.google.common.base.Optional$1
[WARNING] - com.google.common.base.Absent
[WARNING] - com.google.common.base.Present
[WARNING] jta-1.1.jar, javax.transaction-1.1.1.v201105210645.jar define 18 overlappping classes:
[WARNING] - javax.transaction.RollbackException
[WARNING] - javax.transaction.HeuristicMixedException
[WARNING] - javax.transaction.InvalidTransactionException
[WARNING] - javax.transaction.Synchronization
[WARNING] - javax.transaction.xa.XAException
[WARNING] - javax.transaction.HeuristicRollbackException
[WARNING] - javax.transaction.HeuristicCommitException
[WARNING] - javax.transaction.xa.XAResource
[WARNING] - javax.transaction.TransactionSynchronizationRegistry
[WARNING] - javax.transaction.TransactionRolledbackException
[WARNING] - 8 more...
[WARNING] spark-streaming_2.10-1.2.0.jar, spark-yarn_2.10-1.2.0.jar, spark-network-shuffle_2.10-1.2.0.jar, spark-graphx_2.10-1.2.0.jar, spark-mllib_2.10-1.2.0.jar, spark-hive_2.10-1.2.0.jar, unused-1.0.0.jar, spark-catalyst_2.10-1.2.0.jar, spark-sql_2.10-1.2.0.jar, spark-network-common_2.10-1.2.0.jar, spark-bagel_2.10-1.2.0.jar, spark-repl_2.10-1.2.0.jar define 1 overlappping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-generator-1.6.0rc3.jar define 3 overlappping classes:
[WARNING] - parquet.encoding.bitpacking.ByteBasedBitPackingGenerator
[WARNING] - parquet.encoding.Generator
[WARNING] - parquet.encoding.bitpacking.IntBasedBitPackingGenerator
[WARNING] maven-shade-plugin has detected that some .class files
[WARNING] are present in two or more JARs. When this happens, only
[WARNING] one single version of the class is copied in the uberjar.
[WARNING] Usually this is not harmful and you can skeep these
[WARNING] warnings, otherwise try to manually exclude artifacts
[WARNING] based on mvn dependency:tree -Ddetail=true and the above
[WARNING] output
[WARNING] See http://docs.codehaus.org/display/MAVENUSER/Shade+Plugin
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-assembly_2.10 ---
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-assembly_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/assembly/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/assembly/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 8 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Twitter 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-twitter_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/twitter/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-twitter_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-twitter_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/twitter/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-twitter_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-twitter_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/twitter/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-twitter_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-twitter_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-twitter_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/twitter/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-twitter_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-twitter_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-twitter_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-twitter_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-twitter_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-twitter_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-twitter_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-twitter_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-streaming-twitter_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-twitter_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-twitter_2.10 ---
[INFO] Excluding org.twitter4j:twitter4j-stream:jar:3.0.3 from the shaded jar.
[INFO] Excluding org.twitter4j:twitter4j-core:jar:3.0.3 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-streaming-twitter_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-streaming-twitter_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/twitter/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/twitter/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/twitter/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/twitter/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-twitter_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-streaming-twitter_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-twitter_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/twitter/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 51 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Flume Sink 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-flume-sink_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-flume-sink_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-flume-sink_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/src/main/scala added.
[INFO]
[INFO] --- avro-maven-plugin:1.7.6:idl-protocol (default) @ spark-streaming-flume-sink_2.10 ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-flume-sink_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-flume-sink_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-flume-sink_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 5 Scala sources and 3 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/scala-2.10/classes...
[WARNING] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub.
[WARNING] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub.
[WARNING] Class org.jboss.netty.channel.ChannelPipelineFactory not found - continuing with a stub.
[WARNING] Class org.jboss.netty.handler.execution.ExecutionHandler not found - continuing with a stub.
[WARNING] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub.
[WARNING] Class org.jboss.netty.handler.execution.ExecutionHandler not found - continuing with a stub.
[WARNING] Class org.jboss.netty.channel.group.ChannelGroup not found - continuing with a stub.
[WARNING] 7 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: 某些输入文件使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-flume-sink_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 3 source files to /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-flume-sink_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-flume-sink_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-flume-sink_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source to /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-flume-sink_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-flume-sink_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-flume-sink_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-flume-sink_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-flume-sink_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-flume-sink_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-streaming-flume-sink_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-flume-sink_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-flume-sink_2.10 ---
[INFO] Excluding org.apache.flume:flume-ng-sdk:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.3 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-ipc:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-core:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-configuration:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.1 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.5 from the shaded jar.
[INFO] Excluding joda-time:joda-time:jar:2.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:servlet-api:jar:2.5-20110124 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding com.google.code.gson:gson:jar:2.2.2 from the shaded jar.
[INFO] Excluding org.apache.mina:mina-core:jar:2.0.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-streaming-flume-sink_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-streaming-flume-sink_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-flume-sink_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-streaming-flume-sink_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-flume-sink_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/flume-sink/scalastyle-output.xml
Processed 5 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 73 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Flume 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-flume_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/flume/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-flume_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-flume_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/flume/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-flume_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-flume_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/flume/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-flume_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 6 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/flume/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-flume_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/flume/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-flume_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/flume/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-flume_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-flume_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources and 3 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/flume/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-flume_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 3 source files to /home/jifeng/hadoop/spark-1.2.0/external/flume/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-flume_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-flume_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-flume_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-flume_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-flume_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-streaming-flume_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-flume_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-flume_2.10 ---
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-streaming-flume-sink_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-core:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-configuration:jar:1.4.0 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.1 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.5 from the shaded jar.
[INFO] Excluding joda-time:joda-time:jar:2.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:servlet-api:jar:2.5-20110124 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding com.google.code.gson:gson:jar:2.2.2 from the shaded jar.
[INFO] Excluding org.apache.mina:mina-core:jar:2.0.4 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-sdk:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.3 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-ipc:jar:1.7.6 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-streaming-flume_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-streaming-flume_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/flume/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/flume/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-flume_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-streaming-flume_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-flume_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/flume/scalastyle-output.xml
Processed 6 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 75 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External MQTT 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-mqtt_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-mqtt_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-mqtt_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-mqtt_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-mqtt_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/mqtt/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-mqtt_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-mqtt_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-mqtt_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-mqtt_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-mqtt_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-mqtt_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-mqtt_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-mqtt_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-mqtt_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-mqtt_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-mqtt_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-streaming-mqtt_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-mqtt_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-mqtt_2.10 ---
[INFO] Excluding org.eclipse.paho:mqtt-client:jar:0.4.0 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-streaming-mqtt_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-streaming-mqtt_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-mqtt_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-streaming-mqtt_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-mqtt_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/mqtt/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 36 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External ZeroMQ 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-zeromq_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-zeromq_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-zeromq_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-zeromq_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-zeromq_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/zeromq/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-zeromq_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-zeromq_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-zeromq_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-zeromq_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-zeromq_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-zeromq_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-zeromq_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-zeromq_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-zeromq_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-zeromq_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-zeromq_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-streaming-zeromq_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-zeromq_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-zeromq_2.10 ---
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-zeromq_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.spark-project.zeromq:zeromq-scala-binding_2.10:jar:0.0.7-spark from the shaded jar.
[INFO] Excluding net.java.dev.jna:jna:jar:3.0.9 from the shaded jar.
[INFO] Excluding com.github.jnr:jnr-constants:jar:0.8.2 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-streaming-zeromq_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-streaming-zeromq_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-zeromq_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-streaming-zeromq_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-zeromq_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/zeromq/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 17 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Kafka 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-kafka_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/kafka/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-kafka_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-kafka_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/kafka/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-kafka_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-kafka_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/kafka/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-kafka_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 4 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-kafka_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-kafka_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/kafka/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-kafka_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-kafka_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 2 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-kafka_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-kafka_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-kafka_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-kafka_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-kafka_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-kafka_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-streaming-kafka_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-kafka_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-kafka_2.10 ---
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.kafka:kafka_2.10:jar:0.8.0 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.101tec:zkclient:jar:0.3 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding com.yammer.metrics:metrics-core:jar:2.2.0 from the shaded jar.
[INFO] Excluding com.yammer.metrics:metrics-annotation:jar:2.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-streaming-kafka_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-streaming-kafka_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/kafka/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/kafka/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-kafka_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-streaming-kafka_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-kafka_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/kafka/scalastyle-output.xml
Processed 4 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 36 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Examples 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-examples_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/examples/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-examples_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-examples_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/examples/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/examples/scala-2.10/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/examples/scala-2.10/src/main/java added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-examples_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-examples_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 7 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-examples_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 77 Scala sources and 23 Java sources to /home/jifeng/hadoop/spark-1.2.0/examples/target/scala-2.10/classes...
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] /home/jifeng/hadoop/spark-1.2.0/examples/src/main/scala/org/apache/spark/examples/CassandraCQLTest.scala:85: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/examples/src/main/scala/org/apache/spark/examples/CassandraTest.scala:62: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/examples/src/main/scala/org/apache/spark/examples/HBaseTest.scala:39: constructor HTableDescriptor in class HTableDescriptor is deprecated: see corresponding Javadoc for more information.
[WARNING] val tableDesc = new HTableDescriptor(args(0))
[WARNING] ^
[WARNING] 66 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: 某些输入文件使用或覆盖了已过时的 API。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-examples_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 23 source files to /home/jifeng/hadoop/spark-1.2.0/examples/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-examples_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/examples/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-examples_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/examples/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-examples_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-examples_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-examples_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/examples/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-examples_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-examples_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-examples_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/examples/target/spark-examples_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-examples_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-examples_2.10 ---
[INFO] Including com.google.guava:guava:jar:14.0.1 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpclient:jar:4.1.2 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpcore:jar:4.1.2 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.slf4j:slf4j-api:jar:1.7.5 in the shaded jar.
[INFO] Including log4j:log4j:jar:1.2.17 in the shaded jar.
[INFO] Including org.slf4j:slf4j-log4j12:jar:1.7.5 in the shaded jar.
[INFO] Including org.xerial.snappy:snappy-java:jar:1.1.1.6 in the shaded jar.
[INFO] Including net.jpountz.lz4:lz4:jar:1.2.0 in the shaded jar.
[INFO] Including commons-net:commons-net:jar:2.2 in the shaded jar.
[INFO] Including org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including com.typesafe:config:jar:1.2.1 in the shaded jar.
[INFO] Including org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark in the shaded jar.
[INFO] Including org.scala-lang:scala-library:jar:2.10.4 in the shaded jar.
[INFO] Including org.antlr:antlr-runtime:jar:3.4 in the shaded jar.
[INFO] Including org.antlr:stringtemplate:jar:3.2.1 in the shaded jar.
[INFO] Including antlr:antlr:jar:2.7.7 in the shaded jar.
[INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar.
[INFO] Including org.apache.commons:commons-compress:jar:1.4.1 in the shaded jar.
[INFO] Including org.tukaani:xz:jar:1.0 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the shaded jar.
[INFO] Including org.apache.avro:avro:jar:1.7.6 in the shaded jar.
[INFO] Including com.thoughtworks.paranamer:paranamer:jar:2.3 in the shaded jar.
[INFO] Including org.apache.avro:avro-ipc:jar:1.7.6 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-twitter_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.twitter4j:twitter4j-stream:jar:3.0.3 in the shaded jar.
[INFO] Including org.twitter4j:twitter4j-core:jar:3.0.3 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-flume_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-flume-sink_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.flume:flume-ng-core:jar:1.4.0 in the shaded jar.
[INFO] Including org.apache.flume:flume-ng-configuration:jar:1.4.0 in the shaded jar.
[INFO] Including joda-time:joda-time:jar:2.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:servlet-api:jar:2.5-20110124 in the shaded jar.
[INFO] Including com.google.code.gson:gson:jar:2.2.2 in the shaded jar.
[INFO] Including org.apache.flume:flume-ng-sdk:jar:1.4.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-mqtt_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.eclipse.paho:mqtt-client:jar:0.4.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-zeromq_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.spark-project.akka:akka-zeromq_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including org.spark-project.zeromq:zeromq-scala-binding_2.10:jar:0.0.7-spark in the shaded jar.
[INFO] Including net.java.dev.jna:jna:jar:3.0.9 in the shaded jar.
[INFO] Including com.github.jnr:jnr-constants:jar:0.8.2 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-testing-util:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-common:test-jar:tests:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-server:test-jar:tests:0.98.7-hadoop1 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-core:jar:1.8 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-json:jar:1.8 in the shaded jar.
[INFO] Including org.codehaus.jettison:jettison:jar:1.1 in the shaded jar.
[INFO] Including com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-xc:jar:1.7.1 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-server:jar:1.8 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-hadoop1-compat:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-hadoop1-compat:test-jar:tests:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-core:jar:1.2.1 in the shaded jar.
[INFO] Including xmlenc:xmlenc:jar:0.52 in the shaded jar.
[INFO] Including commons-configuration:commons-configuration:jar:1.6 in the shaded jar.
[INFO] Including commons-digester:commons-digester:jar:1.8 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils:jar:1.7.0 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils-core:jar:1.8.0 in the shaded jar.
[INFO] Including commons-el:commons-el:jar:1.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-test:jar:1.2.1 in the shaded jar.
[INFO] Including org.apache.ftpserver:ftplet-api:jar:1.0.0 in the shaded jar.
[INFO] Including org.apache.mina:mina-core:jar:2.0.0-M5 in the shaded jar.
[INFO] Including org.apache.ftpserver:ftpserver-core:jar:1.0.0 in the shaded jar.
[INFO] Including org.apache.ftpserver:ftpserver-deprecated:jar:1.0.0-M2 in the shaded jar.
[INFO] Including com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-protocol:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including com.google.protobuf:protobuf-java:jar:2.5.0 in the shaded jar.
[INFO] Including commons-logging:commons-logging:jar:1.1.1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-common:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including commons-codec:commons-codec:jar:1.5 in the shaded jar.
[INFO] Including commons-lang:commons-lang:jar:2.6 in the shaded jar.
[INFO] Including commons-collections:commons-collections:jar:3.2.1 in the shaded jar.
[INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-client:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.zookeeper:zookeeper:jar:3.4.6 in the shaded jar.
[INFO] Including org.cloudera.htrace:htrace-core:jar:2.04 in the shaded jar.
[INFO] Including org.jruby.joni:joni:jar:2.1.2 in the shaded jar.
[INFO] Including org.jruby.jcodings:jcodings:jar:1.0.8 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-server:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-prefix-tree:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including com.yammer.metrics:metrics-core:jar:2.2.0 in the shaded jar.
[INFO] Including commons-cli:commons-cli:jar:1.2 in the shaded jar.
[INFO] Including com.github.stephenc.high-scale-lib:high-scale-lib:jar:1.1.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty:jar:6.1.26 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty-util:jar:6.1.26 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty-sslengine:jar:6.1.26 in the shaded jar.
[INFO] Including org.mortbay.jetty:jsp-2.1:jar:6.1.14 in the shaded jar.
[INFO] Including org.mortbay.jetty:jsp-api-2.1:jar:6.1.14 in the shaded jar.
[INFO] Including org.mortbay.jetty:servlet-api-2.5:jar:6.1.14 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.8.8 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-jaxrs:jar:1.8.8 in the shaded jar.
[INFO] Including tomcat:jasper-compiler:jar:5.5.23 in the shaded jar.
[INFO] Including tomcat:jasper-runtime:jar:5.5.23 in the shaded jar.
[INFO] Including org.jamon:jamon-runtime:jar:2.3.1 in the shaded jar.
[INFO] Including javax.xml.bind:jaxb-api:jar:2.2.2 in the shaded jar.
[INFO] Including javax.activation:activation:jar:1.1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-hadoop-compat:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.commons:commons-math:jar:2.1 in the shaded jar.
[INFO] Including org.apache.commons:commons-math3:jar:3.1.1 in the shaded jar.
[INFO] Including com.twitter:algebird-core_2.10:jar:0.8.1 in the shaded jar.
[INFO] Including com.googlecode.javaewah:JavaEWAH:jar:0.6.6 in the shaded jar.
[INFO] Including org.scala-lang:scala-reflect:jar:2.10.4 in the shaded jar.
[INFO] Including org.apache.cassandra:cassandra-all:jar:1.2.6 in the shaded jar.
[INFO] Including org.antlr:antlr:jar:3.2 in the shaded jar.
[INFO] Including com.googlecode.json-simple:json-simple:jar:1.1 in the shaded jar.
[INFO] Including org.yaml:snakeyaml:jar:1.6 in the shaded jar.
[INFO] Including edu.stanford.ppl:snaptree:jar:0.1 in the shaded jar.
[INFO] Including org.mindrot:jbcrypt:jar:0.3m in the shaded jar.
[INFO] Including org.apache.thrift:libthrift:jar:0.7.0 in the shaded jar.
[INFO] Including javax.servlet:servlet-api:jar:2.5 in the shaded jar.
[INFO] Including org.apache.cassandra:cassandra-thrift:jar:1.2.6 in the shaded jar.
[INFO] Including com.github.stephenc:jamm:jar:0.2.5 in the shaded jar.
[INFO] Including com.github.scopt:scopt_2.10:jar:3.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-kafka_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.kafka:kafka_2.10:jar:0.8.0 in the shaded jar.
[INFO] Including org.scala-lang:scala-compiler:jar:2.10.4 in the shaded jar.
[INFO] Including com.101tec:zkclient:jar:0.3 in the shaded jar.
[INFO] Including com.yammer.metrics:metrics-annotation:jar:2.2.0 in the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[WARNING] spark-streaming-flume_2.10-1.2.0.jar, spark-streaming-flume-sink_2.10-1.2.0.jar, spark-streaming-zeromq_2.10-1.2.0.jar, spark-streaming-kafka_2.10-1.2.0.jar, spark-streaming-twitter_2.10-1.2.0.jar, unused-1.0.0.jar, spark-streaming-mqtt_2.10-1.2.0.jar define 1 overlappping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar, commons-collections-3.2.1.jar define 10 overlappping classes:
[WARNING] - org.apache.commons.collections.FastHashMap$EntrySet
[WARNING] - org.apache.commons.collections.ArrayStack
[WARNING] - org.apache.commons.collections.FastHashMap$1
[WARNING] - org.apache.commons.collections.FastHashMap$KeySet
[WARNING] - org.apache.commons.collections.FastHashMap$CollectionView
[WARNING] - org.apache.commons.collections.BufferUnderflowException
[WARNING] - org.apache.commons.collections.Buffer
[WARNING] - org.apache.commons.collections.FastHashMap$CollectionView$CollectionViewIterator
[WARNING] - org.apache.commons.collections.FastHashMap$Values
[WARNING] - org.apache.commons.collections.FastHashMap
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar define 82 overlappping classes:
[WARNING] - org.apache.commons.beanutils.Converter
[WARNING] - org.apache.commons.beanutils.WrapDynaBean
[WARNING] - org.apache.commons.beanutils.converters.IntegerConverter
[WARNING] - org.apache.commons.beanutils.locale.LocaleBeanUtilsBean
[WARNING] - org.apache.commons.beanutils.locale.converters.DoubleLocaleConverter
[WARNING] - org.apache.commons.beanutils.locale.converters.DecimalLocaleConverter
[WARNING] - org.apache.commons.beanutils.converters.ShortConverter
[WARNING] - org.apache.commons.beanutils.converters.StringArrayConverter
[WARNING] - org.apache.commons.beanutils.locale.LocaleConvertUtilsBean
[WARNING] - org.apache.commons.beanutils.LazyDynaClass
[WARNING] - 72 more...
[WARNING] jasper-compiler-5.5.23.jar, jasper-runtime-5.5.23.jar, jsp-2.1-6.1.14.jar define 1 overlappping classes:
[WARNING] - org.apache.jasper.compiler.Localizer
[WARNING] jasper-compiler-5.5.23.jar, jsp-2.1-6.1.14.jar define 143 overlappping classes:
[WARNING] - org.apache.jasper.compiler.TagLibraryInfoImpl
[WARNING] - org.apache.jasper.xmlparser.SymbolTable
[WARNING] - org.apache.jasper.compiler.Generator$FragmentHelperClass$Fragment
[WARNING] - org.apache.jasper.compiler.Generator$1TagHandlerPoolVisitor
[WARNING] - org.apache.jasper.compiler.ScriptingVariabler
[WARNING] - org.apache.jasper.compiler.SmapStratum$LineInfo
[WARNING] - org.apache.jasper.compiler.Node$AttributeGenerator
[WARNING] - org.apache.jasper.compiler.Node
[WARNING] - org.apache.jasper.compiler.Node$JspAttribute
[WARNING] - org.apache.jasper.compiler.tagplugin.TagPlugin
[WARNING] - 133 more...
[WARNING] cassandra-all-1.2.6.jar, cassandra-thrift-1.2.6.jar define 2 overlappping classes:
[WARNING] - org.apache.cassandra.thrift.ITransportFactory
[WARNING] - org.apache.cassandra.thrift.TFramedTransportFactory
[WARNING] jasper-runtime-5.5.23.jar, jsp-2.1-6.1.14.jar define 43 overlappping classes:
[WARNING] - org.apache.jasper.runtime.ProtectedFunctionMapper$2
[WARNING] - org.apache.jasper.runtime.PageContextImpl$3
[WARNING] - org.apache.jasper.runtime.JspFactoryImpl$PrivilegedGetPageContext
[WARNING] - org.apache.jasper.runtime.PageContextImpl$4
[WARNING] - org.apache.jasper.runtime.JspFactoryImpl
[WARNING] - org.apache.jasper.runtime.ProtectedFunctionMapper$1
[WARNING] - org.apache.jasper.JasperException
[WARNING] - org.apache.jasper.runtime.PerThreadTagHandlerPool$PerThreadData
[WARNING] - org.apache.jasper.util.FastDateFormat
[WARNING] - org.apache.jasper.runtime.PageContextImpl$8
[WARNING] - 33 more...
[WARNING] servlet-api-2.5-20110124.jar, servlet-api-2.5.jar, javax.servlet-3.0.0.v201112011016.jar, servlet-api-2.5-6.1.14.jar define 42 overlappping classes:
[WARNING] - javax.servlet.ServletRequestWrapper
[WARNING] - javax.servlet.FilterChain
[WARNING] - javax.servlet.SingleThreadModel
[WARNING] - javax.servlet.http.HttpServletResponse
[WARNING] - javax.servlet.http.HttpUtils
[WARNING] - javax.servlet.ServletContextAttributeEvent
[WARNING] - javax.servlet.ServletContextAttributeListener
[WARNING] - javax.servlet.http.HttpServlet
[WARNING] - javax.servlet.http.HttpSessionAttributeListener
[WARNING] - javax.servlet.http.HttpServletRequest
[WARNING] - 32 more...
[WARNING] maven-shade-plugin has detected that some .class files
[WARNING] are present in two or more JARs. When this happens, only
[WARNING] one single version of the class is copied in the uberjar.
[WARNING] Usually this is not harmful and you can skeep these
[WARNING] warnings, otherwise try to manually exclude artifacts
[WARNING] based on mvn dependency:tree -Ddetail=true and the above
[WARNING] output
[WARNING] See http://docs.codehaus.org/display/MAVENUSER/Shade+Plugin
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-examples_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/examples/target/spark-examples_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-examples_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/examples/scalastyle-output.xml
Processed 76 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 470 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project YARN Shuffle Service 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-yarn_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/yarn/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-yarn_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-yarn_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/yarn/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-yarn_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-yarn_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/yarn/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-yarn_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/yarn/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-yarn_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/network/yarn/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-yarn_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/yarn/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-yarn_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/yarn/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-yarn_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-yarn_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-yarn_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/yarn/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-yarn_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-yarn_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-network-yarn_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/yarn/target/spark-network-yarn_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-yarn_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-yarn_2.10 ---
[INFO] Including org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-network-common_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including io.netty:netty-all:jar:4.0.23.Final in the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[WARNING] unused-1.0.0.jar, spark-network-common_2.10-1.2.0.jar, spark-network-shuffle_2.10-1.2.0.jar define 1 overlappping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass
[WARNING] maven-shade-plugin has detected that some .class files
[WARNING] are present in two or more JARs. When this happens, only
[WARNING] one single version of the class is copied in the uberjar.
[WARNING] Usually this is not harmful and you can skeep these
[WARNING] warnings, otherwise try to manually exclude artifacts
[WARNING] based on mvn dependency:tree -Ddetail=true and the above
[WARNING] output
[WARNING] See http://docs.codehaus.org/display/MAVENUSER/Shade+Plugin
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-yarn_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/yarn/target/spark-network-yarn_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-yarn_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/yarn/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/yarn/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 9 ms
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [ 9.124 s]
[INFO] Spark Project Networking .......................... SUCCESS [ 11.218 s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [ 8.029 s]
[INFO] Spark Project Core ................................ SUCCESS [05:54 min]
[INFO] Spark Project Bagel ............................... SUCCESS [ 39.515 s]
[INFO] Spark Project GraphX .............................. SUCCESS [01:56 min]
[INFO] Spark Project Streaming ........................... SUCCESS [02:36 min]
[INFO] Spark Project Catalyst ............................ SUCCESS [02:46 min]
[INFO] Spark Project SQL ................................. SUCCESS [03:01 min]
[INFO] Spark Project ML Library .......................... SUCCESS [03:18 min]
[INFO] Spark Project Tools ............................... SUCCESS [ 22.244 s]
[INFO] Spark Project Hive ................................ SUCCESS [02:30 min]
[INFO] Spark Project REPL ................................ SUCCESS [01:12 min]
[INFO] Spark Project YARN Parent POM ..................... SUCCESS [ 2.751 s]
[INFO] Spark Project YARN Stable API ..................... SUCCESS [01:14 min]
[INFO] Spark Project Assembly ............................ SUCCESS [ 57.801 s]
[INFO] Spark Project External Twitter .................... SUCCESS [ 25.289 s]
[INFO] Spark Project External Flume Sink ................. SUCCESS [ 32.711 s]
[INFO] Spark Project External Flume ...................... SUCCESS [ 47.628 s]
[INFO] Spark Project External MQTT ....................... SUCCESS [ 24.121 s]
[INFO] Spark Project External ZeroMQ ..................... SUCCESS [ 28.154 s]
[INFO] Spark Project External Kafka ...................... SUCCESS [ 43.508 s]
[INFO] Spark Project Examples ............................ SUCCESS [01:49 min]
[INFO] Spark Project YARN Shuffle Service ................ SUCCESS [ 4.315 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 32:19 min
[INFO] Finished at: 2015-02-10T11:49:07+08:00
[INFO] Final Memory: 92M/591M
[INFO] ------------------------------------------------------------------------
[jifeng@feng02 spark-1.2.0]$ ls
assembly data examples make-distribution.sh python scalastyle-output.xml tox.ini
bagel dev external mllib README.md spark-1.2.0-bin-2.4.1.tgz yarn
bin dist extras network repl sql
conf docker graphx NOTICE sbin streaming
CONTRIBUTING.md docs lib_managed pom.xml sbt target
core ec2 LICENSE project scalastyle-config.xml tools
扫一扫
660
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
