spark
文章平均质量分 80
luyee2010
这个作者很懒,什么都没留下…
展开
-
Spark1.1.0 Actions
Actions The following table lists some of the common actions supported by Spark. Refer to the RDD API doc (Scala, Java, Python) and pair RDD functions doc (Scala, Java) for details. Ac原创 2014-09-21 01:50:55 · 2399 阅读 · 0 评论 -
Spark1.1.0 Transformations
Transformations The following table lists some of the common transformations supported by Spark. Refer to the RDD API doc (Scala, Java, Python) and pair RDD functions doc (Scala, Java) for deta原创 2014-09-21 01:51:35 · 3959 阅读 · 0 评论 -
Spark1.1.0 Spark Programming Guide
Spark Programming Guide OverviewLinking with SparkInitializing Spark Using the Shell Resilient Distributed Datasets (RDDs) Parallelized CollectionsExternal DatasetsRDD Operations BasicsPa原创 2014-09-15 12:47:08 · 5231 阅读 · 0 评论 -
Spark1.1.0 Quick Start (link)
Quick Start Interactive Analysis with the Spark Shell BasicsMore on RDD OperationsCaching Standalone ApplicationsWhere to Go from Here This tutorial provides a quick introduction to using Sp原创 2014-09-15 12:45:43 · 2874 阅读 · 0 评论 -
Spark1.1.0 Spark Streaming Programming Guide
Spark Streaming Programming Guide OverviewA Quick ExampleBasic Concepts LinkingInitializing StreamingContextDiscretized Streams (DStreams)Input DStreamsTransformations on DStreamsOutput Operatio原创 2014-09-15 12:50:18 · 7398 阅读 · 0 评论 -
Spark1.1.0 Spark SQL Programming Guide
Spark SQL Programming Guide OverviewGetting StartedData Sources RDDs Inferring the Schema Using ReflectionProgrammatically Specifying the Schema Parquet Files Loading Data Programmaticall原创 2014-09-15 12:51:43 · 7134 阅读 · 0 评论 -
spark yarn /bin/bash: /bin/java: is a directory
mac Os 10.12 +hadoop2.7.2+spark1.6.1 ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster --driver-memory 4g --executor-memory 2g原创 2017-06-22 03:42:00 · 1881 阅读 · 0 评论 -
spark1.6+elasticsearch5.x 底层jar冲突
spark1.6.3 elasticsearch 5.4 bulk api ``` (Netty4Utils:117)-NoSuchMethodError io.netty.buffer.CompositeByteBuf.addComponents(ZLjava/lang/Iterable;)Lio/netty/buffer/CompositeByteBuf; at o原创 2017-07-10 00:06:26 · 3324 阅读 · 7 评论 -
NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer
spark 1.6 scala2.10 替换jackson相关的包依赖 com.fasterxml.jackson.module jackson-module-scala_2.10 2.7.4 com.fasterxml.jackson.modu原创 2017-08-08 13:44:42 · 5163 阅读 · 1 评论