![](https://img-blog.csdnimg.cn/20201014180756919.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
spark
lemonlhy
这个作者很懒,什么都没留下…
展开
-
用scala实现Spark的RDD接口
import org.apache.spark.SparkConfimport org.apache.spark.SparkContextimport org.apache.spark.rdd.RDDobject Spark { final val conf:SparkConf=new SparkConf().setAppName("Spark").setMaster("local")...原创 2018-04-24 08:49:50 · 676 阅读 · 0 评论 -
SparkStreaming的单词计数案例
import org.apache.spark.streaming.dstream.ReceiverInputDStreamimport org.apache.spark.streaming.{Seconds, StreamingContext}import org.apache.spark.{SparkConf, SparkContext}/** * 需要用到nc -lk 9999 ...原创 2018-05-11 20:36:58 · 620 阅读 · 0 评论 -
利用Spark把数据写进mysql数据库时候遇到的问题
写入数据库的方式是:df2.write.mode(SaveMode.Append).jdbc(url,"student",properties)impossible to write to binary log since BINLOG_FORMAT = STATEMENT这是因为,mysql默认的binlog_format是STATEMENT。从 MySQL 5.1.12 开始,可以用以下三种模...原创 2018-05-15 14:54:09 · 1543 阅读 · 0 评论