![](https://img-blog.csdnimg.cn/20201014180756930.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
Spark
yd、夜
这个作者很懒,什么都没留下…
展开
-
状态流累加
object Socket_Streaming_State extends App {val sc: SparkContext = SparkContext.getOrCreate(new SparkConf().setMaster(“local[*]”).setAppName(“hdfs”).set(“spark.executor memory”,“4g”))val ssc = new StreamingContext(sc,Seconds(2))//必须要设置检查点ssc.checkpoint(原创 2021-01-06 22:24:18 · 201 阅读 · 0 评论 -
spark连接redis
/**实际上是java连接redis,返回结果转为spark的rdd/object spark_redis {def main(args: Array[String]): Unit = {val sc = SparkContext.getOrCreate(new SparkConf().setAppName(“redis”).setMaster("local[]"))val jedis = new Jedis(“192.168.56.100”)val dd = jedis.lrange(“x原创 2020-11-18 22:55:39 · 590 阅读 · 0 评论 -
Saprk Standalone伪分布式安装详解(附脚本)
111原创 2020-07-29 19:26:42 · 1026 阅读 · 0 评论