flume学习笔记

于 2021-03-26 23:14:51 发布
阅读量120 收藏
点赞数
分类专栏： 大数据学习之路
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/TigRer/article/details/115257284
版权

1.flume向hdfs传输数据

上传apache-flume-1.9.0-bin.tar.gz到hadoop102 /opt/software下

tar -zxvf apache-flume-1.9.0-bin.tar.gz -C /opt/module
cd /opt/module/
mv apache-flume-1.9.0 flume-1.9.0

启动hdfs
hdp.sh start

# 执行脚本，模拟日志生产
# 在/opt/module/datas目录下创建a.log
while true; do echo $RANDOM >> a.log; sleep 0.01; done
1.1配置flume的 taildir-m-hdfs.conf
a1.sources = r1
a1.sinks = k1
a1.channels = c1

a1.sources.r1.channels = c1
a1.sources.r1.type = TAILDIR
a1.sources.r1.filegroups = g1
a1.sources.r1.filegroups.g1 = /opt/module/datas/a.*
a1.sources.r1.headers.g1.x = y
a1.sources.r1.fileHeader = true
a1.sources.r1.fileHeaderKey = filepath
a1.sources.r1.interceptors = i1
a1.sources.r1.interceptors.i1.type = timestamp
a1.sources.r1.interceptors.i1.headerName = timestamp

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 1000


a1.sinks.k1.channel = c1
a1.sinks.k1.type = hdfs
a1.sinks.k1.hdfs.path = hdfs://hadoop102:8020/flumedata/%Y-%m-%d/%H
a1.sinks.k1.hdfs.filePrefix = mylog-
a1.sinks.k1.hdfs.fileSuffix = .log
a1.sinks.k1.hdfs.rollSize = 268435456
a1.sinks.k1.hdfs.rollInterval = 120
a1.sinks.k1.hdfs.rollCount = 0
a1.sinks.k1.hdfs.batchSize = 1000
a1.sinks.k1.hdfs.fileType = CompressedStream
a1.sinks.k1.hdfs.codeC = snappy
a1.sinks.k1.hdfs.useLocalTimeStamp = false
2.启动flume-agent
[xx@hadoop102 flume-1.9.0]$ bin/flume-ng agent -c ./conf -f ./agentconf/taildir-m-hdfs.conf -n a1 -Dflume.root.logger=DEBUG,console

在这里插入图片描述

成功！

2.flume级联案例

在这里插入图片描述

2.1.hadoop102上flume配置taildir-f-avrosink.conf
# 第一级的agent配置，第一级的所有节点配置都相同
a1.sources = r1
a1.sinks = k1
a1.channels = c1

a1.sources.r1.channels = c1
a1.sources.r1.type = TAILDIR
a1.sources.r1.filegroups = g1
a1.sources.r1.filegroups.g1 = /opt/module/datas/a.*
a1.sources.r1.fileHeader = false


a1.channels.c1.type = file


a1.sinks.k1.channel = c1
a1.sinks.k1.type = avro
a1.sinks.k1.hostname = hadoop103
a1.sinks.k1.port = 4444
2.2.hadoop103flume上配置avro-f-kfksink.conf
# 第二级的agent配置 
a1.sources = r1
a1.sinks = k1
a1.channels = c1


a1.sources.r1.channels = c1
a1.sources.r1.type = avro
a1.sources.r1.bind = hadoop103
a1.sources.r1.port = 4444
a1.sources.r1.batchSize = 100


a1.channels.c1.type = file


a1.sinks.k1.channel = c1
a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSink
a1.sinks.k1.kafka.bootstrap.servers = hadoop102:9092,hadoop103:9092,hadoop104:9092
a1.sinks.k1.kafka.topic = doitedu17
a1.sinks.k1.kafka.producer.acks = 1
2.3. 模拟生产日志

hadoop102 /opt/module/datas目录

while true; do echo $RANDOM >> a.log; sleep 0.01; done
2.4.启动zookeeper, kafka （zk和kafka配置）
[xx@hadoop102 ~]$ zk.sh start
JMX enabled by default
Using config: /opt/module/zookeeper-3.4.6/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
JMX enabled by default
Using config: /opt/module/zookeeper-3.4.6/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
JMX enabled by default
Using config: /opt/module/zookeeper-3.4.6/bin/../conf/zoo.cfg
Starting zookeeper ... kSTARTED
[xx@hadoop102 ~]$ kafka.sh start
 --------启动 hadoop102 Kafka-------
 --------启动 hadoop103 Kafka-------
 --------启动 hadoop104 Kafka-------
[xx@hadoop102 ~]$ xcall.sh  jps
=======hadoop102=======
2130 Kafka
2233 Jps
1803 QuorumPeerMain
=======hadoop103=======
1776 QuorumPeerMain
2199 Jps
2105 Kafka
=======hadoop104=======
1771 QuorumPeerMain
2189 Jps
2094 Kafka

kafka基本命令操作

## topic查看
bin/kafka-topics.sh --list --zookeeper doitedu01:2181

## topic创建
bin/kafka-topics.sh --create --topic topic2 --partitions 2 --replication-factor 2 --zookeeper doitedu01:2181

## 启动一个控制台生产者来生产数据
bin/kafka-console-producer.sh --broker-list doitedu01:9092,doitedu02:9092,doitedu03:9092 --topic topic2
>hello tom

## 启动一个控制台消费者来消费数据
bin/kafka-console-consumer.sh --bootstrap-server doitedu01:9092,doitedu02:9092,doitedu03:9092 --topic topic2 --from-beginning
2.5.级联采集的实践操作步骤
1.启动级联flume系统的第2级 hadoop103
[xx@hadoop103 flume-1.9.0]$ bin/flume-ng agent -c conf/ -f agengConf/avro-f-kfksink.conf  -n a1 -Dflume.root.logger=DEBUG,console
2.启动级联flume系统的第1级
[xx@hadoop102 flume-1.9.0]$ bin/flume-ng agent -c conf/ -f agentConf/taildir-f-avrosink.conf -n a1 -Dflume.root.logger=DEBUG,console
3.检查数据是否传输到了kafka，启动一个消费者来消费
[atguigu@hadoop104 kafka]$ bin/kafka-console-consumer.sh   --bootstrap-server hadoop102:9092 --topic doitedu17
26088
1901
15413
32216
18167
11155
2907
22079
1172
16349
7927
2059

成功！

3.channel选择器-自定义拦截器-项目分流需求

在这里插入图片描述

0.编写一个拦截器
package com.zh.flume;

import org.apache.flume.Context;
import org.apache.flume.Event;
import org.apache.flume.interceptor.Interceptor;

import java.util.List;

public class MultiplexingInterceptor implements Interceptor {
    private Integer flagfield = 0;
    private Integer timestampfield = 0;

    public MultiplexingInterceptor(Integer flagfield,Integer timestampfield) {
        this.flagfield = flagfield;
        this.timestampfield = timestampfield;
    }

    /**
     * 拦截器构造实例后的初始化工作
     */
    public void initialize() {

    }

    // 日志格式:
    // u01,ev1,mall,1568738583468
    public Event intercept(Event event) {
        // 根据event的数据内容，以及参数中指定的标记字段，来产生不同的header值
        byte[] body = event.getBody();
        String line = new String(body);

        String[] split = line.split(",");

        // 切出业务标记,并添加到header
        event.getHeaders().put("flag",split[flagfield]);

        // 切出行为（事件）时间戳,并添加到header
        event.getHeaders().put("timestamp",split[timestampfield]);


        return event;
    }

    public List<Event> intercept(List<Event> list) {
        for (Event event : list) {
            intercept(event);
        }
        return list;
    }


    /**
     * 拦截器销毁之前的一些清理工作
     */
    public void close() {

    }


    public static class MultiplexingInterceptorBuilder implements Interceptor.Builder{

        Integer flagfield = 0;
        Integer timestampfield = 0;
        /**
         * 用户构建一个拦截器实例
         * @return
         */
        public Interceptor build() {

            return new MultiplexingInterceptor(flagfield,timestampfield);
        }

        /**
         * 获取参数的入口
         * @param context
         */
        public void configure(Context context) {
            flagfield = context.getInteger("flagfield");
            timestampfield = context.getInteger("timestampfield");

        }
    }
}

打包上传到flume的lib目录

1.-- 模拟日志生成的脚本：
while true
do
if [ $(($RANDOM % 2)) -eq 0 ]
then
echo "u$RANDOM,e1,waimai,`date +%s`000" >> a.log
else
echo "u$RANDOM,e1,mall,`date +%s`000" >> a.log
fi
sleep 0.2
done
2.flume的agent配置：2个channel，1个选择器，1个自定义拦截器
[xx@hadoop102 flume-1.9.0]$ vim agentConf/multiplexing.conf

a1.sources = r1
a1.channels = c1 c2
a1.sinks = k1 k2

a1.sources.r1.channels = c1 c2
a1.sources.r1.type = TAILDIR
a1.sources.r1.filegroups = g1
a1.sources.r1.filegroups.g1 = /opt/module/datas/a.*
a1.sources.r1.fileHeader = false

a1.sources.r1.interceptors = i1
a1.sources.r1.interceptors.i1.type = com.zh.flume.MultiplexingInterceptor$MultiplexingInterceptorBuilder
a1.sources.r1.interceptors.i1.flagfield = 2
a1.sources.r1.interceptors.i1.timestampfield = 3

a1.sources.r1.interceptors = i1
a1.sources.r1.interceptors.i1.type = com.zh.flume.MultiplexingInterceptor$MultiplexingInterceptorBuilder
a1.sources.r1.interceptors.i1.flagfield = 2
a1.sources.r1.interceptors.i1.timestampfield = 3

a1.sources.r1.selector.type = multiplexing
a1.sources.r1.selector.header = flag
a1.sources.r1.selector.mapping.mall = c1
a1.sources.r1.selector.mapping.waimai = c2
a1.sources.r1.selector.default = c2


a1.channels.c1.type = memory
a1.channels.c1.capacity = 2000
a1.channels.c1.transactionCapacity = 1000

a1.channels.c2.type = memory
a1.channels.c2.capacity = 2000
a1.channels.c2.transactionCapacity = 1000


a1.sinks.k1.channel = c1
a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSink
a1.sinks.k1.kafka.bootstrap.servers = hadoop102:9092,hadoop103:9092,hadoop104:9092
a1.sinks.k1.kafka.topic = mall
a1.sinks.k1.kafka.producer.acks = 1

a1.sinks.k2.channel = c2
a1.sinks.k2.type = hdfs
a1.sinks.k2.hdfs.path = hdfs://hadoop102:8020/waimai/%Y-%m-%d/%H
a1.sinks.k2.hdfs.filePrefix = doitedu-log-
a1.sinks.k2.hdfs.fileSuffix = .log
a1.sinks.k2.hdfs.rollSize = 268435456
a1.sinks.k2.hdfs.rollInterval = 120
a1.sinks.k2.hdfs.rollCount = 0
a1.sinks.k2.hdfs.batchSize = 1000
a1.sinks.k2.hdfs.fileType = DataStream
a1.sinks.k2.hdfs.useLocalTimeStamp = false
4.启动hdfs,zookeeper,kafka
hdp.sh start
zk.sh start
kafka.sh start

[xx@hadoop102 ~]$ xcall.sh  jps
=======hadoop102=======
2000 NameNode
3093 Kafka
2139 DataNode
3196 Jps
2477 NodeManager
2765 QuorumPeerMain
2655 JobHistoryServer
=======hadoop103=======
2545 QuorumPeerMain
2023 ResourceManager
2874 Kafka
2970 Jps
1836 DataNode
2156 NodeManager
=======hadoop104=======
2528 Kafka
2625 Jps
2037 NodeManager
1830 DataNode
1946 SecondaryNameNode
2205 QuorumPeerMain

脚本文件：

hdp.sh

#!/bin/bash
if [ $# -lt 1 ]
then
    echo "No Args Input..."
    exit ;
fi
case $1 in
"start"){
        echo " =================== 启动 hadoop集群 ==================="

        echo " --------------- 启动 hdfs ---------------"
        ssh hadoop102 "/opt/module/hadoop-3.1.3/sbin/start-dfs.sh"
        echo " --------------- 启动 yarn ---------------"
        ssh hadoop103 "/opt/module/hadoop-3.1.3/sbin/start-yarn.sh"
        echo " --------------- 启动 historyserver ---------------"
        ssh hadoop102 "/opt/module/hadoop-3.1.3/bin/mapred --daemon start historyserver"
};;
"stop"){
        echo " =================== 关闭 hadoop集群 ==================="

        echo " --------------- 关闭 yarn ---------------"
        ssh hadoop103 "/opt/module/hadoop-3.1.3/sbin/stop-yarn.sh"
        echo " --------------- 关闭 hdfs ---------------"
        ssh hadoop102 "/opt/module/hadoop-3.1.3/sbin/stop-dfs.sh"
        echo " --------------- 关闭 historyserver ---------------"
        ssh hadoop102 "/opt/module/hadoop-3.1.3/bin/mapred --daemon stop historyserver"
};;
*){
    echo "Input Args Error..."
};;
esac

zk.sh:

#!/bin/bash
case $1 in
"start") {
        for i in hadoop102 hadoop103 hadoop104
        do
                ssh $i "source /etc/profile; /opt/module/zookeeper-3.4.6/bin/zkServer.sh start"
        done
};;
"stop") {
        for i in hadoop102 hadoop103 hadoop104
        do
                ssh $i "source /etc/profile; /opt/module/zookeeper-3.4.6/bin/zkServer.sh stop"
        done
};;
"status") {
        for i in hadoop102 hadoop103 hadoop104
        do
                ssh $i "source /etc/profile; /opt/module/zookeeper-3.4.6/bin/zkServer.sh status"
        done
};;
esac

kafka.sh:

#! /bin/bash
case $1 in
"start"){
        for i in hadoop102 hadoop103 hadoop104
        do
                echo " --------启动 $i Kafka-------"
                ssh $i "source /etc/profile; /opt/module/kafka/bin/kafka-server-start.sh -daemon /opt/module/kafka/config/server.properties "
        done
};;
"stop"){
        for i in hadoop102 hadoop103 hadoop104
        do
                echo " --------停止 $i Kafka-------"
                ssh $i "source /etc/profile; /opt/module/kafka/bin/kafka-server-stop.sh stop"
        done
};;
esac
5.启动flume agent
[xx@hadoop102 flume-1.9.0]$ bin/flume-ng agent -c conf/ -f agentConf/multiplexing.conf -n a1 -Dflume.root.logger=DEBUG,console
6.测试查看kafka和hdfs数据
[xx@hadoop103 kafka]$ bin/kafka-console-consumer.sh --bootstrap-server hadoop102:9092,hadoop103:9092,hadoop104:9092 --topic mall2
u27323,e1,mall,1616769650000
u27407,e1,mall,1616769650000
u31325,e1,mall,1616769651000
u5017,e1,mall,1616769651000
u4703,e1,mall,1616769651000
u26035,e1,mall,1616769651000
u2202,e1,mall,1616769652000
u16182,e1,mall,1616769652000
u30472,e1,mall,1616769653000
u15990,e1,mall,1616769653000
u32291,e1,mall,1616769654000
u1236,e1,mall,1616769654000
u17401,e1,mall,1616769654000
u22316,e1,mall,1616769654000

在这里插入图片描述

[atguigu@hadoop103 kafka]$ hdfs dfs -tail hdfs://hadoop102:8020/waimai/2021-03-26/22/doitedu-log-.1616769585211.log

u27887,e1,waimai,1616769691000
u4557,e1,waimai,1616769692000
u3,e1,waimai,1616769692000
u932,e1,waimai,1616769692000
u2070,e1,waimai,1616769692000
u17029,e1,waimai,1616769693000
u15891,e1,waimai,1616769693000
u17386,e1,waimai,1616769693000
u28482,e1,waimai,1616769693000
u19256,e1,waimai,1616769695000
u3694,e1,waimai,1616769695000
u22488,e1,waimai,1616769696000
u12503,e1,waimai,1616769696000
u963,e1,waimai,1616769696000
u20473,e1,waimai,1616769696000
u15916,e1,waimai,1616769697000
u15052,e1,waimai,1616769697000
u8609,e1,waimai,1616769697000
u14148,e1,waimai,1616769697000
u24441,e1,waimai,1616769698000

成功！

4.级联汇聚点HA高可用

在这里插入图片描述

级联高可用配置第一级(hadoop102)failover.conf
a1.sources = r1
a1.sinks = k1 k2
a1.channels = c1

a1.sources.r1.channels = c1
a1.sources.r1.type = TAILDIR
a1.sources.r1.filegroups = g1
a1.sources.r1.filegroups.g1 = /opt/module/datas/a.*
a1.sources.r1.fileHeader = false


a1.channels.c1.type = memory
a1.channels.c1.capacity = 2000
a1.channels.c1.transactionCapacity = 1000


a1.sinks.k1.channel = c1
a1.sinks.k1.type = avro
a1.sinks.k1.hostname = hadoop103
a1.sinks.k1.port = 4444


a1.sinks.k2.channel = c1
a1.sinks.k2.type = avro
a1.sinks.k2.hostname = hadoop104
a1.sinks.k2.port = 4444


a1.sinkgroups = g1
a1.sinkgroups.g1.sinks = k1 k2
a1.sinkgroups.g1.processor.type = failover
a1.sinkgroups.g1.processor.priority.k1 = 200
a1.sinkgroups.g1.processor.priority.k2 = 100
a1.sinkgroups.g1.processor.maxpenalty = 5000
级联高可用配置第2级（hadoop103）failover.conf
a1.sources = r1
a1.sinks = k1
a1.channels = c1


a1.sources.r1.channels = c1
a1.sources.r1.type = avro
a1.sources.r1.bind = hadoop103
a1.sources.r1.port = 4444
a1.sources.r1.batchSize = 100


a1.channels.c1.type = memory
a1.channels.c1.capacity = 2000
a1.channels.c1.transactionCapacity = 1000

a1.sinks.k1.channel = c1
a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSink
a1.sinks.k1.kafka.bootstrap.servers = hadoop102:9092,hadoop103:9092,hadoop104:9092
a1.sinks.k1.kafka.topic = failover
a1.sinks.k1.kafka.producer.acks = 1
级联高可用配置第2级（hadoop104）failover.conf
a1.sources = r1
a1.sinks = k1
a1.channels = c1


a1.sources.r1.channels = c1
a1.sources.r1.type = avro
a1.sources.r1.bind = hadoop104
a1.sources.r1.port = 4444
a1.sources.r1.batchSize = 100


a1.channels.c1.type = memory
a1.channels.c1.capacity = 2000
a1.channels.c1.transactionCapacity = 1000

a1.sinks.k1.channel = c1
a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSink
a1.sinks.k1.kafka.bootstrap.servers = hadoop102:9092,hadoop103:9092,hadoop104:9092
a1.sinks.k1.kafka.topic = failover
a1.sinks.k1.kafka.producer.acks = 1

/opt/module/datas

while true
do
if [ $(($RANDOM % 2)) -eq 0 ]
then
echo "u$RANDOM,e1,waimai,`date +%s`000" >> a.log
else
echo "u$RANDOM,e1,mall,`date +%s`000" >> a.log
fi
sleep 0.2
done

复制flume到hadoop104

[xx@hadoop102 module]$ scp -r flume-1.9.0/ hadoop104:$PWD

开启hadoop103,hadoop104

bin/flume-ng agent -c conf/ -f agentConf/failover.conf -n a1 -Dflume.root.logger=DEBUG,console

开启hadoop102

bin/flume-ng agent -c conf/ -f agentConf/failover.conf -n a1 -Dflume.root.logger=DEBUG,console

kafka查看topic failover

bin/kafka-console-consumer.sh --bootstrap-server \n
hadoop102:9092,hadoop103:9092,hadoop104:9092 \n
--topic failover

u21356,e1,waimai,1616817611000
u11451,e1,mall,1616817611000
u15814,e1,waimai,1616817612000
u20755,e1,waimai,1616817612000

成功！

TigRer
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论
专栏目录
Flume笔记
Yuexp0825的博客
04-13 143
Flume 概述: 特点：高可用的，高可靠的，分布式的海量日志采集、聚合和传输的系统。 选Flume的原因：FLume是流式传输实时处理的。 数据的传输过程：没有将用户产生的日志直接传输给大数据平台,而是传给日志服务器,可以按自己的需求方式去日志服务器获取。 不希望以你的方式来传输而时希望以我的方式去拿。 日志：<1>框架工作时候产生日志;<2>用户的操作行为被后台服务器收集后产生的用户行为日志。 Log4j：通过日志（log4j）的方式打印日志 日志的级别：...
flume学习笔记.pptx
09-23
flume学习笔记 ===亲测===== 笔记中所有demo都已由本人实现
Flume学习笔记
ZeroTeam_麒麟
04-08 1512
Flume学习笔记和实践分享一
flume笔记
weixin_45764675的博客
02-06 185
Flume是什么? Flume是⼀种分布式，可靠且可⽤的服务，⽤于有效地收集，聚合和移动⼤量⽇志数据。Flume构建在⽇志流之上⼀个简单灵活的架构。它具有可靠的可靠性机制和许多故障转移和恢复机制，具有强⼤的容错性。使⽤Flume这套架构实现对⽇志流数据的实时在线分析。Flume⽀持在⽇志系统中定制各类数据发送⽅，⽤于收集数据；同时，Flume提供对数据进⾏简单处理，并写到各种数据接受⽅（可定制）的...
Flume 笔记
qq_36864672的博客
11-28 456
$>flume-ng avro-client -H localhost -p 4141 -F /xxx(文件)  上面出错改成这个                   $>flume-ng agent -z s101:2181,s102:2181 -p /flume --name a1 -Dflume.root.logger=INFO,console 通过这个连接： $>flume
flume学习笔记更新版20190927.pptx
09-27
更新flume笔记文档 其中包括flume安装，flume监控文件、目录等并保存数据 还包含flume启动脚本
Flume笔记.zip
04-04
结合配套视频资源（https://space.bilibili.com/320773563/channel/detail?cid=173209），可以深入学习 Flume 的安装、配置、使用案例以及如何与其他大数据组件集成，提升你在大数据实时处理领域的技能。通过实践，...
大数据技术之Flume笔记
04-17
在实际的大数据环境中，Flume 常用于收集Web服务器日志、应用程序日志、社交媒体数据等，为后续的数据分析、挖掘和机器学习任务提供原始数据。结合Hadoop、Spark等工具，Flume 可以构建出强大的实时数据流处理系统。...
IT十八掌_Flume阶段学习笔记(知识点总结)
09-03
IT十八掌第三期配套课堂笔记! 1、安装和执行机制的分析 2、操作引入 3、常见工具对比 4、flume起源 5、flume概念 6、flume简介和实际应用操作 7、flume的几种配置 8、知识点的总结
Kafka最新完整学习笔记.pdf
08-17
学习kafka相关概念以及使用方法，kafka相关运行原理和执行流程，结合javaAPI，拦截器的相关实现，flume整合kafka等等
大数据学习笔记.zip
08-23
大数据学习笔记.zip是一个压缩包，其中包含了关于大数据技术的学习资料，特别是聚焦于Hadoop、HBase、Kafka和Flume这四个重要组件。这些技术都是大数据处理和分析领域中的核心工具，广泛应用于海量数据的存储、实时...
学习kafa的笔记，可以看看目录选择下载
最新发布
06-01
Kafka可以与Flume（数据收集系统）结合，FlumeSource用于从各种源收集数据，FlumeSink则将数据发送到Kafka。 了解这些核心概念后，开发者可以通过Kafka的API创建生产者和消费者，配置参数以优化性能，实现高效的...
storm 实战笔记
04-09
这部分内容聚焦于Storm与其他系统的集成，包括数据源的接入（如Kafka、Flume）和数据消费端的对接（如HDFS、Elasticsearch）。通过实例解析，读者可以掌握如何设计和实现数据流的完整生命周期，理解如何利用Storm...
learning-notes:IT学习笔记
04-11
IT学习笔记大数据蜂巢卡夫卡猪Power BI Python数据科学库火花火花编码火花流Spark Streaming Real Project教程Kafka客户端应用程序（生产者和消费者） Spark Streaming接收套接字数据并进行字计数。 Spark Streaming...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

TigRer

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值