大数据常用组件官网地址
数据采集传输
Flume
下载地址:https://flume.apache.org/download.html
Kafka
官方地址:https://kafka.apache.org/downloads.html
DataX
官网开源地址:https://github.com/alibaba/DataX
百度网盘:
链接:https://pan.baidu.com/s/17Q0JbP334UmkxmZiYSI2mQ
提取码:1234
MaxWell
地址:https://github.com/zendesk/maxwell/releases/download/v1.29.2/maxwell-1.29.2.tar.gz
下载地址:
链接:https://pan.baidu.com/s/1ZCXNBqb0cJyV5Fzc5uoGEw
提取码:1234
Sqoop
下载:https://archive.apache.org/dist/sqoop/
数据存储
Hadoop(HDFS)
下载地址:https://hadoop.apache.org/releases.html
HBase
下载地址:[https://hbase.apache.org/downloads.html]
MySQL
下载地址;[https://www.mysql.com/downloads/]
Redis
下载地址:https://redis.io/download/
数据计算
Hive(离线)
官网:https://hive.apache.org/index.html
下载地址:[https://hive.apache.org/general/downloads/
Spark(离线)
下载地址:https://spark.apache.org/downloads.html
Fink(实时)
下载地址:https://flink.apache.org/downloads.html
数据查询
ClickHouse(实时)
Presto(离线)
下载:https://prestodb.io/getting-started.html
数据可视化
Superset
官网:https://superset.apache.org/
下载地址:https://pypi.org/project/apache-superset/
任务调度
DolphinScheduler
官网:https://dolphinscheduler.apache.org/
下载:https://dolphinscheduler.apache.org/zh-cn/download
集群监控
Zabbix(离线)
Prometheus(实时)
下载地址:https://prometheus.io/download/
Zookeeper
官网:https://zookeeper.apache.org/
eus.io/download/](https://prometheus.io/download/)