环境:
1..版本选择
参考: hadoop集群版本兼容问题
hadoop-2.5.0
hive-0.13.1
spark-1.2.0
hbase-0.98.6
flume-ng-1.5.0
jdk-8u161-linux-x64.tar.gz
组件分布:
|
qy01 |
qy02 |
qy03 |
HDFS |
NameNode DataNode |
DataNode |
DataNode |
YARN |
ResourceManager NodeManager |
NodeManager |
NodeManager |
Zookeeper |
Zookeeper |
Zookeeper |
Zookeeper |
Kafka |
Kafka |
Kafka |
Kafka |
Flume |