Hadoop,Yarn,Zookeeper,kafka数据仓库集群命令集合

1.HDFS

start-dfs.sh

stop-dfs.sh

2.Yarn;

start-yarn.sh

stop-yarn.sh

要先启动ZooKeeper 再启动Kafka 顺序不可以改变。先关闭kafka ，再关闭zookeeper。

3.Zookeeper

zkServer.sh start

zkServer.sh stop

检查ZooKeeper状态：zkServer.sh status

4.kafka

路径根据自己的配置去修改

启动

kafka-server-start.sh -daemon /opt/apps/kafka/config/server.properties

关闭

kafka-server-stop.sh

新建一个主题

kafka-topics.sh --zookeeper node04:2181,node02:2181,node03:2181/kafka --create --replication-factor 1 --partitions 1 --topic topic_spider_jd

kafka-topics.sh --zookeeper node01:2181 --create --replication-factor 3 --partitions 1 --topic t1
Created topic t1.

flume采集数据

flume-ng agent --name a1 --conf-file /opt/apps/flume/conf/spider-flume-kafka.conf &