Hadoop使用时的一些常见问题

看日志，根据一些报错：
datanode启动之后，jps不显示datanode进程：https://stackoverflow.com/questions/22316187/datanode-not-starts-correctly
java.io.IOException: Incompatible clusterIDs in /home/hadoop/dfs/data: namenode clusterID= ****; datanode clusterID = ****

• bin/stop-all.sh
  rm -Rf /home/prassanna/usr/local/hadoop/yarn_data/hdfs/* //删除hdfs文件存放目录
  bin/hadoop namenode -format //reformat
  It is because after you set up your cluster, you, for whatever reason, decided to reformat your NN. Your DNs on slaves still bear reference to the old NN.

To resolve this simply delete and recreate data folder on that machine in local Linux FS, namely /home/hadoop/dfs/data.

Restarting that DN’s daemon on that machine will recreate data/ folder’s content and resolve the problem.