Hadoop配置遇到的问题总结

0. 环境说明：

hbase-2.1.3，hadoop-3.1.2，ubuntu 18.04

1. 无法连接http://localhost:50070

我的配置过程是参考官方文档的：http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html
　一步一步核对很多次，配置按文档所述，但就是无法打开上面的链接。后面bing了一下，找到了原因：
　https://stackoverflow.com/questions/19641326/http-localhost50070-does-not-work-hadoop
　原来是新版此端口变为9870了：

Since Hadoop 3.0.0 - Alpha 1 there was a Change in the port configuration:
http://localhost:50070
was moved to
http://localhost:9870

2. 执行./bin/start-hbase.sh，使用jps看到HMaster and HRegionServer运行不起来, 在logs/hbase-xxx-master-xxx-iMac.log中看到报错：

2019-03-03 18:42:41,252 ERROR [main] regionserver.HRegionServer: Failed construction RegionServer
java.lang.NoClassDefFoundError: org/apache/htrace/SamplerBuilder
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:644)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:628)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
…

网上搜索看到如下解决方法：
https://stackoverflow.com/questions/19641326/http-localhost50070-does-not-work-hadoophttps://stackoverflow.com/questions/19641326/http-localhost50070-does-not-work-hadoop
，执行如下命令解决：

cp ./lib/client-facing-thirdparty/htrace-core-3.1.0-incubating.jar ./lib/

3. 分别按照hbase和hadoop官方文档配置，hbase配置为hbase.cluster.distributed=true, 无法连接上hadoop，执行./bin/hadoop fs -ls /hbase提示错误。

log中有如下错误：

2019-03-03 21:57:54,012 ERROR [master/localhost:16000:becomeActiveMaster] master.HMaster: Failed to become active master
java.net.ConnectException: Call From xxx-iMac/localhost to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAcce

结果发现hadoop的etc/hadoop/core-site.xml中配置如下：

<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:8020</value>
</property>

而hbase的conf/hbase-site.xml中配置如下：

<property>
<name>hbase.rootdir</name>
<value>hdfs://localhost:9000/hbase</value>
</property>

发现端口不一致，所以连接不上。在hbase-site.xml中将9000也改为8020，停止hdfs和hbase，都重新启一下就好了。
这又是文档上的二者版本不一致导致的文档错误。