常见问题
- 问题一
localhost: Warning: Permanently added 'localhost' (ECDSA) to the list of known hosts.
解决:执行SSH设置和密钥生成
操作
- 问题二
Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
解决:在环境变量中添加export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib:$HADOOP_COMMON_LIB_NATIVE_DIR"
- 问题三
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
解决:在/usr/local/HBase/conf
目录中,使用vi编辑器,打开hbase-env.sh
,注释以下代码:
export HBASE_MASTER_OPTS="$HBASE_MASTER_OPTS -XX:PermSize=128m -XX:MaxPermSize=128m"
export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS -XX:PermSize=128m -XX:MaxPermSize=128m"
- 问题四
10/12/08 20:10:31 INFO hdfs.DFSClient: Could not obtain block
blk_XXXXXXXXXXXXXXXXXXXXXX_YYYYYYYY from any node: java.io.IOException: No live nodes
contain current block. Will get new block locations from namenode and retry...
解决,在hadoop的安装目录下的conf目录,使用vi编辑器,打开hdfs-site.xml
添加如下代码,而后重启hdfs生效:
<property>
<!-- 设置DataNode文件数量上限 -->
<name>dfs.datanode.max.transfer.threads</name>
<value>4096</value>
</property>
- 问题五
分布式集群HBase启动后某节点的HRegionServer自动消失问题
原因该节点系统时间与master机器时间未同步,解决,在该节点机器上输入以下命令,同步时间后重启Hbase:
ntpdate pool.ntp.org