hadoop学习遇到问题1

Problem1

格式化失败导致namenode datanode没打开，抛出错误

18/10/10 16:25:18 INFO util.GSet: capacity = 2^15 = 32768 entries
18/10/10 16:25:18 ERROR namenode.NameNode: Failed to start namenode.
java.lang.IllegalArgumentException: URI has an authority component
at java.io.File.(File.java:423)
at org.apache.hadoop.hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:338)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:286)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournalsForWrite(FSEditLog.java:257)
at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1104)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1567)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1694)
18/10/10 16:25:18 INFO util.ExitUtil: Exiting with status 1
18/10/10 16:25:18 INFO namenode.NameNode: SHUTDOWN_MSG:

重新配置core-site.xml

<property>
    <name>fs.defaultFS</name>
    <value>hdfs://你的机器名:9000</value>
</property>
<property>
	<name>hadoop.tmp.dir</name>
	<value>/opt/module/hadoop-2.7.2/data/tmp</value>
</property>

再次格式化

然后打开namenode、datanode
sbin/hadoop-daemon.sh start namenode
sbin/hadoop-daemon.sh start datanode

jps查看

Problem2

伪分布式运行，linux机器内部能访问127.0.0.1:50070,外部无法访问，

问题可能

1. 端口没打开

   netstat -ano |grep 50070

   修改/etc/sysconfig/iptables文件，增加如下一行：

   -A RH-Firewall-1-INPUT -m state --state NEW -m tcp -p tcp --dport 50070 -j ACCEPT

   重启 iptables

   service iptables restart

   查看状态

   service iptables status

再次尝试浏览器访问就好使了