mac安装hadoop

首先在终端输入:ssh localhost，如果终端有返回Last login: Mon Jul  8 16:33:56 2019
说明你之前成功配置了SSH keys,如果没有返回该内容，请按下述步骤新建一个配置:

  ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
  cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
  chmod 0600 ~/.ssh/authorized_keys

安装hadoop
brew install hadoop

配置hadoop
修改：hadoop-2.9.2/etc/hadoop/hadoop-env.sh

export JAVA_HOME="/Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home"

修改：hadoop-2.9.2/etc/hadoop/core-site.xml

<configuration>

  <property>
    <name>fs.defaultFS</name>
    <value>hdfs://localhost:9000</value>
  </property>
  <property>
     <name>hadoop.tmp.dir</name>
    <value>/Users/**/dev/hadoop-2.9.2/tmp</value>
    <description>A base for other temporary directories.</description>
  </property>

</configuration>

修改：hadoop-2.9.2/etc/hadoop/mapred-site.xml

<configuration>
   <property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
  </property>
</configuration>

修改：hadoop-2.9.2/etc/hadoop/hdfs-site.xml

<configuration>
    <property>
      <name>dfs.replication</name>
      <value>1</value>
    </property>
    <property>
      <name>dfs.permissions</name>
      <value>false</value>
    </property>
</configuration>

hadoop namenode -format

sh start-dfs.sh

sh start-yarn.sh

jps

DataNode
ResourceManager
NodeManager
NameNode
SecondaryNameNode

http://localhost:8088/cluster

http://localhost:50070/dfshealth.html#tab-overview