hadoop.2.8.1-搭建笔记

官网下载hadoop-2.8.1 ,并解压到/usr/local/hadoop

基本环境

yum install -y java java-1.8.0-openjdk-devel.x86_64

cd /usr/local/hadoop

一. 创建目录

mkdir hdfs name tmp

二. 配置环境变量
vim /usr/local/hadoop/etc/hadoop/hadoop-env.sh

export JAVA_HOME=/usr/lib/jvm/jre-1.8.0-openjdk.x86_64
export HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop

生效配置

source /usr/local/hadoop/etc/hadoop/hadoop-env.sh

三、配置core-site.xml、hdfs-site.xml、mapred-site.xml

vim /usr/local/hadoop/etc/hadoop/core-site.xml

<configuration>
 <property>  
        <name>fs.default.name</name>  
        <value>hdfs://localhost:9000</value>  
    </property>  
    <property>  
        <name>hadoop.tmp.dir</name>  
        <value>/usr/local/hadoop/tmp</value>  
    </property>
</configuration>

vim /usr/local/hadoop/etc/hadoop/hdfs-site.xml

<configuration>
<property>  
        <name>dfs.replication</name>  
        <value>1</value>  
    </property>  
    <property>  
        <name>dfs.name.dir</name>  
        <value>/usr/local/hadoop/hdfs/name</value>  
    </property>  
    <property>  
        <name>dfs.data.dir</name>  
        <value>/usr/local/hadoop/hdfs/data</value>  
    </property>  
</configuration>

创建mapred-site.xml文件

cp /usr/local/hadoop/etc/hadoop/mapred-site.xml.template /usr/local/hadoop/etc/hadoop/mapred-site.xml

vim /usr/local/hadoop/etc/hadoop/mapred-site.xml

<configuration>
<property>  
        <name>mapred.job.tracker</name>  
        <value>localhost:9001</value>  
    </property>  
</configuration>

四、格式化hdfs

hadoop namenode -format 

五、启动服务

sh /usr/local/hadoop/sbin/start-all.sh 

六、查看服务

# jps
13026 Jps
12339 ResourceManager
12181 SecondaryNameNode
12442 NodeManager
12026 DataNode

note: java-1.8.0-openjdk-devel中包含jps命令

七、停止服务

sh /usr/local/hadoop/sbin/stop-all.sh 

八、查看搭建结果
查看hadoop相关进程

netstat -nap  | grep java

http://localhost:8088/cluster
http://localhost:50090/status.html
http://localhost:50075/datanode.html

感谢以下博主分享的文章:
http://blog.csdn.net/hitwengqi/article/details/8008203
http://blog.csdn.net/yy_done/article/details/7006489
http://blog.sina.com.cn/s/blog_61ef49250100uvab.html