hadoop集群搭建 修改配置文件（三台主机都要配置）

hadoop集群搭建 修改配置文件（三台主机都要配置）

master 主机配置

1）hadoop-env.sh

vimhadoop-env.sh

2）core-site.xml

vim core-site.xml

fs.defaultFS hdfs://backup01:9000 io.file.buffer.size 131072 hadoop.tmp.dir /usr/local/hadoop/hadoop-3.1.2/tmp Abase for other temporary directories. hadoop.proxyuser.hduser.hosts \* hadoop.proxyuser.hduser.groups \*

3）hdfs-site.xml

vim hdfs-site.xml

dfs.namenode.secondary.http-address backup01:9001 dfs.namenode.name.dir file:/usr/local/hadoop/hadoop-3.1.2/dfs/name dfs.datanode.data.dir file:/usr/local/hadoop/hadoop-3.1.2/dfs/data dfs.replication 2 dfs.webhdfs.enabled true

4）mapred-site.xml

vim mapred-site.xml

5）yarn-site.xml

6）workers （slaves节点配置）

7）start-dfs.sh 和 stop-dfs.sh

cd /usr/local/hadoop/hadoop-3.1.2/sbin

vim start-dfs.sh

vimstop-dfs.sh

8）start-yarn.sh 和 stop-yarn.sh

vimstart-yarn.sh

vimstop-yarn.sh

注意：主机配置完成将master配置copy到其他两个slave节点