Hadoop安装与伪分布式配置

1.hadoop cdh下载地址

http://archive.cloudera.com/cdh5/cdh/5/

2.下载

wget http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.6.0-cdh5.15.1.tar.gz

也可以scp传输文件

3.解压

tar -zxvf hadoop-2.6.0-cdh5.15.1.tar.gz -C ~/app/

4.添加环境变量

sudo vim /etc/profile   //所有用户添加
export HADOOP_HOME=/home/ubuntu/app/hadoop-2.6.0-cdh5.15.1
export PATH=$PATH:$HADOOP_HOME/bin

source /etc/profile
echo $HADOOP_HOME

5.配置Hadoop文件

cd $HADOOP_HOME
cd etc/hadoop
vim hadoop-env.sh

导入echo $JAVA_HOME的位置

export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64

etc/hadoop/core-site.xml:

vim core-site.xml

<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

etc/hadoop/hdfs-site.xml:

vim hdfs-site.xml

Reference
https://ke.qq.com/course/478249