Hadoop单节点环境搭建
使用的Hadoop相关版本:CDH
CDH相关软件包下载地址:http://archive.cloudera.com/cdh5/cdh/5/
Hadoop使用版本:hadoop-2.6.0-cdh5.15.1(版本一定要相互对应)
Hadoop下载:wget http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.6.0-cdh5.15.1.tar.gz
Required software for Linux include:
1.Java™ must be installed. Recommended Java versions are described at HadoopJavaVersions.
2.ssh must be installed and sshd must be running to use the Hadoop scripts that manage remote Hadoop daemons.
一.安装Java
1.拷贝本地软件包到服务器:scp jdk-8u91-linux-x64.tar.gz hadoop@192.168.199.218:~/hadoop/app
2.解压jdk到~/app/:tar -zvxf jdk-8u91-linux-x64.tar.gz -C ~/app/
3.把jdk配置系统环境变量中: ~/.bash_profile
export JAVA_HOME=/home/hadoop/app/jdk1.8.0_91
export PATH=$JAVA_HOME/bin:$PATH
4.使得配置修改生效:source .bash_profile
6.验证:java -version
二.安装ssh无密码登陆
ls 命令
ls -a
1. ls -la 并没有发现一个.ssh的文件夹
2.生成钥:
ssh-keygen -t rsa 一路回车
3. cd ~/.ssh
查看
[hadoop@hadoop01 .ssh]$ ll
总用量 12
-rw------- 1 hadoop hadoop 1679 10月 15 02:54 id_rsa 私钥
-rw-r--r-- 1 hadoop hadoop 398 10月 15 02:54 id_rsa.pub 公钥
-rw-r--r-- 1 hadoop hadoop 358 10月 15 02:54 known_