Hadoop环境搭建

最新推荐文章于 2024-09-21 17:07:20 发布

chenxie2031

最新推荐文章于 2024-09-21 17:07:20 发布

阅读量114

点赞数

文章标签：大数据

原文链接：https://my.oschina.net/jerval/blog/3032777

版权

Linux环境：CentOS-7-x86_64-DVD-1810

虚拟机：VirtualBox v5.2

JDK: jdk-8u91-linux-x64.rpm

Hadoop: hadoop-2.7.3.tar.gz

>>虚拟机网络设置：

>>Linux 网络设置

[root@localhost ~]# cat /etc/sysconfig/network-scripts/ifcfg-enp0s3
TYPE=Ethernet
BOOTPROTO=static
ONBOOT=yes
IPADDR=192.168.31.110
NETMASK=255.255.255.0
GATEWAY=192.168.31.1
DNS1=192.168.31.1

[root@localhost ~]#

>>通过FTP工具上传下面文件到/usr/local

hadoop-2.7.3.tar.gz

jdk-8u91-linux-x64.rpm

>>安装JDK

[root@localhost ~]# cd /usr/local
[root@localhost local]# ls
bin  etc  games  hadoop-2.7.3.tar.gz  include  jdk-8u91-linux-x64.rpm  lib  lib64  libexec  sbin  share  src
[root@localhost local]# rpm -ivh jdk-8u91-linux-x64.rpm

安装完成后显示：

Preparing...                          ################################# [100%]
Updating / installing...
   1:jdk1.8.0_91-2000:1.8.0_91-fcs    ################################# [100%]
Unpacking JAR files...
	tools.jar...
	plugin.jar...
	javaws.jar...
	deploy.jar...
	rt.jar...
	jsse.jar...
	charsets.jar...
	localedata.jar...
	jfxrt.jar...
[root@localhost local]#

检查Java默认安装目录：

[root@localhost usr]# ls
bin  etc  games  include  java  lib  lib64  libexec  local  sbin  share  src  tmp

检查JDK版本：

[root@localhost local]# java -version
java version "1.8.0_91"
Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)
[root@localhost local]#

>>安装Hadoop

[root@localhost local]# cd /usr/local
[root@localhost local]# ls
bin  etc  games  hadoop-2.7.3  hadoop-2.7.3.tar.gz  include  jdk-8u91-linux-x64.rpm  lib  lib64  libexec  sbin  share  src
[root@localhost local]# tar -xvf hadoop-2.7.3.tar.gz

修改默认安装文件夹名从hadoop-2.7.3到hadoop

[root@localhost local]# ls
bin  etc  games  hadoop-2.7.3  hadoop-2.7.3.tar.gz  include  jdk-8u91-linux-x64.rpm  lib  lib64  libexec  sbin  share  src
[root@localhost local]# mv hadoop-2.7.3 hadoop
[root@localhost local]# ls
bin  etc  games  hadoop  hadoop-2.7.3.tar.gz  include  jdk-8u91-linux-x64.rpm  lib  lib64  libexec  sbin  share  src
[root@localhost local]#

>>配置hadoop环境：

[root@localhost hadoop]# cd /usr/local/hadoop/etc/hadoop
[root@localhost hadoop]# vim hadoop-env.sh

设置hadooop jdk：

[root@localhost hadoop]# cd /usr/local/hadoop/etc/hadoop
[root@localhost hadoop]# vim hadoop-env.sh
[root@localhost hadoop]#

修改JAVA_HOME:

# The java implementation to use.
export JAVA_HOME=/usr/java/default

添加hadoop到系统环境变量：

vim /etc/profile

文件结尾添加内容：


export PATH=$PATH:/usr/local/hadoop/bin:/usr/local/hadoop/sbin

刷新环境变量：

[root@localhost hadoop]# source /etc/profile
[root@localhost hadoop]#

检查hadoop环境配置：

[root@localhost hadoop]# hadoop
Usage: hadoop [--config confdir] [COMMAND | CLASSNAME]
  CLASSNAME            run the class named CLASSNAME
 or
  where COMMAND is one of:
  fs                   run a generic filesystem user client
  version              print the version
  jar <jar>            run a jar file
                       note: please use "yarn jar" to launch
                             YARN applications, not this command.
  checknative [-a|-h]  check native hadoop and compression libraries availability
  distcp <srcurl> <desturl> copy file or directories recursively
  archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
  classpath            prints the class path needed to get the
  credential           interact with credential providers
                       Hadoop jar and the required libraries
  daemonlog            get/set the log level for each daemon
  trace                view and modify Hadoop tracing settings

Most commands print help when invoked w/o parameters.
[root@localhost hadoop]#

转载于:https://my.oschina.net/jerval/blog/3032777