本人打算在linux环境下安装eclipse用于Hadoop MapReduce开发。已经安装了Hadoop-2.2.0环境,jdk是1.7.0_79版本
系统环境:
[
root@namenode hadoop]# cat /etc/redhat-release
Red Hat Enterprise Linux Server release 6.2 (Santiago)
[
root@namenode hadoop]# uname -a
Linux namenode 2.6.32-220.el6.x86_64 #1 SMP Wed Nov 9 08:03:13 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
[
root@namenode hadoop]# hadoop version
Hadoop 2.2.0
Subversion Unknown -r Unknown
Compiled by root on 2016-01-03T16:40Z
Compiled with protoc 2.5.0
From source with checksum 79e53ce7994d1628b240f09af91e1af4
This command was run using /opt/yarn/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0.jar
[
root@namenode eclipse-kelper4.3.2]# java -version
java version "1.7.0_79"
Java(TM) SE Runtime Environment (build 1.7.0_79-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.79-b02, mixed mode)
[
root@namenode eclipse-kelper4.3.2]# echo $JAVA_HOME
/usr/java/jdk1.7.0_79/
第一步,下载
1. eclipse-standard-kepler-SR2-linux-gtk-x86_64.tar.gz 在eclipse官网可以下载
2.
hadoop-eclipse-kepler-plugin-2.2.0.jar 这个也可以下载源码自己编译,但是我遇到了不少问题,后来不得不放弃,还好有CSDN,在里面搜到一个2.2.0的jar包
3. 另外,根据其他网友的介绍,也下载了
cdt-master-8.1.0.zip
,但不确定是否必须
第二步,安装
1. 我的Hadoop的安装目录是
/opt/yarn/hadoop-2.2.0/
2. 把eclipse-standard-kepler-SR2-linux-gtk-x86_64.tar.gz解压缩到/opt/
eclipse-kelper4.3.2/
[
root@namenode eclipse-kelper4.3.2]# pwd
/opt/eclipse-kelper4.3.2
[
root@namenode eclipse-kelper4.3.2]# ll
total 348
drwxrwsr-x. 2 100 users 4096 Feb 24 2014 about_files
-rw-rw-r--. 1 100 users 18732 Jan 17 2014 about.html
-rw-rw-r--. 1 100 users 113671 Feb 24 2014 artifacts.xml
drwxrwsr-x. 11 100 users 4096 Jan 5 21:15 configuration
drwxrwsr-x. 2 100 users 4096 Feb 24 2014 dropins
-rwxr-xr-x. 1 100 users 73031 Jan 15 2014 eclipse
-rw-rw-r--. 1 100 users 449 Jan 5 21:15 eclipse.ini
-rw-rw-r--. 1 100 users 16536 Feb 12 2014 epl-v10.html
drwxrwsr-x. 33 100 users 12288 Jan 5 21:09 features
-rw-rw-r--. 1 100 users 9022 Oct 9 2013 icon.xpm
-rw-rw-r--. 1 100 users 9230 Feb 12 2014 notice.html
drwxrwsr-x. 4 100 users 4096 Feb 24 2014 p2
drwxrwsr-x. 11 100 users 65536 Jan 5 21:15 plugins
drwxrwsr-x. 2 100 users 4096 Feb 24 2014 readme
[
root@namenode eclipse-kelper4.3.2]#
3. 把hadoop-eclipse-kepler-plugin-2.2.0.jar放入/opt/eclipse-kelper4.3.2/plugins下
4. 把
cdt-master-8.1.0.zip解压缩后,把它的plugins下的所有文件都copy到/opt/eclipse-kelper4.3.2/plugins,并把它的features的所有文件copy到/opt/eclipse-kelper4.3.2/features
第三步,设定环境变量,启动
vim /etc/profile加入
export PATH=/opt/eclipse-kelper4.3.2/:$PATH
启动eclipse
[root@namenode eclipse-kelper4.3.2]
./eclipse &
第四步,配置
界面如下:
这里,host是我的主机名(namenode),左边端口是JobTracker的端口,但这个端口经测试并不影响这里HDFS的连接;
右边是HDFS的端口,端口号是9000,这个端口才是关乎能否连上HDFS的关键。因为我的core-site.xml配置如下:
[
root@namenode hadoop]# cat core-site.xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>
hdfs://namenode:9000</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/opt/yarn/hadoop-2.2.0/yarn/yarn_data/tmp</value>
</property>
</configuration>