hadoop eclipse 配置

重装系统后有折腾了好久,才搞定。。感觉还是不靠谱。。先记录下

hadoop 伪分布式配置:

1,hadoop版本

hadoop@ubuntu:~/collector_3h/hadoop-0.20.2/bin$ ./hadoop version
Hadoop 0.20.2
Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707
Compiled by chrisdo on Fri Feb 19 08:07:34 UTC 2010

2,配置文件 

hdfs-site.xml

hadoop@ubuntu:~/collector_3h/hadoop-0.20.2/conf$ cat hdfs-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>

     <property>  
      <name>dfs.permissions</name>  
      <value>false</value>  
     </property>  

    <property>
        <name>dfs.name.dir</name>
        <value>/home/hadoop/collector_3h/hadoop-0.20.2/hdfs/name</value>
    </property>

    <property>
        <name>dfs.data.dir</name>
        <value>/home/hadoop/collector_3h/hadoop-0.20.2/hdfs/data</value>
    </property>
</configuration>

-----------------------

mapred-site.xml

hadoop@ubuntu:~/collector_3h/hadoop-0.20.2/conf$ cat mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
    <property>
        <name>mapred.job.tracker</name>
        <value>localhost:9001</value>
    </property>


    <property>
    <name>mapred.local.dir</name>
    <value>/home/hadoop/collector_3h/hadoop-0.20.2/mapred/local</value>
    </property>  

    <property>
    <name>mapred.system.dir</name>
    <value>/home/hadoop/collector_3h/hadoop-0.20.2/mapred/system</value>
    </property>

</configuration>


--------------------------------------------

core-site.xml
hadoop@ubuntu:~/collector_3h/hadoop-0.20.2/conf$ cat core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
  <property>
    <name>fs.default.name</name>
    <value>hdfs://localhost:9000</value>
  </property>

  <property>  
    <name>hadoop.tmp.dir</name>  
    <value>/home/hadoop/collector_3h/hadoop-0.20.2/hdfs/tmp</value>  
  </property>  

</configuration>


--------------------------------------

之后配置eclipse  这个插件真不靠谱

最终用的3.3.2+hadoop 自带的插件


评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值