big-data 3: presudo distributed configuration

1, same as before,but need to change

Configuration

Use the following:

conf/core-site.xml:

<configuration>
     <property>
         <name>fs.default.name</name>
         <value>hdfs://localhost:9000</value>
     </property>
</configuration>

conf/hdfs-site.xml:

<configuration>
     <property>
         <name>dfs.replication</name>
         <value>1</value>
     </property>
</configuration>

---if without below, you can not visit

• JobTracker - http://localhost:50030/ . 
  conf/mapred-site.xml:

  <configuration>
       <property>
           <name>mapred.job.tracker</name>
           <value>localhost:9001</value>
       </property>
  </configuration>
  

  Execution

  Format a new distributed-filesystem:
  $ bin/hadoop namenode -format

  Start the hadoop daemons:
  $ bin/start-all.sh

  The hadoop daemon log output is written to the ${HADOOP_LOG_DIR} directory (defaults to ${HADOOP_HOME}/logs).

  Browse the web interface for the NameNode and the JobTracker; by default they are available at:

  • NameNode - http://localhost:50070/
  • JobTracker - http://localhost:50030/

  Copy the input files into the distributed filesystem:
  $ bin/hadoop fs -put conf input

  Run some of the examples provided:
  $ bin/hadoop jar hadoop-examples-*.jar grep input output 'dfs[a-z.]+'

  Examine the output files:

  Copy the output files from the distributed filesystem to the local filesytem and examine them:
  $ bin/hadoop fs -get output output
  $ cat output/*

  or

  View the output files on the distributed filesystem:
  $ bin/hadoop fs -cat output/*

  When you're done, stop the daemons with:
  $ bin/stop-all.sh