hadoop （四） 单机安装hadoop

最新推荐文章于 2024-05-30 16:47:53 发布
最新推荐文章于 2024-05-30 16:47:53 发布
阅读量1.7k 收藏 2
点赞数
分类专栏： hadoop
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_35573689/article/details/80495429
版权

hadoop 安装部署的三种模式（本地模式不需要jdk）：

               单机（本地）安装（standalone mode）：部署在一台机器上，没有分布式不使用hdfs，主要用于本地开发和调试。

               伪分布式安装（pseudo-distributed mode）：一台机器上运行所有的hadoop 服务，每个hadoop守护进程都是一个独立的jvm进程，常用于调试。

               全分布式模式（fullil distributed mode）：运行于多台机器的的真实环境模式。

              

单机模式安装

        1安装jdk

              解压jdk压缩包

             vi  /etc/profile

             ##jdk config

            export JAVA_HOME=/usr/java/jdk1.8.0_171
            export CLASSPATH=.:${JAVA_HOME}/jre/lib/rt.jar:${JAVA_HOME}/lib/dt.jar:${JAVA_HOME}/lib/tools.jar

            export PATH=$PATH:${JAVA_HOME}/bin

           让配置生效

           source /etc/profile

       2安装hadoop

            解压

           tar -zxvf  hadoop-1.2.1.tar.gz

      配置环境变量 /etc/profile 末尾添加内容：

   ##hadoop config

     export HADOOP_HOME=/usr/hadoop/hadoop-1.2.1

    export  PATH=$PATH:/usr/hadoop/hadoop-1.2.1/bin

   以root用户让配置生效

   source /etc/profile

   测试是否安装配置成功

   输入hadoop查看：

    

   配置hadoop中的jdk安装路径（修改为自己安装jdk）  

         cd /usr/hadoop/hadoop-1.2.1/conf    #cd 到hadoop的配置文件目录

        vi hadoop-env.sh

显示如下：

       

修改路径为：

 

测试mapreduce程序：

      在usr目录下创建目录data，data下创建目录input（此处目录自己随便命名，只要使用一致就行）

     mkdir -p /usr/data/input

   把hadoop配置文件全部copy过来，作为mapreduce的输入文件

        cp /usr/hadoop/hadoop-1.2.1/conf/*.xml  /usr/data/input

    在hadoop目录下执行命令测试mapreduce：

    hadoop jar hadoop-examples-1.2.1.jar  grep /usr/data/input /usr/data/output 'dfs[a-z.]+'

          可以根据下面的过程看mapreduce执行过程

              18/05/29 21:11:35 INFO util.NativeCodeLoader: Loaded the native-hadoop library
18/05/29 21:11:35 WARN snappy.LoadSnappy: Snappy native library not loaded
18/05/29 21:11:35 INFO mapred.FileInputFormat: Total input paths to process : 7
18/05/29 21:11:36 INFO mapred.JobClient: Running job: job_local2023822132_0001
18/05/29 21:11:36 INFO mapred.LocalJobRunner: Waiting for map tasks
18/05/29 21:11:36 INFO mapred.LocalJobRunner: Starting task: attempt_local2023822132_0001_m_000000_0
18/05/29 21:11:36 INFO util.ProcessTree: setsid exited with exit code 0
18/05/29 21:11:36 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@58ee6b86
18/05/29 21:11:36 INFO mapred.MapTask: Processing split: file:/usr/data/input/capacity-scheduler.xml:0+7457
18/05/29 21:11:36 INFO mapred.MapTask: numReduceTasks: 1
18/05/29 21:11:36 INFO mapred.MapTask: io.sort.mb = 100
18/05/29 21:11:37 INFO mapred.JobClient:  map 0% reduce 0%
18/05/29 21:11:37 INFO mapred.MapTask: data buffer = 79691776/99614720
18/05/29 21:11:37 INFO mapred.MapTask: record buffer = 262144/327680
18/05/29 21:11:37 INFO mapred.MapTask: Starting flush of map output
18/05/29 21:11:37 INFO mapred.Task: Task:attempt_local2023822132_0001_m_000000_0 is done. And is in the process of commiting
18/05/29 21:11:37 INFO mapred.LocalJobRunner: file:/usr/data/input/capacity-scheduler.xml:0+7457
18/05/29 21:11:37 INFO mapred.Task: Task 'attempt_local2023822132_0001_m_000000_0' done.
18/05/29 21:11:37 INFO mapred.LocalJobRunner: Finishing task: attempt_local2023822132_0001_m_000000_0
18/05/29 21:11:37 INFO mapred.LocalJobRunner: Starting task: attempt_local2023822132_0001_m_000001_0
18/05/29 21:11:37 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@56f687af
18/05/29 21:11:37 INFO mapred.MapTask: Processing split: file:/usr/data/input/hadoop-policy.xml:0+4644
18/05/29 21:11:37 INFO mapred.MapTask: numReduceTasks: 1
18/05/29 21:11:37 INFO mapred.MapTask: io.sort.mb = 100
18/05/29 21:11:37 INFO mapred.MapTask: data buffer = 79691776/99614720
18/05/29 21:11:37 INFO mapred.MapTask: record buffer = 262144/327680
18/05/29 21:11:37 INFO mapred.MapTask: Starting flush of map output
18/05/29 21:11:37 INFO mapred.MapTask: Finished spill 0
18/05/29 21:11:37 INFO mapred.Task: Task:attempt_local2023822132_0001_m_000001_0 is done. And is in the process of commiting
18/05/29 21:11:37 INFO mapred.LocalJobRunner: file:/usr/data/input/hadoop-policy.xml:0+4644
18/05/29 21:11:37 INFO mapred.Task: Task 'attempt_local2023822132_0001_m_000001_0' done.
18/05/29 21:11:37 INFO mapred.LocalJobRunner: Finishing task: attempt_local2023822132_0001_m_000001_0
18/05/29 21:11:37 INFO mapred.LocalJobRunner: Starting task: attempt_local2023822132_0001_m_000002_0
18/05/29 21:11:37 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6796c850
18/05/29 21:11:37 INFO mapred.MapTask: Processing split: file:/usr/data/input/mapred-queue-acls.xml:0+2033
18/05/29 21:11:37 INFO mapred.MapTask: numReduceTasks: 1
18/05/29 21:11:37 INFO mapred.MapTask: io.sort.mb = 100
18/05/29 21:11:37 INFO mapred.MapTask: data buffer = 79691776/99614720
18/05/29 21:11:37 INFO mapred.MapTask: record buffer = 262144/327680
18/05/29 21:11:37 INFO mapred.MapTask: Starting flush of map output
18/05/29 21:11:37 INFO mapred.Task: Task:attempt_local2023822132_0001_m_000002_0 is done. And is in the process of commiting
18/05/29 21:11:37 INFO mapred.LocalJobRunner: file:/usr/data/input/mapred-queue-acls.xml:0+2033
18/05/29 21:11:37 INFO mapred.Task: Task 'attempt_local2023822132_0001_m_000002_0' done.
18/05/29 21:11:37 INFO mapred.LocalJobRunner: Finishing task: attempt_local2023822132_0001_m_000002_0
18/05/29 21:11:37 INFO mapred.LocalJobRunner: Starting task: attempt_local2023822132_0001_m_000003_0
18/05/29 21:11:37 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@16efbfc4
18/05/29 21:11:37 INFO mapred.MapTask: Processing split: file:/usr/data/input/fair-scheduler.xml:0+327
18/05/29 21:11:37 INFO mapred.MapTask: numReduceTasks: 1
18/05/29 21:11:37 INFO mapred.MapTask: io.sort.mb = 100
18/05/29 21:11:37 INFO mapred.MapTask: data buffer = 79691776/99614720
18/05/29 21:11:37 INFO mapred.MapTask: record buffer = 262144/327680
18/05/29 21:11:37 INFO mapred.MapTask: Starting flush of map output
18/05/29 21:11:37 INFO mapred.Task: Task:attempt_local2023822132_0001_m_000003_0 is done. And is in the process of commiting
18/05/29 21:11:37 INFO mapred.LocalJobRunner: file:/usr/data/input/fair-scheduler.xml:0+327
18/05/29 21:11:37 INFO mapred.Task: Task 'attempt_local2023822132_0001_m_000003_0' done.
18/05/29 21:11:37 INFO mapred.LocalJobRunner: Finishing task: attempt_local2023822132_0001_m_000003_0
18/05/29 21:11:37 INFO mapred.LocalJobRunner: Starting task: attempt_local2023822132_0001_m_000004_0
18/05/29 21:11:37 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@493129d5
18/05/29 21:11:37 INFO mapred.MapTask: Processing split: file:/usr/data/input/core-site.xml:0+178
18/05/29 21:11:37 INFO mapred.MapTask: numReduceTasks: 1
18/05/29 21:11:37 INFO mapred.MapTask: io.sort.mb = 100
18/05/29 21:11:38 INFO mapred.MapTask: data buffer = 79691776/99614720
18/05/29 21:11:38 INFO mapred.MapTask: record buffer = 262144/327680
18/05/29 21:11:38 INFO mapred.MapTask: Starting flush of map output
18/05/29 21:11:38 INFO mapred.Task: Task:attempt_local2023822132_0001_m_000004_0 is done. And is in the process of commiting
18/05/29 21:11:38 INFO mapred.LocalJobRunner: file:/usr/data/input/core-site.xml:0+178
18/05/29 21:11:38 INFO mapred.Task: Task 'attempt_local2023822132_0001_m_000004_0' done.
18/05/29 21:11:38 INFO mapred.LocalJobRunner: Finishing task: attempt_local2023822132_0001_m_000004_0
18/05/29 21:11:38 INFO mapred.LocalJobRunner: Starting task: attempt_local2023822132_0001_m_000005_0
18/05/29 21:11:38 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@17ce0e1f
18/05/29 21:11:38 INFO mapred.MapTask: Processing split: file:/usr/data/input/hdfs-site.xml:0+178
18/05/29 21:11:38 INFO mapred.MapTask: numReduceTasks: 1
18/05/29 21:11:38 INFO mapred.MapTask: io.sort.mb = 100
18/05/29 21:11:38 INFO mapred.JobClient:  map 71% reduce 0%
18/05/29 21:11:38 INFO mapred.MapTask: data buffer = 79691776/99614720
18/05/29 21:11:38 INFO mapred.MapTask: record buffer = 262144/327680
18/05/29 21:11:38 INFO mapred.MapTask: Starting flush of map output
18/05/29 21:11:38 INFO mapred.Task: Task:attempt_local2023822132_0001_m_000005_0 is done. And is in the process of commiting
18/05/29 21:11:38 INFO mapred.LocalJobRunner: file:/usr/data/input/hdfs-site.xml:0+178
18/05/29 21:11:38 INFO mapred.Task: Task 'attempt_local2023822132_0001_m_000005_0' done.
18/05/29 21:11:38 INFO mapred.LocalJobRunner: Finishing task: attempt_local2023822132_0001_m_000005_0
18/05/29 21:11:38 INFO mapred.LocalJobRunner: Starting task: attempt_local2023822132_0001_m_000006_0
18/05/29 21:11:38 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4a78398e
18/05/29 21:11:38 INFO mapred.MapTask: Processing split: file:/usr/data/input/mapred-site.xml:0+178
18/05/29 21:11:38 INFO mapred.MapTask: numReduceTasks: 1
18/05/29 21:11:38 INFO mapred.MapTask: io.sort.mb = 100
18/05/29 21:11:38 INFO mapred.MapTask: data buffer = 79691776/99614720
18/05/29 21:11:38 INFO mapred.MapTask: record buffer = 262144/327680
18/05/29 21:11:38 INFO mapred.MapTask: Starting flush of map output
18/05/29 21:11:38 INFO mapred.Task: Task:attempt_local2023822132_0001_m_000006_0 is done. And is in the process of commiting
18/05/29 21:11:38 INFO mapred.LocalJobRunner: file:/usr/data/input/mapred-site.xml:0+178
18/05/29 21:11:38 INFO mapred.Task: Task 'attempt_local2023822132_0001_m_000006_0' done.
18/05/29 21:11:38 INFO mapred.LocalJobRunner: Finishing task: attempt_local2023822132_0001_m_000006_0
18/05/29 21:11:38 INFO mapred.LocalJobRunner: Map task executor complete.
18/05/29 21:11:38 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2a27f691
18/05/29 21:11:38 INFO mapred.LocalJobRunner: 
18/05/29 21:11:38 INFO mapred.Merger: Merging 7 sorted segments
18/05/29 21:11:38 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 21 bytes
18/05/29 21:11:38 INFO mapred.LocalJobRunner: 
18/05/29 21:11:38 INFO mapred.Task: Task:attempt_local2023822132_0001_r_000000_0 is done. And is in the process of commiting
18/05/29 21:11:38 INFO mapred.LocalJobRunner: 
18/05/29 21:11:38 INFO mapred.Task: Task attempt_local2023822132_0001_r_000000_0 is allowed to commit now
18/05/29 21:11:38 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local2023822132_0001_r_000000_0' to file:/usr/hadoop/hadoop-1.2.1/grep-temp-1671205082
18/05/29 21:11:38 INFO mapred.LocalJobRunner: reduce > reduce
18/05/29 21:11:38 INFO mapred.Task: Task 'attempt_local2023822132_0001_r_000000_0' done.
18/05/29 21:11:39 INFO mapred.JobClient:  map 100% reduce 100%
18/05/29 21:11:39 INFO mapred.JobClient: Job complete: job_local2023822132_0001
18/05/29 21:11:39 INFO mapred.JobClient: Counters: 21
18/05/29 21:11:39 INFO mapred.JobClient:   Map-Reduce Framework
18/05/29 21:11:39 INFO mapred.JobClient:     Spilled Records=2
18/05/29 21:11:39 INFO mapred.JobClient:     Map output materialized bytes=61
18/05/29 21:11:39 INFO mapred.JobClient:     Reduce input records=1
18/05/29 21:11:39 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=0
18/05/29 21:11:39 INFO mapred.JobClient:     Map input records=369
18/05/29 21:11:39 INFO mapred.JobClient:     SPLIT_RAW_BYTES=637
18/05/29 21:11:39 INFO mapred.JobClient:     Map output bytes=17
18/05/29 21:11:39 INFO mapred.JobClient:     Reduce shuffle bytes=0
18/05/29 21:11:39 INFO mapred.JobClient:     Physical memory (bytes) snapshot=0
18/05/29 21:11:39 INFO mapred.JobClient:     Map input bytes=14995
18/05/29 21:11:39 INFO mapred.JobClient:     Reduce input groups=1
18/05/29 21:11:39 INFO mapred.JobClient:     Combine output records=1
18/05/29 21:11:39 INFO mapred.JobClient:     Reduce output records=1
18/05/29 21:11:39 INFO mapred.JobClient:     Map output records=1
18/05/29 21:11:39 INFO mapred.JobClient:     Combine input records=1
18/05/29 21:11:39 INFO mapred.JobClient:     CPU time spent (ms)=0
18/05/29 21:11:39 INFO mapred.JobClient:     Total committed heap usage (bytes)=1303212032
18/05/29 21:11:39 INFO mapred.JobClient:   File Input Format Counters 
18/05/29 21:11:39 INFO mapred.JobClient:     Bytes Read=14995
18/05/29 21:11:39 INFO mapred.JobClient:   FileSystemCounters
18/05/29 21:11:39 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=1570178
18/05/29 21:11:39 INFO mapred.JobClient:     FILE_BYTES_READ=1272608
18/05/29 21:11:39 INFO mapred.JobClient:   File Output Format Counters 
18/05/29 21:11:39 INFO mapred.JobClient:     Bytes Written=123
18/05/29 21:11:39 INFO mapred.FileInputFormat: Total input paths to process : 1
18/05/29 21:11:39 INFO mapred.JobClient: Running job: job_local251880250_0002
18/05/29 21:11:39 INFO mapred.LocalJobRunner: Waiting for map tasks
18/05/29 21:11:39 INFO mapred.LocalJobRunner: Starting task: attempt_local251880250_0002_m_000000_0
18/05/29 21:11:39 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@50ab4b47
18/05/29 21:11:39 INFO mapred.MapTask: Processing split: file:/usr/hadoop/hadoop-1.2.1/grep-temp-1671205082/part-00000:0+111
18/05/29 21:11:39 INFO mapred.MapTask: numReduceTasks: 1
18/05/29 21:11:39 INFO mapred.MapTask: io.sort.mb = 100
18/05/29 21:11:39 INFO mapred.MapTask: data buffer = 79691776/99614720
18/05/29 21:11:39 INFO mapred.MapTask: record buffer = 262144/327680
18/05/29 21:11:39 INFO mapred.MapTask: Starting flush of map output
18/05/29 21:11:39 INFO mapred.MapTask: Finished spill 0
18/05/29 21:11:39 INFO mapred.Task: Task:attempt_local251880250_0002_m_000000_0 is done. And is in the process of commiting
18/05/29 21:11:39 INFO mapred.LocalJobRunner: file:/usr/hadoop/hadoop-1.2.1/grep-temp-1671205082/part-00000:0+111
18/05/29 21:11:39 INFO mapred.Task: Task 'attempt_local251880250_0002_m_000000_0' done.
18/05/29 21:11:39 INFO mapred.LocalJobRunner: Finishing task: attempt_local251880250_0002_m_000000_0
18/05/29 21:11:39 INFO mapred.LocalJobRunner: Map task executor complete.
18/05/29 21:11:39 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4d0a2b92
18/05/29 21:11:39 INFO mapred.LocalJobRunner: 
18/05/29 21:11:39 INFO mapred.Merger: Merging 1 sorted segments
18/05/29 21:11:39 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 21 bytes
18/05/29 21:11:39 INFO mapred.LocalJobRunner: 
18/05/29 21:11:39 INFO mapred.Task: Task:attempt_local251880250_0002_r_000000_0 is done. And is in the process of commiting
18/05/29 21:11:39 INFO mapred.LocalJobRunner: 
18/05/29 21:11:39 INFO mapred.Task: Task attempt_local251880250_0002_r_000000_0 is allowed to commit now
18/05/29 21:11:39 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local251880250_0002_r_000000_0' to file:/usr/data/output
18/05/29 21:11:39 INFO mapred.LocalJobRunner: reduce > reduce
18/05/29 21:11:39 INFO mapred.Task: Task 'attempt_local251880250_0002_r_000000_0' done.
18/05/29 21:11:40 INFO mapred.JobClient:  map 100% reduce 100%
18/05/29 21:11:40 INFO mapred.JobClient: Job complete: job_local251880250_0002
18/05/29 21:11:40 INFO mapred.JobClient: Counters: 21
18/05/29 21:11:40 INFO mapred.JobClient:   Map-Reduce Framework
18/05/29 21:11:40 INFO mapred.JobClient:     Spilled Records=2
18/05/29 21:11:40 INFO mapred.JobClient:     Map output materialized bytes=25
18/05/29 21:11:40 INFO mapred.JobClient:     Reduce input records=1
18/05/29 21:11:40 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=0
18/05/29 21:11:40 INFO mapred.JobClient:     Map input records=1
18/05/29 21:11:40 INFO mapred.JobClient:     SPLIT_RAW_BYTES=114
18/05/29 21:11:40 INFO mapred.JobClient:     Map output bytes=17
18/05/29 21:11:40 INFO mapred.JobClient:     Reduce shuffle bytes=0
18/05/29 21:11:40 INFO mapred.JobClient:     Physical memory (bytes) snapshot=0
18/05/29 21:11:40 INFO mapred.JobClient:     Map input bytes=25
18/05/29 21:11:40 INFO mapred.JobClient:     Reduce input groups=1
18/05/29 21:11:40 INFO mapred.JobClient:     Combine output records=0
18/05/29 21:11:40 INFO mapred.JobClient:     Reduce output records=1
18/05/29 21:11:40 INFO mapred.JobClient:     Map output records=1
18/05/29 21:11:40 INFO mapred.JobClient:     Combine input records=0
18/05/29 21:11:40 INFO mapred.JobClient:     CPU time spent (ms)=0
18/05/29 21:11:40 INFO mapred.JobClient:     Total committed heap usage (bytes)=322510848
18/05/29 21:11:40 INFO mapred.JobClient:   File Input Format Counters 
18/05/29 21:11:40 INFO mapred.JobClient:     Bytes Read=123
18/05/29 21:11:40 INFO mapred.JobClient:   FileSystemCounters
18/05/29 21:11:40 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=782023
18/05/29 21:11:40 INFO mapred.JobClient:     FILE_BYTES_READ=610105
18/05/29 21:11:40 INFO mapred.JobClient:   File Output Format Counters 

18/05/29 21:11:40 INFO mapred.JobClient:     Bytes Written=23

可以去data/output/查看输出的内容

至此单机部署已经结束

按照伪分布模式安装部署

           

王叫瘦
关注
  • 0
    点赞
  • 踩
  • 2
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
Hadoop单机安装详细步骤
Spring , Hadoop, Spark , BI , ML
07-11 8533
环境准备安装Java过程简单，这里省略具体安装步骤。安装后确认相应版本的Java已安装，这里选择1.7。java -version创建Hadoop账号为Hadoop创建一个专门的账号是很好的实践：sudo adduser hadoop sudo passwd hadoop授予 Hadoop root权限 为了测试，图方便，这里给Hadoop root权限，生产环境不建议这样做。 使用root权限
hadoop单机版安装
幻神舞的专栏
11-08 1317
hadoop单机版安装
Hadoop安装（小白教程）
最新发布
weixin_43977307的博客
05-30 853
1）Hadoop是一个由Apache基金会所开发的分布式系统基础架构。2）主要解决，海量数据的存储和海量数据的分析计算问题。3）广义上来说，Hadoop通常是指一个更广泛的概念——Hadoop生态圈。
Hadoop单机安装
letterss的博客
11-16 1840
JDK 的安装 将下载好的 jdk 文件放到/usr/local，配置环境变量 vim /etc/profileexport JAVA_HOME=/usr/local/jdk1.8.0_211 export PATH=$PATH:$JAVA_HOME/bin export CLASSPATH=$JAVA_HOME/lib Hadoop 的安装 官网下载Hadoop,下载到/usr/local 目录下并解压并在 /etc/profile文件中配置环境变量 export HADOOP_HOME=/.
大数据学习系列之一 ----- Hadoop环境搭建(单机)
weixin_34302561的博客
12-10 168
一、环境选择 1，服务器选择 阿里云服务器:入门型(按量付费) 操作系统:linux CentOS 6.8 Cpu：1核 内存：1G 硬盘:40G ip:39.108.77.250 2，配置选择 JDK:1.8 （jdk-8u144-linux-x64.tar.gz） Hadoop:2.8.2 (hadoop-2.8.2.tar.gz) 3，下载地址 官网地址: JDK： http://www....
Hadoop单机版安装
qq_42773076的博客
09-23 4227
hadoop单机版安装流程如下： 创建一个用于管理hadood的用户（可新建或者使用已有的用户） 安装并配置ssh免密码登陆 安装Java环境 下载hadoop并配置环境变量 配置相关的Hadoop配置 验证hadoop安装并启动 创建先的用的用户 没有用户则通过useradd username # 用户名 passwd username # 设置密码 已存在可用的用户则直接切换当前用户：su username 安装并配置ssh免密码登陆 使用ssh-keygen -t rsa 或 注：使用ssh-ke
hadoop 单机安装
01-25
### Hadoop单机模式安装详解 #### 一、前言 Hadoop是一个开源软件框架，用于分布式存储和处理大规模数据集。它最初由Apache软件基金会开发，并被广泛应用于大数据处理领域。对于初学者来说，了解如何在单机模式下...
hadoop 单机安装配置教程
09-05
以下是一个详细的Hadoop单机安装配置教程。 1. **环境准备**： 在开始安装前，确保你的系统已经安装了Java开发环境（JDK），因为Hadoop依赖Java运行。你需要设置好`JAVA_HOME`环境变量，指向JDK的安装路径。 2. *...
hadoop单机版安装教程
05-07
下面将详细介绍Hadoop单机版的安装步骤及相关知识点。 1. **系统要求** 在开始安装前，确保你的操作系统是Linux或Windows，并且有足够的硬盘空间，至少8GB。推荐使用64位系统，因为Hadoop不支持32位。对于Linux，...
Hadoop单机伪分布式安装
03-20
Hadoop单机伪分布式安装 Hadoop 是一个开源的大数据处理框架，由 Apache 软件基金会开发和维护。Hadoop 的核心组件包括 HDFS（Hadoop Distributed File System）、MapReduce 和 YARN（Yet Another Resource ...
单机Hadoop配置安装
04-06
单机配置hadoop的详细教程,,亲自实验后发布,包教包会,你值得拥有
hadoop组件的安装（单机）
qq_61476788的博客
12-25 609
hadoop单机安装
单机模式的hadoop安装
qq_46073104的博客
07-20 1630
单机模式下的hadoop安装
单机安装hadoop
u013385018的专栏
06-14 968
一、安装Java在安装 hadoop 之前，请确保你的系统上安装了 Java。使用java -version命令检查已安装 Java 的版本。 查看java 路径，要记住该路径，后面配置hadoop时会用到二、安装hadoop1.创建用于 hadoop 安装的系统帐户hadoop[root@localhost ~]# useradd hadoop[root@localhost ~]# passwd...
Hadoop单机安装配置 图文保姆级教程—保姆级配置教程—全网最全[官方手册版]
m0_63324772的博客
05-11 1209
Hadoop单机安装配置图文保姆级教程—全网最全 一、安装前需要 1.VMware安装配置： 2.相关Hadoop软件包下载 3.Ubuntu镜像下载 二、Ubuntu系统安装 前提声明：已安装可忽略此步（但要有远程传输VMwareTools，和英文版的Ubuntu） 三、Hadoop单机+伪分布式配置 1.更新apt 2.安装Vim 3.安装SSH 4.配置SSH无密码登陆 5.安装Java环境 6.安装Hadoop 7.单机配置（非分布式）
Hadoop单机环境安装
2301_77657960的博客
05-03 744
至少1个以上的Linux系统，例如centos7、Ubuntu。
Hadoop 单机安装
RETURN100ERRORS的博客
09-01 496
**前提:**确保JDK环境已经配置好 步骤： 1、 下载并配置环境，本文默认安装目录 /opt/apps 配置安装目录并下载hadoop # 创建apps目录 mkdir /opt/apps # 进入该路径 cd /opt/apps # 下载hadoop压缩包 wget http://archive.apache.org/dist/hadoop/core/hadoop-2.9.2/hadoop-2.9.2.tar.gz 解压并配置环境变量 # 解压hadoop压缩包 tar -zxvf hadoop-2
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值