vmware workstation 搭建hadoop

最新推荐文章于 2023-09-16 12:11:39 发布

howsoever

最新推荐文章于 2023-09-16 12:11:39 发布

阅读量818

点赞数

分类专栏： hadoop

本文链接：https://blog.csdn.net/howsoever/article/details/79477141

版权

hadoop 专栏收录该内容

3 篇文章 0 订阅

订阅专栏

1.https://www.vmware.com/cn/products/workstation-pro/workstation-pro-evaluation.html

下载Workstation 14 Pro for Windows

2.https://www.centos.org/download/ 下载centos 7 dvd iso

3.安装虚拟机

4.复制虚拟机

5.http://blog.csdn.net/howsoever/article/details/79459936 按照步骤布置hadoop

遇到的问题

1.以hadoop身份建立目录，注意权限问题

2.配置不对，可以先删除/home/hadoop/app/hadoop/hdfs和/home/hadoop/app/hadoop/tmp

3.注意配置好hostname,centos 7 配置hostname参考https://segmentfault.com/q/1010000004684175

4.注意java环境的搭建

http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html下载jdk 8

 rmp -ivh jdk-8u161-linux-x64.rpm

以下为/etc/profile的配置

     1  # /etc/profile

     2  # System wide environment and startup programs, for login setup
     3  # Functions and aliases go in /etc/bashrc

     4  # It's NOT a good idea to change this file unless you know what you
     5  # are doing. It's much better to create a custom.sh shell script in
     6  # /etc/profile.d/ to make custom changes to your environment, as this
     7  # will prevent the need for merging in future updates.

     8  pathmunge () {
     9      case ":${PATH}:" in
    10          *:"$1":*)
    11              ;;
    12          *)
    13              if [ "$2" = "after" ] ; then
    14                  PATH=$PATH:$1
    15              else
    16                  PATH=$1:$PATH
    17              fi
    18      esac
    19  }


    20  if [ -x /usr/bin/id ]; then
    21      if [ -z "$EUID" ]; then
    22          # ksh workaround
    23          EUID=`/usr/bin/id -u`
    24          UID=`/usr/bin/id -ru`
    25      fi
    26      USER="`/usr/bin/id -un`"
    27      LOGNAME=$USER
    28      MAIL="/var/spool/mail/$USER"
    29  fi

    30  # Path manipulation
    31  if [ "$EUID" = "0" ]; then
    32      pathmunge /usr/sbin
    33      pathmunge /usr/local/sbin
    34  else
    35      pathmunge /usr/local/sbin after
    36      pathmunge /usr/sbin after
    37  fi

    38  HOSTNAME=`/usr/bin/hostname 2>/dev/null`
    39  HISTSIZE=1000
    40  if [ "$HISTCONTROL" = "ignorespace" ] ; then
    41      export HISTCONTROL=ignoreboth
    42  else
    43      export HISTCONTROL=ignoredups
    44  fi

    45  export PATH USER LOGNAME MAIL HOSTNAME HISTSIZE HISTCONTROL

    46  # By default, we want umask to get set. This sets it for login shell
    47  # Current threshold for system reserved uid/gids is 200
    48  # You could check uidgid reservation validity in
    49  # /usr/share/doc/setup-*/uidgid file
    50  if [ $UID -gt 199 ] && [ "`/usr/bin/id -gn`" = "`/usr/bin/id -un`" ]; then
    51      umask 002
    52  else
    53      umask 022
    54  fi

    55  for i in /etc/profile.d/*.sh ; do
    56      if [ -r "$i" ]; then
    57          if [ "${-#*i}" != "$-" ]; then
    58              . "$i"
    59          else
    60              . "$i" >/dev/null
    61          fi
    62      fi
    63  done

    64  unset i
    65  unset -f pathmunge
    66  JAVA_HOME=/usr/java/jdk1.8.0_161
    67  JRE_HOME=/usr/java/jdk1.8.0_161/jre
    68  HADOOP_HOME=/home/hadoop/app/hadoop/hadoop-2.7.5
    69  PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
    70  export PATH

开启