lLinux安装CM

一：安装jdk

二：安装MySQL 登录mysql mysql -uroot -proot

1.下载文件：D:\bigdata\大数据\Jar\Mysql  上传到Linux的opt文件夹中。

    和Linux上传文件：yum install lrzsz

2.卸载：判断是否以前有安装过

3.安装：rpm -ivh MySQL-client-5.5.54-1.linux2.6.x86_64.rpm

               rpm -ivh MySQL-server-5.5.54-1.linux2.6.x86_64.rpm

如果出现package mariadb-libs冲突，因此先把mariadb-libs卸载再重新安装yum -y remove mariadb-libs-1:5.5.44-*

4.设置密码：mysql本身没有密码，首先启动服务service mysql start，设置密码：mysqladmin -u root password 'root'

5.登录mysql:mysql -uroot -proot;   show databases;  安装成功！

 

三：关闭SELINUX

1. 临时关闭：三台都关闭，降低安全级别

setenforce 0

1. 修改配置文件/etc/selinux/config（重启生效）

将SELINUX=enforcing 改为SELINUX=disabled

 

配置hosts

https://jingyan.baidu.com/article/9f7e7ec06cd5e72e281554e7.html
vim /etc/hosts
10.90.17.84 hadoop1
10.90.17.82 hadoop2
10.90.17.89 hadoop3
/etc/init.d/network restart

 

四：配置免密登录

        1.ssh-keygen -t rsa。存放地址：(/root/.ssh/id_rsa): 三个enter

         2.进入/root/.ssh/id_rsa，将公用密钥放到目标的机器上

           ssh-copy-id 10.90.17.89

           ssh-copy-id 10.90.17.82

           ssh-copy-id 10.90.17.84

         3.进入/root/.ssh/id_rsa，在另外的两台机器上做同样的配置

 

五：创建CM

        

1.6 下载第三方依赖

在三台节点（所有agent的节点）上执行下载第三方依赖

yum -y install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb httpd mod_ssl

1.7 创建CM用的数据库：

（1）集群监控数据库

create database amon DEFAULT CHARSET utf8 COLLATE utf8_general_ci;

（2）hive数据库 

create database hive DEFAULT CHARSET utf8 COLLATE utf8_general_ci;

（3）oozie数据库

create database oozie DEFAULT CHARSET utf8 COLLATE utf8_general_ci;

（4）hue数据库

create database hue DEFAULT CHARSET utf8 COLLATE utf8_general_ci;

 

create database cm DEFAULT CHARSET utf8 COLLATE utf8_general_ci;

第3章 CM安装部署

CM下载地址：http://archive.cloudera.com/cm5/cm/5/

离线库下载地址：http://archive.cloudera.com/cdh5/parcels

 

注：以下所有操作均使用root用户

2.1 解压cloudera-manager-centos7-cm5.12.1_x86_64.tar.gz

[root@hadoop102 module]# mkdir /opt/

[root@hadoop102 module]# tar -zxvf /opt/software/cloudera-manager-el6-cm5.12.1_x86_64.tar.gz -C /opt/

下载虚拟机对应版本的

2.2 创建用户cloudera-scm（所有节点）

[root@hadoop102 cloudera-scm-server]# useradd --system --home=/opt/cloudera-manager/cm-5.12.1/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

 

--system 创建一个系统账户

--home 指定用户登入时的主目录，替换系统默认值/home/<用户名>

--no-create-home 不要创建用户的主目录

--shell 用户的登录 shell 名

--comment 用户的描述信息

 mv CDH* /opt/cloudera/parcel-repo/
mv manifest.json /opt/cloudera/parcel-repo/

 cd /opt/cloudera/parcel-repo

mv CDH-5.1.2-1.cdh5.1.2.p0.3-el6.parcel.sha1 CDH-5.1.2-1.cdh5.1.2.p0.3-el6.parcel.sha

useradd --system --home=/opt/cloudera-manager/cm-5.12.1/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

  chown -R cloudera-scm:cloudera-scm c*

进入：cm-5.12.1/etc /cloudera-scm-agent/vim config.ini

把localhost改成主虚拟机IP

2.3 配置CM Agent

修改文件/opt/module/cloudera-manager/cm-5.12.1/etc/cloudera-scm-agent/ config.ini

[root@hadoop102 cloudera-scm-agent]# vim /opt/cloudera-manager/cm-5.12.1/etc/cloudera-scm-agent/config.ini

server_host=hadoop102

 

 

2.4 配置CM的数据库

1. 拷贝mysql jar文件到目录 /usr/share/java/   java渠道默认的地址

[root@hadoop102 share]# mkdir /bigdata/mysql-connection---把驱动拷贝过去mysql-connector-java-5.1.27-bin.jar

[root@cp-centos mysql-connection]# mkdir /usr/share/java/

[root@hadoop102 cm-5.12.1]# cp /bigdata/mysql-connection/mysql-connector-java-5.1.46-bin.jar /usr/share/java/

[root@hadoop102 share]# mv /usr/share/java/mysql-connector-java-5.1.46-bin.jar /usr/share/java/mysql-connector-java.jar

2.5 在mysql中创建cm库

[root@hadoop102 cm-5.12.1]#cd  /opt /cm-5.12.1/share/cmf/schema

运行：/opt/cm-5.12.1/share/cmf/schema/./scm_prepare_database.sh mysql cm -h hadoop1 -uroot -proot --scm-host hadoop1 scm scm scm

进入MySQL配置远程连接

grant all privileges on *.* to 'root'@'10.90.17.84' identified by 'root' with grant option;
grant all privileges on *.* to 'root'@'10.90.17.82' identified by 'root' with grant option;
grant all privileges on *.* to 'root'@'10.90.17.89' identified by 'root' with grant option;
grant all privileges on *.* to 'root'@'%' identified by 'root' with grant option;

grant all privileges on *.* to 'scm'@'10.90.17.84' identified by 'scm' with grant option;
grant all privileges on *.* to 'scm'@'10.90.17.82' identified by 'scm' with grant option;
grant all privileges on *.* to 'scm'@'10.90.17.89' identified by 'scm' with grant option;
grant all privileges on *.* to 'scm'@'%' identified by 'scm' with grant option;

mysql>use mysql;
mysql>desc user;
mysql>GRANT ALL PRIVILEGES ON *.* TO root@"%" IDENTIFIED BY "root";　　//为root添加远程连接的能力。
mysql>update user set Password = password('root') where User='root';
mysql>select Host,User,Password  from user where User='root';
mysql>flush privileges;
mysql>exit

grant all privileges on *.* to'scm'@'%' identified by 'scm' with grant option;
/opt/cm-5.12.1/share/cmf/schema/scm_prepare_database.sh mysql cm -hhadoop1 -uroot -phadoop --scm-host 10.90.17.84  scm scm scm

如果有如下错误： Invalid user name or database name. DB Name: cm -hhadoop1 User Name:  scm. Database name and user name can only have alphanumeric characters and _  修改密码就

 

分发
  scp -r /opt/cm-5.12.1 root@10.90.17.82:/opt
  scp -r /opt/cm-5.12.1 root@10.90.17.89:/opt
在主节点上启动服务
进入opt
./cm-5.12.1/etc/init.d/cloudera-scm-server start  或者 /opt/cm-5.12.1/etc/init.d/cloudera-scm-server start
查看是否启动成功7180端口    netstat -lntp

启动有问题：日志，/opt/cm-5.12.1/log/cloudera-scm-server/cloudera-scm-server.out

JDK 问题，需要换回jdk 1.8

启动字节点：/opt/cm-5.12.1/etc/init.d/cloudera-scm-agent start

纪念一下：