mysql安装&cloudera安装

mysql-5.7.21-1.el6.x86_64.rpm-bundle.tar安装到centos6.5

 

-rw-r--r-- 1 root root  472760320 Aug  3 20:14 mysql-5.7.21-1.el6.x86_64.rpm-bundle.tar
-rw-r--r-- 1 7155 31415  23850100 Dec 28  2017 mysql-community-client-5.7.21-1.el6.x86_64.rpm
-rw-r--r-- 1 7155 31415    337036 Dec 28  2017 mysql-community-common-5.7.21-1.el6.x86_64.rpm
-rw-r--r-- 1 7155 31415   3721376 Dec 28  2017 mysql-community-devel-5.7.21-1.el6.x86_64.rpm
-rw-r--r-- 1 7155 31415  39214116 Dec 28  2017 mysql-community-embedded-5.7.21-1.el6.x86_64.rpm
-rw-r--r-- 1 7155 31415 136516836 Dec 28  2017 mysql-community-embedded-devel-5.7.21-1.el6.x86_64.rpm
-rw-r--r-- 1 7155 31415   2177444 Dec 28  2017 mysql-community-libs-5.7.21-1.el6.x86_64.rpm
-rw-r--r-- 1 7155 31415   1723492 Dec 28  2017 mysql-community-libs-compat-5.7.21-1.el6.x86_64.rpm
-rw-r--r-- 1 7155 31415 159856456 Dec 28  2017 mysql-community-server-5.7.21-1.el6.x86_64.rpm
-rw-r--r-- 1 7155 31415 105350080 Dec 28  2017 mysql-community-test-5.7.21-1.el6.x86_64.rpm

操作系统本身会有低版本的mysql-libs-5.1.73-3.el6_5.x86_64影响，首先卸载掉

yum erase mysql-libs
然后再

yum localinstall mysql-community-common-5.7.21-1.el6.x86_64.rpm  mysql-community-server-5.7.21-1.el6.x86_64.rpm mysql-community-client-5.7.21-1.el6.x86_64.rpm mysql-community-libs-5.7.21-1.el6.x86_64.rpm  mysql-community-devel-5.7.21-1.el6.x86_64.rpm mysql-community-libs-compat-5.7.21-1.el6.x86_64.rpm

yum erase mariadb-libs    (centos7.3安装)

yum localinstall mysql-community-common-5.7.22-1.el7.x86_64.rpm mysql-community-server-5.7.22-1.el7.x86_64.rpm mysql-community-client-5.7.22-1.el7.x86_64.rpm mysql-community-libs-5.7.22-1.el7.x86_64.rpm mysql-community-devel-5.7.22-1.el7.x86_64.rpm mysql-community-libs-compat-5.7.22-1.el7.x86_64.rpm

第一次启动

[root@cdhsit01 ~]# /etc/init.d/mysqld start
Initializing MySQL database:                               [  OK  ]
Starting mysqld:                                           [  OK  ]
[root@cdhsit01 ~]# 

找到密码，第一次启动是随机密码，会放在log文件里，

[root@cdhsit01 log]# grep pass /var/log/mysqld.log 
2018-08-04T16:00:39.241550Z 1 [Note] A temporary password is generated for root@localhost: Xh#o>eTwX8s2
2018-08-04T16:00:55.033225Z 2 [Note] Access denied for user 'UNKNOWN_MYSQL_USER'@'localhost' (using password: NO)

第一次登陆进去，必须要改root密码，密码不能为弱口令

mysql> SET PASSWORD FOR 'root'@'localhost' = PASSWORD('1qaz@WSX');
设置远程登陆方法，%表示可以在任何机器远程登陆到本台mysql

grant all on *.*  此处都是 * 号，若是root.*   则是没有权限

grant all on *.* TO 'root'@'localhost' IDENTIFIED BY 'root';
grant all on *.* TO 'root'@'172.16.0.0/255.255.0.0' IDENTIFIED BY 'root';

grant all on *.* TO 'root'@'%' IDENTIFIED BY '1qaz@WSX';
FLUSH PRIVILEGES;

+-----------+---------------+-------------+-------------+-------------+-------------+-------------+-----------+-------------+---------------+--------------+-----------+------------+-----------------+------------+------------+--------------+------------+-----------------------+------------------+--------------+-----------------+------------------+------------------+----------------+---------------------+--------------------+------------------+------------+--------------+------------------------+----------+------------+-------------+--------------+---------------+-------------+-----------------+----------------------+-----------------------+-------------------------------------------+------------------+-----------------------+-------------------+----------------+
| Host      | User          | Select_priv | Insert_priv | Update_priv | Delete_priv | Create_priv | Drop_priv | Reload_priv | Shutdown_priv | Process_priv | File_priv | Grant_priv | References_priv | Index_priv | Alter_priv | Show_db_priv | Super_priv | Create_tmp_table_priv | Lock_tables_priv | Execute_priv | Repl_slave_priv | Repl_client_priv | Create_view_priv | Show_view_priv | Create_routine_priv | Alter_routine_priv | Create_user_priv | Event_priv | Trigger_priv | Create_tablespace_priv | ssl_type | ssl_cipher | x509_issuer | x509_subject | max_questions | max_updates | max_connections | max_user_connections | plugin                | authentication_string                     | password_expired | password_last_changed | password_lifetime | account_locked |
+-----------+---------------+-------------+-------------+-------------+-------------+-------------+-----------+-------------+---------------+--------------+-----------+------------+-----------------+------------+------------+--------------+------------+-----------------------+------------------+--------------+-----------------+------------------+------------------+----------------+---------------------+--------------------+------------------+------------+--------------+------------------------+----------+------------+-------------+--------------+---------------+-------------+-----------------+----------------------+-----------------------+-------------------------------------------+------------------+-----------------------+-------------------+----------------+
| localhost | root          | Y           | Y           | Y           | Y           | Y           | Y         | Y           | Y             | Y            | Y         | Y          | Y               | Y          | Y          | Y            | Y          | Y                     | Y                | Y            | Y               | Y                | Y                | Y              | Y                   | Y                  | Y                | Y          | Y            | Y                      |          |            |             |              |             0 |           0 |               0 |                    0 | mysql_native_password | *58319282EAB9E38D49CA25844B73DA62C80C2ABC | N                | 2018-08-05 00:05:02   |              NULL | N              |
| localhost | mysql.session | N           | N           | N           | N           | N           | N         | N           | N             | N            | N         | N          | N               | N          | N          | N            | Y          | N                     | N                | N            | N               | N                | N                | N              | N                   | N                  | N                | N          | N            | N                      |          |            |             |              |             0 |           0 |               0 |                    0 | mysql_native_password | *THISISNOTAVALIDPASSWORDTHATCANBEUSEDHERE | N                | 2018-08-05 00:00:48   |              NULL | Y              |
| localhost | mysql.sys     | N           | N           | N           | N           | N           | N         | N           | N             | N            | N         | N          | N               | N          | N          | N            | N          | N                     | N                | N            | N               | N                | N                | N              | N                   | N                  | N                | N          | N            | N                      |          |            |             |              |             0 |           0 |               0 |                    0 | mysql_native_password | *THISISNOTAVALIDPASSWORDTHATCANBEUSEDHERE | N                | 2018-08-05 00:00:48   |              NULL | Y              |
| %         | root          | N           | N           | N           | N           | N           | N         | N           | N             | N            | N         | N          | N               | N          | N          | N            | N          | N                     | N                | N            | N               | N                | N                | N              | N                   | N                  | N                | N          | N            | N                      |          |            |             |              |             0 |           0 |               0 |                    0 | mysql_native_password | *58319282EAB9E38D49CA25844B73DA62C80C2ABC | N                | 2018-08-05 00:08:26   |              NULL | N              |
+-----------+---------------+-------------+-------------+-------------+-------------+-------------+-----------+-------------+---------------+--------------+-----------+------------+-----------------+------------+------------+--------------+------------+-----------------------+------------------+--------------+-----------------+------------------+------------------+----------------+---------------------+--------------------+------------------+------------+--------------+------------------------+----------+------------+-------------+--------------+---------------+-------------+-----------------+----------------------+-----------------------+-------------------------------------------+------------------+-----------------------+-------------------+----------------+
4 rows in set (0.00 sec)

安装cm5.12.0

1.配置cm的yum源，安装yum install cloudera-server，安装cm指定jdk
2.将mysql-connector-java-5.1.32-bin.jar更名mysql-connector-java.jar，放入/usr/share/java
3.准备mysql，运行脚本
scm_prepare_database.sh 数据库类型  数据库 服务器 用户名 密码  --scm-host  Cloudera_Manager_Server所在的机器
/usr/share/cmf/schema/scm_prepare_database.sh mysql scm  -hlocalhost -uroot -p1qaz@WSX  --scm-host localhost scm 1qaz@WSX scm

安装，需要安装cloudera自带的jdk，否则服务起不来

yum install cloudera-manager-daemons cloudera-manager-server enterprise-debuginfo jdk

cloudera-cm更换jdk1.8，将jdk1.8 放到  /usr/java/jdk1.8.0_144  ，系统会自动识别到java，cloudera自带的jdk1.6 oracle-java1.7都不需要装了

CREATE USER oozie IDENTIFIED BY '1qaz@WSX';
create database oozie;
grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY '1qaz@WSX';
FLUSH PRIVILEGES;

CREATE USER hive IDENTIFIED BY '1qaz@WSX';
create database hive;
grant all on hive.* TO 'hive'@'%' IDENTIFIED BY '1qaz@WSX';
FLUSH PRIVILEGES;

CREATE USER hue IDENTIFIED BY '1qaz@WSX';
create database hue;
grant all on hue.* TO 'hue'@'%' IDENTIFIED BY '1qaz@WSX';
FLUSH PRIVILEGES;

补充

当cm使用远程的MySQL（mysql-5.7.30-1.el7.x86_64.rpm-bundle.tar）时，(可能是由于MySQL版本所导致) 在给root赋权 赋远程访问权时 

grant all on *.* TO 'root'@'%' IDENTIFIED BY '1qaz@WSX';
FLUSH PRIVILEGES;
可以查询 select * from mysql.user;表时 可以看到 ，不是所有权限都是 Y

mysql> select user,host,grant_priv from user;
+---------------+-----------+------------+
| user          | host      | grant_priv |
+---------------+-----------+------------+
| root          | localhost | Y          |
| root          | %         | N          |
+---------------+-----------+------------+
6 rows in set (0.00 sec)

其中 在远程访问mysql 给其他用户赋权的权限 是没有的
所以在使用root远程访问MySQL执行命令
grant all on scm.* TO 'scm'@'%' IDENTIFIED BY 'bigdata';
会失败的，显示没有权限,所以执行
/usr/share/cmf/schema/scm_prepare_database.sh mysql -h1.1.1.1.1 -uroot -pRoot@1234 --scm-host 10.249.4.5 scm scm bigdata 会失败的, 假如 cm 和MySQL在同一台机器  就没有这个问题

修改赋权

mysql> update user set grant_priv='Y' where user='root';
Query OK, 1 row affected (0.00 sec)
Rows matched: 2  Changed: 1  Warnings: 0

mysql> flush privileges;   //  一定要执行,感觉好像是将更改的数据刷到内存
Query OK, 0 rows affected (0.03 sec)

然年执行

/usr/share/cmf/schema/scm_prepare_database.sh mysql -h1.1.1.1.1 -uroot -pRoot@1234 --scm-host 10.249.4.5 scm scm bigdata

正常会有如下提示：

All done, your SCM database is configured correctly!

此时MySQL库中，还是没有表的，只是把库和用户建好了

systemctl start cloudera-scm-server  启动后 才会有表存在

此时又出现一个问题，在启动时，日志中出现 找不到 JAVA_HOME ，

在 /etc/profile 中有

export JAVA_HOME=/usr/local/java
export PATH=$JAVA_HOME/bin:$PATH

echo $JAVA_HOME也是正常的，直接输入java 也是正常的。不知道什么原因

最后在 /etc/init.d/cloudera-scm-server 中增加 export JAVA_HOME=/usr/local/java
export PATH=$JAVA_HOME/bin:$PATH 后 启动就正常了