hive2.1.0+mysql5.1本地模式+Hadoop完全分布式集群的安装与配置

1. 下载hive等
2. 配置部署
   2.1 配置环境变量
   2.2 在HDFS上创建相关目录
   2.3 修改hive-site.xml
   2.4 修改 hive-log4j2.properties和hive-exec-log4j2.properties
   2.5 mysql中创建相关内容
   2.6 使用schematool初始化
3. 启动hive

前提:已安装好MySQL,hadoop能够启动后jps进程中至少存在以下6个进程:
DataNode
Jps
NodeManager
NameNode
ResourceManager
SecondaryNameNode
系统环境:主节点master:172.16.77.98
分节点slave:172.16.77.94,172.16.77.95,172.16.77.97
MySQL安装在master上,hive也下载安装在master上.

1.下载hive

[yqzhou@groot-sm ~]$ wget http://mirrors.cnnic.cn/apache/hive/hive-2.1.0/apache-hive-2.1.0-bin.tar.gz
//解压hive包
[yqzhou@groot-sm ~]$ tar -zxf apache-hive-2.1.0-bin.tar.gz

//建立软链接
[yqzhou@groot-sm ~]$ ln -s apache-hive-2.1.0-bin hive

[yqzhou@groot-sm ~]$ ls
apache-hive-2.1.0-bin
apache-hive-2.1.0-bin.tar.gz
hadoop-2.6.4
hive -> apache-hive-2.1.0-bin
soft

//下载jdbc
[yqzhou@groot-sm ~]$ wget http://cdn.mysql.com/Downloads/Connector-J/mysql-connector-java-5.1.39.tar.gz

//解压
[yqzhou@groot-sm ~]$ tar xzvf mysql-connector-java-5.1.36.tar.gz

//解压后的文件目录
[yqzhou@groot-sm soft]$ cd mysql-connector-java-5.1.39

[yqzhou@groot-sm mysql-connector-java-5.1.39]$ ll

total 1448
-rw-r–r–. 1 yqzhou yqzhou 90721 May 4 19:11 build.xml
-rw-r–r–. 1 yqzhou yqzhou 239747 May 4 19:11 CHANGES
-rw-r–r–. 1 yqzhou yqzhou 18122 May 4 19:11 COPYING drwxr-xr-x. 2 yqzhou yqzhou 4096 Aug 8 10:50 docs
-rw-r–r–. 1 yqzhou yqzhou 989497 May 4 19:11 mysql-connector-java-5.1.39-bin.jar
-rw-r–r–. 1 yqzhou yqzhou 61407 May 4 19:11 README
-rw-r