hive-1.1.0-cdh5.16.2部署

                             hive-1.1.0-cdh5.16.2部署

 

一.下载

      [hadoop@xkhadoop app]$ wget http://archive.cloudera.com/cdh5/cdh/5/hive-1.1.0-cdh5.16.2.tar.gz

从cloudera公司给的地址下载

 

二.解压和配置文件

[hadoop@xkhadoop software]$ tar -xzvf hive-1.1.0-cdh5.16.2.tar.gz -C ~/app/

[hadoop@xkhadoop app]$ cd ~/software/
[hadoop@xkhadoop software]$ cd ~/app/
[hadoop@xkhadoop app]$ ll
总用量 0
lrwxrwxrwx.  1 hadoop hadoop  22 11月 29 22:42 hadoop -> hadoop-2.6.0-cdh5.16.2
drwxr-xr-x. 15 hadoop hadoop 253 11月 29 23:07 hadoop-2.6.0-cdh5.16.2
drwxr-xr-x. 11 hadoop hadoop 197 6月   3 2019 hive-1.1.0-cdh5.16.2

[hadoop@xkhadoop app]$ cd hive-1.1.0-cdh5.16.2/
[hadoop@xkhadoop hive-1.1.0-cdh5.16.2]$ ll
总用量 416
drwxr-xr-x. 2 hadoop hadoop     48 6月   3 2019 auxlib
drwxr-xr-x. 3 hadoop hadoop    119 6月   3 2019 bin
drwxr-xr-x. 2 hadoop hadoop    179 6月   3 2019 conf
drwxr-xr-x. 3 hadoop hadoop     21 6月   3 2019 data
drwxr-xr-x. 6 hadoop hadoop    110 6月   3 2019 docs
drwxr-xr-x. 4 hadoop hadoop     34 6月   3 2019 examples
drwxr-xr-x. 7 hadoop hadoop     68 6月   3 2019 hcatalog
drwxr-xr-x. 4 hadoop hadoop   8192 6月   3 2019 lib
-rw-r--r--. 1 hadoop hadoop  24754 6月   3 2019 LICENSE
-rw-r--r--. 1 hadoop hadoop    397 6月   3 2019 NOTICE
-rw-r--r--. 1 hadoop hadoop   4048 6月   3 2019 README.txt
-rw-r--r--. 1 hadoop hadoop 376416 6月   3 2019 RELEASE_NOTES.txt
drwxr-xr-x. 3 hadoop hadoop     23 6月   3 2019 scripts

[hadoop@xkhadoop hive-1.1.0-cdh5.16.2]$ cd conf/
[hadoop@xkhadoop conf]$ ll
总用量 20
-rw-r--r--. 1 hadoop hadoop 1196 6月   3 2019 beeline-log4j.properties.template
-rw-r--r--. 1 hadoop hadoop 2378 6月   3 2019 hive-env.sh.template
-rw-r--r--. 1 hadoop hadoop 2662 6月   3 2019 hive-exec-log4j.properties.template
-rw-r--r--. 1 hadoop hadoop 3505 6月   3 2019 hive-log4j.properties.template
-rw-r--r--. 1 hadoop hadoop 2060 6月   3 2019 ivysettings.xml

修改配置文件

[hadoop@xkhadoop conf]$ vim hive-site.xml

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<configuration>
    <property>
      <name>javax.jdo.option.ConnectionURL</name>
      <value>jdbc:mysql://xkhadoop:3306/hive?createDatabaseIfNotExist=true</value>
    </property>
    
    <property>
      <name>javax.jdo.option.ConnectionDriverName</name>
      <value>com.mysql.jdbc.Driver</value>
    </property>

    <property>
      <name>javax.jdo.option.ConnectionUserName</name>
      <value>root</value>
    </property>

    <property>
      <name>javax.jdo.option.ConnectionPassword</name>
      <value>123456</value>
    </property>
    
    <property>
        <name>hive.cli.print.current.db</name>
        <value>true</value>
    </property>
    
    <property>
        <name>hive.cli.print.header</name>
        <value>true</value>
    </property>
</configuration>    

三.因为hive中缺少MySQL的jar所以需要下载MySQL的驱动，然后把驱动放进HIVE_HOME/lib下面

[hadoop@xkhadoop conf]$ cd ../lib/
[hadoop@xkhadoop lib]$ wget https://repo1.maven.org/maven2/mysql/mysql-connector-java/5.1.27/mysql-connector-java-5.1.27.jar

四.配置软连接和环境变量

[hadoop@xkhadoop app]$ ln -s hive-1.1.0-cdh5.16.2 hive

[hadoop@xkhadoop ~]$ vim .bashrc 

export HIVE_HOME=/home/hadoop/app/hive
export PATH=$HIVE_HOME/bin:$PATH

[hadoop@xkhadoop ~]$ source .bashrc 

[hadoop@xkhadoop ~]$ which hive
~/app/hive/bin/hive

五.启动hive

先启动Hadoop

[hadoop@xkhadoop ~]$ start-all.sh 
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
19/12/16 20:39:49 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [xkhadoop]
xkhadoop: starting namenode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.16.2/logs/hadoop-hadoop-namenode-xkhadoop.out
xkhadoop: starting datanode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.16.2/logs/hadoop-hadoop-datanode-xkhadoop.out
Starting secondary namenodes [xkhadoop]
xkhadoop: starting secondarynamenode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.16.2/logs/hadoop-hadoop-secondarynamenode-xkhadoop.out
19/12/16 20:40:06 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.16.2/logs/yarn-hadoop-resourcemanager-xkhadoop.out
xkhadoop: starting nodemanager, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.16.2/logs/yarn-hadoop-nodemanager-xkhadoop.out

启动HIVE

[hadoop@xkhadoop ~]$ hive