一、概念
二、安装、配置
- Hive安装模式分为嵌入模式、本地模式、远程模式三种模式
- 嵌入模式:Hive将元信息存储到derby数据库中。它只能创建一个连接,同一时间只能一个人操作Hive
- 本地模式:Hive将元信息储存在Mysql数据库中。Mysql数据库与Hive运行在同一台物理机器上,支持多个连接,多用于开发和测试
- 远程模式:Hive将元信息储存在Mysql数据库中。Mysql数据库与Hive运行在不同的物理机器上,多用于生产环境
- 准备
apache-hive-1.2.1-bin.tar.gz安装包,下载地址:http://apache.fayea.com/hive/hive-1.2.1/
将hive安装包上传至linux的root目录下
- 安装
解压安装,tar zxvf apache-hive-1.2.1.tar.gz
建立软链接,ln -sf /root/apache-hive-1.2.1-bin /home/hive
- 配置
cd /home/hive/conf目录
cp hive-default.xml.template hive-site.xml
配置环境变量
vim /etc/profile
source /etc/profileexport HIVE_INSTALL=/home/hive export PATH=$PATH:$HIVE_INSTALL/bin
- 启动hive,成功!
三、安装关系型数据库MySQL
- 通过查看hive/conf/hive-site.xml,hive自带的关系型数据库是derby,这种数据库不稳定
<property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:derby:;databaseName=metastore_db;create=true</value> <description>JDBC connect string for a JDBC metastore</description> </property>
- 安装mysql数据库
启动yum install mysql-server
登入mysqlservice mysqld start
如果报错:ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: NO)mysql -uroot -p
解决办法:http://blog.csdn.net/alex_bean/article/details/51543097 - 加入mysql驱动jar包:mysql-connector-java-5.1.38-bin.jar
复制到hive的lib目录内:cp -a mysql-connector-java-5.1.38-bin.jar /home/hive/lib/ - 进入conf目录,创建hive-site.xml文件,添加如下内容
保存退出<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://node1:3306/hive</value> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>root</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>sp6161266</value> </property> </configuration>
确认mysql数据库hive,确认hadoop启动
启动hive
四、常见异常
[root@node1 bin]# hive Logging initialized using configuration in jar:file:/root/apache-hive-1.2.1-bin/lib/hive-common-1.2.1.jar!/hive-log4j.properties Exception in thread "main" java.lang.RuntimeException: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D at org.apache.hadoop.fs.Path.initialize(Path.java:206) at org.apache.hadoop.fs.Path.<init>(Path.java:172) at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:563) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:508) ... 7 more Caused by: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D at java.net.URI.checkPath(URI.java:1804) at java.net.URI.<init>(URI.java:752) at org.apache.hadoop.fs.Path.initialize(Path.java:203) ... 10 more
解决办法:
vim conf/hive-site.xml,增加下面两项配置内容
<property> <name>system:java.io.tmpdir</name> <value>/opt/hive/tmpdir</value> </property> <property> <name>system:user.name</name> <value>username</value> </property>
- 异常二
[root@node1 lib]# hive Logging initialized using configuration in jar:file:/root/apache-hive-1.2.1-bin/lib/hive-common-1.2.1.jar!/hive-log4j.properties [ERROR] Terminal initialization failed; falling back to unsupported java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected at jline.TerminalFactory.create(TerminalFactory.java:101) at jline.TerminalFactory.get(TerminalFactory.java:158) at jline.console.ConsoleReader.<init>(ConsoleReader.java:229) at jline.console.ConsoleReader.<init>(ConsoleReader.java:221) at jline.console.ConsoleReader.<init>(ConsoleReader.java:209) at org.apache.hadoop.hive.cli.CliDriver.setupConsoleReader(CliDriver.java:787) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:721) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Exception in thread "main" java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected at jline.console.ConsoleReader.<init>(ConsoleReader.java:230) at jline.console.ConsoleReader.<init>(ConsoleReader.java:221) at jline.console.ConsoleReader.<init>(ConsoleReader.java:209) at org.apache.hadoop.hive.cli.CliDriver.setupConsoleReader(CliDriver.java:787) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:721) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
解决办法:
原因是hadoop目录下存在老版本jline:
进入hadoop存在jline的目录 cd /home/hadoop-2.5/share/hadoop/yarn/lib/ 将hive的最新版jline替换掉hadoop的旧版jline cp /home/hive/lib/jline-2.12.jar ./ 删除或改名字旧版jline的jar包 mv jline-0.9.94.jar jline-0.9.94.jar-bak