ambari hive mysql出错_ambari启动hive metastore 失败

最新推荐文章于 2024-04-21 21:49:32 发布
最新推荐文章于 2024-04-21 21:49:32 发布
阅读量431 收藏
点赞数
文章标签： ambari hive mysql出错
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_36085895/article/details/113269051
版权

报错信息：

Metastore on vmocdp124.test.com failed (Traceback (most recent call last):

File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py", line 183, in execute

timeout=int(check_command_timeout) )

File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__

self.env.run()

File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run

self.run_action(resource, action)

File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 121, in run_action

provider_action()

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 238, in action_run

tries=self.resource.tries, try_sleep=self.resource.try_sleep)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner

result = function(command, **kwargs)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call

tries=tries, try_sleep=try_sleep)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper

result = _call(command, **kwargs_copy)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call

raise Fail(err_msg)

Fail: Execution of 'export HIVE_CONF_DIR='/usr/hdp/current/hive-metastore/conf/conf.server' ; hive --hiveconf hive.metastore.uris=thrift://vmocdp124.test.com:9083 --hiveconf hive.metastore.client.connect.retry.delay=1 --hiveconf hive.metastore.failure.retries=1 --hiveconf hive.metastore.connect.retries=1 --hiveconf hive.metastore.client.socket.timeout=14 --hiveconf hive.execution.engine=mr -e 'show databases;'' returned 1. WARNING: Use "yarn jar" to launch YARN applications.

Logging initialized using configuration in file:/etc/hive/2.4.0.0-169/0/conf.server/hive-log4j.properties

Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:494)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:680)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:624)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:497)

at org.apache.hadoop.util.RunJar.run(RunJar.java:221)

at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient

at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1533)

at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:86)

at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)

at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)

at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3000)

at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3019)

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:475)

... 8 more

Caused by: java.lang.reflect.InvocationTargetException

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:422)

at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1531)

... 14 more

Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused

at org.apache.thrift.transport.TSocket.open(TSocket.java:187)

at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:426)

at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:236)

at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.(SessionHiveMetaStoreClient.java:74)

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:422)

at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1531)

at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:86)

at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)

at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)

at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3000)

at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3019)

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:475)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:680)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:624)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:497)

at org.apache.hadoop.util.RunJar.run(RunJar.java:221)

at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

Caused by: java.net.ConnectException: Connection refused

at java.net.PlainSocketImpl.socketConnect(Native Method)

at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)

at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)

at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)

at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)

at java.net.Socket.connect(Socket.java:589)

at org.apache.thrift.transport.TSocket.open(TSocket.java:182)

... 22 more

)

at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:472)

at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:236)

at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.(SessionHiveMetaStoreClient.java:74)

... 19 more

)

标准错误输出: /var/lib/ambari-agent/data/errors-1312.txt

Traceback (most recent call last):

File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py", line 245, in

HiveMetastore().execute()

File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute

method(env)

File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py", line 58, in start

self.configure(env)

File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py", line 72, in configure

hive(name = 'metastore')

File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk

return fn(*args, **kwargs)

File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py", line 292, in hive

user = params.hive_user

File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__

self.env.run()

File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run

self.run_action(resource, action)

File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 121, in run_action

provider_action()

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 238, in action_run

tries=self.resource.tries, try_sleep=self.resource.try_sleep)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner

result = function(command, **kwargs)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call

tries=tries, try_sleep=try_sleep)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper

result = _call(command, **kwargs_copy)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call

raise Fail(err_msg)

resource_management.core.exceptions.Fail: Execution of 'export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/conf.server ; /usr/hdp/current/hive-metastore/bin/schematool -initSchema -dbType mysql -userName hive -passWord [PROTECTED]' returned 1. WARNING: Use "yarn jar" to launch YARN applications.

Metastore connection URL: jdbc:mysql://vmocdp124.test.com/hive?createDatabaseIfNotExist=true

Metastore Connection Driver : com.mysql.jdbc.Driver

Metastore connection User: hive

org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.

*** schemaTool failed ***

刘保池
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Hive安装：Metastore配置和常见错误处理
O_1CxH的博客
11-28 2494
Hive安装、Metastore配置和常见错误处理 文章目录Hive安装、Metastore配置和常见错误处理1 方法简介2 步骤2.1 安装Hive2.2 安装mysql2.3 在mysql中配置相应用户2.4 配置JDBC支持2.5 在Hive中配置metastore3 常见问题举例3.1 无法创建SessionHiveMetaStoreClient实例3.2 创建事务连接错误3.3 绝对路径中包含相对路径3.4 无法创建目录4 参考 1 方法简介 Hive的本身结构决定了其需要把一部分数据存储在关系数
ambari hive mysql出错_ambari 安装 hive 的时候服务检测失败
weixin_34890108的博客
01-19 197
Metastore on slave1.hadoop failed (Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py", line 183, in execute ti...
ambari下 hive metastore 启动失败
weixin_30788731的博客
03-06 428
由字符集引起的hive 元数据进程启动失败 解决方法新增 这2句话 reload(sys)sys.setdefaultencoding('utf8') 转载于:https://www.cnblogs.com/staryea/p/8514200.html...
ambari离线方式安装Hive不能连接mysql和不能启动hive metastore&hiveserver2
记录点滴
12-01 3399
1，在自己笔记本上离线安装ambari，在搭建Hadoop集群时测试hive连接mysql的连通性，总是连接不上 网上查资料，找到是因为缺少一个配置文件，进入后台在hive-site.xml里添加一个 javax.jdo.option.ConnectionPassword hive在mysql的密码 之后再测试就能连上 2，服务启动时，hive metastore&hives
ambari hive mysql出错_Ambari Hive 无法正常查询 问题分析处理
weixin_39866487的博客
01-19 299
1.今天遇到一个错误，在连接到hive之后，无法执行任何命令。$beeline-u"jdbc:hive2://hostname.domain.cn:10000/default;principal=hive/_HOST@domain.com;"Connectingtojdbc:hive2://hostname.domain.cn:10000/default;principal=hive/_...
ambari安装hive以mysql作为元数据存储建表失败的解决办法
香菇的博客
11-02 1992
这几天项目上线，需要新安装hive在生产环境上，元数据准备就直接用mysql进行存储，因为行内生产环境肯定不能随随便便就安装一个mysql，所有的数据必须由DBA数据中心进行申请操作，所以我们向DBA提交了建库申请，DBA同事也帮我们建好了hive的元数据存储库，继而我们直接在ambari进行傻瓜式安装hive填上了相应的数据库名，用户名，表名等等，测试连接通过，直接next，但是在最后deplo
ambari hive mysql出错_Ambari Hive 无法正常查询的解决
weixin_42184237的博客
01-19 500
1.今天遇到一个错误，在连接到hive之后，无法执行任何命令。$ beeline -u "jdbc:hive2://hostname.domain.cn:10000/default;principal=hive/_HOST@domain.com;"Connecting to jdbc:hive2://hostname.domain.cn:10000/default;principal=hive/_...
ambari hive mysql出错_ambari方式安装hadoop的hive组件遇到的问题
weixin_39769807的博客
01-26 249
最近在部署hadoop，我发现了ambari工具部署hadoop的hive组件的一个问题，不知道其他人遇到过没有。问题描述：通过ambari工具搭建了hadoop2.0完全分布式集群。在测试hive的时候，按照官方文档里的说明通过下面命令检查根目录的时候：总是报错无法连接mysql。(java.sql.SQLException: Access deniedforuser'hive'@'hdb3.y...
ambari hive mysql_基于Ambari的WebUI部署Hive服务
weixin_42298645的博客
01-26 498
基于Ambari的WebUI部署Hive服务作者：尹正杰版权声明：原创作品，谢绝转载！否则将追究法律责任。一.部署Ambari服务博主推荐阅读:https://www.cnblogs.com/yinzhengjie2020/p/12227503.html二.创建Hive的元数据信息1>.MySQL 8.x以上版本需要确认的配置文件密码策略[root@hdp101.yinzhengjie.or...
Ambari部署Hive
最新发布
2401_84123188的博客
04-21 674
光有这些思路和搞懂单个知识的应用是还远远不够的，在Android开源框架设计思想中的知识点还是比较多的，想要搞懂还得学会整理和规划：我们常见的**Android热修复框架、插件化框架、组件化框架、图片加载框架、网络访问框架、RxJava响应式编程框架、IOC依赖注入框架、最近架构组件Jetpack等等Android第三方开源框架，**这些都是属于Android开源框架设计思想的。如下图所示：这位阿里P8大佬针对以上知识点，熬夜整理出了一本长达1042页的完整版如何解读开源框架设计思想。
Ambari下Hive3.0升级到Hive4.0
03-25
在大数据领域，Apache Ambari 是一个用于 Hadoop 集群管理和监控的开源工具，而 Hive 是一个基于 Hadoop 的数据仓库系统，用于处理和分析大规模数据集。本话题聚焦于如何在 Ambari 环境下将 Hive 3.0 升级到 Hive ...
Ambari安装Hive组件
weixin_43943841的博客
01-06 3435
1.建新目录/path/to/mysql/，mkdir -p /path/to/mysql 2.把之前用于安装Ambari所需要的MySQL JDBC驱动jar包放在新目录里，名称改为mysql-connector-java.jar；如果是用Linux的命令来在线安装JDBC驱动(ubuntu的apt-get install或centos的yum install)的，下载的驱动jar包是位于/us...
Ambari安装hive服务，数据库Connection Failed
CREATE_17的博客
01-12 1707
点击卡片“大数据实战演练”，选择“设为星标”或“置顶”回复“资料”可领取独家整理的学习资料！一、问题描述因为写 ambari 相关的文章比较多，所以有很多使用 ambari 的朋友加我好...
【转】安装ambari的时候遇到的ambari和hadoop问题集
weixin_30376453的博客
10-31 830
5.在安装的时候遇到的问题 5.1使用ambari-server start的时候出现ERROR: Exiting with exit code -1. 5.1.1REASON: Ambari Server java process died with exitcode 255. Check /var/log/ambari-server/ambari-server.out for m...
HDP商业平台安装,Hive的metatore起不来
陆山右的技术博客
12-08 552
Metastore on bigdata03 failed (Traceback (most recent call last): File “/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py”, line 200, in execute t...
Ambari启动hive报错
lin_tuer的博客
04-02 3024
第一次错误：Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py", line 203, in <module> HiveMetastore().execute...
ambari hive mysql_ambari方式安装hadoop的hive组件遇到的问题
weixin_27605509的博客
01-31 336
最近在部署hadoop，我发现了ambari工具部署hadoop的hive 组件的一个问题，不知道其他人遇到过没有。问题描述：通过ambari工具搭建了hadoop2.0完全分布式集群。在测试hive的时候，按照官方文档里的说明通过下面命令检查根目录的时候：总是报错无法连接mysql。(java.sql.SQLException: Access denied foruser 'hive'@'hdb...
Hive MetaStore 启动配置
是个好男人的博客
05-12 5591
1.MetaStore介绍 Hive可以启动一个叫做MetaStore的服务，该服务在Hive的客户端启动，用户通过客户端连接到MetaStore，然后和一个数据库（例如：Mysql）进行通信。该数据库是用于存储Hive的元数据信息。 2.MetaStore配置 需要修改hive-site.xml配置文件，配置端口 <property> <name>hive.metastore.port</name> <value>9083&...
doris 连接ambari hive 表
06-13
要连接Ambari Hive表，你可以使用Doris的Hive插件来实现。具体步骤如下： 1. 安装Doris的Hive插件：你需要下载和安装Doris的Hive插件，以便Doris能够读取和写入Hive表。你可以从Doris官网下载最新版本的插件。 2. 修改Doris的配置文件：你需要修改Doris的配置文件，以便Doris能够加载Hive插件。具体来说，你需要将以下配置项添加到Doris的配置文件中： ``` ## Hive plugin configuration hive.plugin.path=hdfs://[HIVE_SERVER_HOST]:[HIVE_SERVER_PORT]/user/hive/warehouse ``` 其中，[HIVE_SERVER_HOST]和[HIVE_SERVER_PORT]是你的Hive服务器的主机名和端口号。 3. 创建外部表：你可以使用Doris的CREATE EXTERNAL TABLE语句来创建外部表，以便Doris能够读取Hive表中的数据。具体来说，你需要在CREATE EXTERNAL TABLE语句中指定Hive表的位置和格式，例如： ``` CREATE EXTERNAL TABLE hive_table ( col1 STRING, col2 INT, col3 DOUBLE ) STORED AS PARQUET LOCATION 'hdfs://[HIVE_SERVER_HOST]:[HIVE_SERVER_PORT]/user/hive/warehouse/hive_table'; ``` 其中，[HIVE_SERVER_HOST]和[HIVE_SERVER_PORT]是你的Hive服务器的主机名和端口号。 4. 查询Hive表：你可以使用Doris的SELECT语句来查询Hive表中的数据，例如： ``` SELECT col1, col2, col3 FROM hive_table; ``` 这样就可以通过Doris连接和查询Ambari Hive表了。
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值