hue整合sparksql和presto

常见问题
参考文档

整合spark

参考文档

vim ${spark_home}/conf/hive-site.xml

将hive.metastore.schema.verification设置成false
不然会出现 
Caused by: MetaException(message:Version information not found in metastore. )
    at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:83)
    at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:92)
    at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:6608)
    at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:239)
    at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:70)
    ... 28 more


将thriftserver的端口号更改成10008

<property>
    <name>hive.server2.thrift.port</name>
    <value>10008</value>
    <description>Port number of HiveServer2 Thrift interface when hive.server2.transport.mode is 'binary'.</description>
  </property>
开启
${spark_home}/sbin/start-thriftserver.sh 
测试
${SPARK_HOME}/bin/beeline -u jdbc:hive2://master:10008

修改${hue_home}/usr/share/hue/desktop/conf/hue.ini 【博主是写在主机上然后覆盖容器内的hue.ini】

[spark]
# Host of the Spark Thrift Server
# https://spark.apache.org/docs/latest/sql-distributed-sql-engine.html
sql_server_host=localhost

# Port of the Spark Thrift Server
sql_server_port=10008
[[interpreters]]
    # Define the name and how to connect and execute the language.
    # https://docs.gethue.com/administrator/configuration/editor/
.........

[[[sparksql]]]
name=SparkSql
interface=hiveserver2
............
整合presto

安装建议
https://blog.jathamcloud.top/blog/27

presto://{presto-coordinator}:{port}/{catalog}/{schema} format:

[[[presto]]]
  name = Presto
  interface=sqlalchemy
  options='{"url": "presto://localhost:8080/hive/default"}'

覆盖hue.ini

docker cp  /hue/hue.ini   <containerId>:/usr/share/hue/desktop/conf/hue.ini 

docker restart <containerId>

博主公众号
求关注
在这里插入图片描述

  • 0
    点赞
  • 2
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值