常见问题
参考文档
整合spark
vim ${spark_home}/conf/hive-site.xml
将hive.metastore.schema.verification设置成false
不然会出现
Caused by: MetaException(message:Version information not found in metastore. )
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:83)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:92)
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:6608)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:239)
at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:70)
... 28 more
将thriftserver的端口号更改成10008
<property>
<name>hive.server2.thrift.port</name>
<value>10008</value>
<description>Port number of HiveServer2 Thrift interface when hive.server2.transport.mode is 'binary'.</description>
</property>
开启
${spark_home}/sbin/start-thriftserver.sh
测试
${SPARK_HOME}/bin/beeline -u jdbc:hive2://master:10008
修改${hue_home}/usr/share/hue/desktop/conf/hue.ini 【博主是写在主机上然后覆盖容器内的hue.ini】
[spark]
# Host of the Spark Thrift Server
# https://spark.apache.org/docs/latest/sql-distributed-sql-engine.html
sql_server_host=localhost
# Port of the Spark Thrift Server
sql_server_port=10008
[[interpreters]]
# Define the name and how to connect and execute the language.
# https://docs.gethue.com/administrator/configuration/editor/
.........
[[[sparksql]]]
name=SparkSql
interface=hiveserver2
............
整合presto
安装建议
https://blog.jathamcloud.top/blog/27
presto://{presto-coordinator}:{port}/{catalog}/{schema} format:
[[[presto]]]
name = Presto
interface=sqlalchemy
options='{"url": "presto://localhost:8080/hive/default"}'
覆盖hue.ini
docker cp /hue/hue.ini <containerId>:/usr/share/hue/desktop/conf/hue.ini
docker restart <containerId>
博主公众号
求关注