python 连接 hive

https://juejin.im/post/5dc4fc646fb9a04ab25be021

 

from impala.dbapi import connect
from impala.util import as_pandas


cdh_params = {
    'host': 'hive',
    'port':10000,
    #'database': 'xx',
    #'timeout': 60,
    'auth_mechanism':'PLAIN',    # hive  PLAIN
    #'user': 'xx',
    #'password': 'xx'
}

cdh_conn = connect(**cdh_params)
cdh_cursor = cdh_conn.cursor()

cdh_cursor.execute('SHOW databases')
cdh_tabs = cdh_cursor.fetchall()
print(cdh_tabs)

 

最后 pip install impyla 会报错，其中需要安装 bitarray 包，只用 whl 文件安装，安装好后， 再 pip install impyla 就可成功