使用Impyla连接Hive

环境:Ubuntu 18.04 Python 3.6

安装

# coding=utf-8
from impala.dbapi import connect

conn = connect(host='127.0.0.1', port=10000, database='gld', auth_mechanism='PLAIN')
cursor = conn.cursor()
cursor.execute('SELECT * FROM student LIMIT 100')

print(cursor.description) # 打印字段名

results = cursor.fetchall() # 打印结果,results是list of tuples
print(results)

结果:

[('student.id', 'STRING', None, None, None, None, None), ('student.name', 'STRING', None, None, None, None, None), ('student.sex', 'STRING', None, None, None, None, None), ('student.age', 'STRING', None, None, None, None, None), ('student.dept_id', 'STRING', None, None, None, None, None)]

[('1', '孙悟空', '男', '18', '01'), ('2', '明世隐', '男', '19', '01'), ('3', '高渐离', '男', '20', '02'), ('4', '孙尚香', '女', '21', '02'), ('5', '安琪拉', '女', '22', '03')]

常见报错解决方案

  1. 安装sasl时报错:sasl/saslwrapper.h:22:10: fatal error: sasl/sasl.h: No such file or directory
    使用sudo apt-get install libsasl2-dev安装libsasl2-dev即可。

  2. 连接时报错:AttributeError: 'TSocket' object has no attribute 'isOpen'
    版本兼容问题,安装:pip3 install thrift_sasl==0.2.1,注意检查版本ply-3.11 thrift-0.9.3 sasl-0.2.1 six-1.12.0 thrift-sasl-0.2.1 thriftpy-0.3.9

已标记关键词 清除标记
©️2020 CSDN 皮肤主题: 精致技术 设计师:CSDN官方博客 返回首页