总结文档
一、 环境配置
1. Python3.6:https://www.python.org/downloads/windows/
2. Meld源码: https://gitlab.gnome.org/GNOME/meld
3. pip install cx-Freeze
4. pip install PYGObject
- 问题:Microsoft Visual C++ 14.0 is requred
- 下载安装编译工具包
https://blog.csdn.net/CDL2017CDL/article/details/104474305
https://blog.csdn.net/qq_15158911/article/details/107887490
https://www.cnblogs.com/yyds/p/7065637.html
二、 问题
- pip not found : https://www.pianshen.com/article/50191151479/
- pip 不能用问题:
python -m pip install --upgrade --force-reinstall pip
3.impyla、impala
在连接hive时,使用impala的方式,使用的是python3.8,发现很多问题,换成python3.6后连接成功,特此记录。
关联包:
six1.16.0
thrift0.11.0
thrift-sasl0.4.3
impyla0.17.0
impala0.2
Cython0.29.28
from impala.dbapi import connect
import pandas as pd
conn = connect(host='192.168.10.10', port=10000, user=None, password=None, database='default', auth_mechanism="PLAIN")
cur = conn.cursor()
cur.execute("select 1")
row = cur.fetchall()
data = []
for i in row:
data.append(i[0])
#data = cur.fetchall()
#df = pd.DataFrame(data, columns=cols)
#print(df)