python pyhive查询hive

最新推荐文章于 2024-03-03 09:15:00 发布

相交的直线

最新推荐文章于 2024-03-03 09:15:00 发布

阅读量1.9k

点赞数 1

分类专栏： python 文章标签： python phive hive

本文链接：https://blog.csdn.net/u013255226/article/details/95594453

版权

python 专栏收录该内容

8 篇文章 0 订阅

订阅专栏

安装phive

pip install sasl
pip install thrift
pip install thrift-sasl
pip install PyHive

工具类
class HiveClient:
    def __init__(self, db_host, user, password, database, port=10000):
        """
        create connection to hive server2
        """
        # 配置队列
        config = {"mapreduce.job.queuename": "XXX"}  
        self.conn = hive.Connection(host=db_host,
                                  port=port,
                                    auth='CUSTOM',
                                  username=user,
                                  password=password,
                                  database=database,
                                  configuration=config
                                  )

    def query(self, sql):

        """
        query
        """
        with self.conn.cursor() as cursor:
            cursor.execute(sql)
            return cursor.fetchall()


if __name__ == '__main__':
    """
    main process
    """
    try:

        hiveCli = HiveClient(hive_info["ip"], hive_info["username"], hive_info["password"],
                             "default", hive_info["port"])
        sql = '''select * from db_test.test where concat_ws('-', year, month, day) = '2019-07-03' and (
                sql_str LIKE '%%phone%%')  limit 10'''
        data = hiveCli.query(sql)
        print(data)
    except Exception, tx:
        print '%s' % (tx.message)