impala+hive自定义函数

最新推荐文章于 2023-11-08 10:53:24 发布

qq_25617289

最新推荐文章于 2023-11-08 10:53:24 发布

阅读量1.1k

点赞数

分类专栏：数仓 shell 文章标签： hive hadoop mysql

本文链接：https://blog.csdn.net/qq_25617289/article/details/122468662

版权

数仓同时被 2 个专栏收录

2 篇文章 0 订阅

订阅专栏

shell

1 篇文章 0 订阅

订阅专栏

impala:
create function fuzzyMatch(string,string) returns double location '/user/hive/udf/common_project-1.0-SNAPSHOT.jar' symbol='utils.FuzzyMatch';

create function getDistance(double,double,double,double) returns double location '/user/hive/udf/common_project-1.0-SNAPSHOT.jar' symbol='utils.Distance';

hive:
add jar /data/common_project-1.0-SNAPSHOT.jar
create temporary function fuzzyMatch as 'utils.FuzzyMatch';

create temporary function getDistance as 'utils.Distance';

create function getDistance as 'utils.Distance' using jar 'hdfs:///user/hive/udf/common_project-1.0-SNAPSHOT.jar';
create function fuzzyMatch as 'utils.FuzzyMatch' using jar 'hdfs:///user/hive/udf/common_project-1.0-SNAPSHOT.jar';

sqoop导入:
sqoop import --connect jdbc:mysql://192.168.16.126:3306/sinohealth_test --username hefeng --password hefeng%123 --table student --fields-terminated-by '\t' --hive-import --hive-overwrite --hive-database sinohealth_test --hive-table student --null-string '\\N' --null-non-string '\\N'

sqoop导出:
sqoop export --connect jdbc:mysql://192.168.52.23:3306/test --username hefeng --password hefeng%123 --table student --fields-terminated-by '\t' --hcatalog-database sinohealth_test --hcatalog-table student

impala命令登陆:
impala-shell -i hadoop04:21000 -u hive -l --auth_creds_ok_in_clear

impala-shell -i hadoop04:21000 -u data_tool_hadoop -l --auth_creds_ok_in_clear