HIve自定义函数(自定义UDF函数)

15 篇文章 1 订阅
13 篇文章 0 订阅

步骤如下:

1,导入依赖
<dependencies>
		<!-- https://mvnrepository.com/artifact/org.apache.hive/hive-exec -->
		<dependency>
			<groupId>org.apache.hive</groupId>
			<artifactId>hive-exec</artifactId>
			<version>1.2.1</version>
		</dependency>
</dependencies>

2.创建一个类
package com.isea;

import org.apache.hadoop.hive.ql.exec.UDF;

public class HiveUDF extends UDF {
    public String evaluate(final String s){
        if (s == null){
            return  null;
        }
        return s.toLowerCase();
    }
}

将该程序打为jar包

3.打成jar包上传到服务器/opt/module/hive/下
[isea@hadoop108 ~]$ cd /opt/module/hive/
[isea@hadoop108 hive]$ ll
*
-rw-rw-r--. 1 isea isea   2104 12月  3 02:21 hive_udf-1.0-SNAPSHOT.jar
*



4.将jar包添加到hive的classpath

> add jar /opt/module/hive/hive_udf-1.0-SNAPSHOT.jar;

5.创建临时函数与开发好的java class关联,这里要写类的全路径
> create temporary function mylower as "com.isea.HiveUDF";

先看看我们的原始数据
0: jdbc:hive2://hadoop108:10000> select * from emp;
+------------+------------+------------+----------+---------------+----------+-----------+-------------+--+
| emp.empno  | emp.ename  |  emp.job   | emp.mgr  | emp.hiredata  | emp.sal  | emp.comm  | emp.deptno  |
+------------+------------+------------+----------+---------------+----------+-----------+-------------+--+
| 7369       | SMITH      | CLERK      | 7902     | 1980-12-17    | 800.0    | NULL      | 20          |
| 7499       | ALLEN      | SALESMAN   | 7698     | 1981-2-20     | 1600.0   | 300.0     | 30          |
| 7521       | WARD       | SALESMAN   | 7698     | 1981-2-22     | 1250.0   | 500.0     | 30          |
| 7566       | JONES      | MANAGER    | 7839     | 1981-4-2      | 2975.0   | NULL      | 20          |
| 7654       | MARTIN     | SALESMAN   | 7698     | 1981-9-28     | 1250.0   | 1400.0    | 30          |
| 7698       | BLAKE      | MANAGER    | 7839     | 1981-5-1      | 2850.0   | NULL      | 30          |
| 7782       | CLARK      | MANAGER    | 7839     | 1981-6-9      | 2450.0   | NULL      | 10          |
| 7788       | SCOTT      | ANALYST    | 7566     | 1987-4-19     | 3000.0   | NULL      | 20          |
| 7839       | KING       | PRESIDENT  | NULL     | 1981-11-17    | 5000.0   | NULL      | 10          |
| 7844       | TURNER     | SALESMAN   | 7698     | 1981-9-8      | 1500.0   | 0.0       | 30          |
| 7876       | ADAMS      | CLERK      | 7788     | 1987-5-23     | 1100.0   | NULL      | 20          |
| 7900       | JAMES      | CLERK      | 7698     | 1981-12-3     | 950.0    | NULL      | 30          |
| 7902       | FORD       | ANALYST    | 7566     | 1981-12-3     | 3000.0   | NULL      | 20          |
| 7934       | MILLER     | CLERK      | 7782     | 1982-1-23     | 1300.0   | NULL      | 10          |
+------------+------------+------------+----------+---------------+----------+-----------+-------------+--+

将上表中的数据改写成对应的大写的英文转为小写

7.即可在hql中使用自定义的函数strip  
> select ename, mylower(ename) lowername from emp;
+---------+------------+--+
|  ename  | lowername  |
+---------+------------+--+
| SMITH   | smith      |
| ALLEN   | allen      |
| WARD    | ward       |
| JONES   | jones      |
| MARTIN  | martin     |
| BLAKE   | blake      |
| CLARK   | clark      |
| SCOTT   | scott      |
| KING    | king       |
| TURNER  | turner     |
| ADAMS   | adams      |
| JAMES   | james      |
| FORD    | ford       |
| MILLER  | miller     |
+---------+------------+--+

 

  • 2
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值