hive练习

有如下通话记录:
Zhangsan Wangwu 01:01:01
Zhangsan Zhaoliu 00:11:21
Zhangsan Yuqi 00:19:01
Zhangsan Jingba 00:21:01
Zhangsan Wuxi 01:31:17
Wangwu Zhaoliu 00:51:01
Wangwu Zhaoliu 01:11:19
Wangwu Yuqi 00:00:21
Wangwu Yuqi 00:23:01
Yuqi Zhaoliu 01:18:01
Yuqi Wuxi 00:18:00
Jingba Wangwu 00:02:04
Jingba Wangwu 00:02:54
Wangwu Yuqi 01:00:13
Wangwu Yuqi 00:01:01
Wangwu Zhangsan 00:01:01
函数:unix_timestamp(time_string,time_format)前面是将string类型时间字符串转化为指定的时间格式
from_unixtime(unix_time,format)将时间戳转化为指定格式的时间
建表

create table phonetime(
fornaem string,
toname strng,
time string
)
row format delimited
fields terminated by ' '
;

查询

  1. 聚合数据将相同的数据聚合相加

select fromName,
toName,
from_unixtime(sum(unix_timestamp(time,“HH:mm:ss”)-unix_timestamp(“00:00:00”,“HH:mm:ss”))+unix_timestamp(“00:00:00”,“HH:mm:ss”),“HH:mm:ss”)
from
phonetime
group by
fromName,toName;

  1. 当成两张表关联,表1的第一个字段与表2的第二个字段关 并且 联表1的第二个字段与表2的第一个字段关联(求两人之间的通话)

select t1.,t2.
from
(select
fromName,toName,
from_unixtime(sum(unix_timestamp(time,“HH:mm:ss”)-unix_timestamp(“00:00:00”,“HH:mm:ss”))+unix_timestamp(“00:00:00”,“HH:mm:ss”),“HH:mm:ss”) times
from phonetime
group by
fromName,toName) t1
left join
(select
fromName,toName,
from_unixtime(sum(unix_timestamp(time,“HH:mm:ss”)-unix_timestamp(“00:00:00”,“HH:mm:ss”))+unix_timestamp(“00:00:00”,“HH:mm:ss”),“HH:mm:ss”) times
from phonetime
group by
fromName,toName) t2
on
t1.fromName = t2.toName and t1.toName = t2.fromName;

  1. 累加同一条记录的t1.time和t2.time(通过左连接可将相互通话的时间相加没有去重)

    select
    t1.fromName,t1.toName,
    from_unixtime((unix_timestamp(t1.times,“HH:mm:ss”)-unix_timestamp(“00:00:00”,“HH:mm:ss”)+
    unix_timestamp(nvl(t2.times,“00:00:00”),“HH:mm:ss”)-unix_timestamp(“00:00:00”,“HH:mm:ss”))+
    unix_timestamp(“00:00:00”,“HH:mm:ss”),“HH:mm:ss”)
    from
    (select fromName,toName,
    from_unixtime(sum(unix_timestamp(time,“HH:mm:ss”)-unix_timestamp(“00:00:00”,“HH:mm:ss”))+unix_timestamp(“00:00:00”,“HH:mm:ss”),“HH:mm:ss”) times
    from phonetime group by fromName,toName) t1
    left join
    (select fromName,toName,
    from_unixtime(sum(unix_timestamp(time,“HH:mm:ss”)-unix_timestamp(“00:00:00”,“HH:mm:ss”))+unix_timestamp(“00:00:00”,“HH:mm:ss”),“HH:mm:ss”) times
    from phonetime group by fromName,toName) t2
    on t1.fromName = t2.toName and t1.toName = t2.fromName;

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
1.上传tar包 2.解压 tar -zxvf hive-1.2.1.tar.gz 3.安装mysql数据库 推荐yum 在线安装 4.配置hive (a)配置HIVE_HOME环境变量 vi conf/hive-env.sh 配置其中的$hadoop_home (b)配置元数据库信息 vi hive-site.xml 添加如下内容: javax.jdo.option.ConnectionURL jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true JDBC connect string for a JDBC metastore javax.jdo.option.ConnectionDriverName com.mysql.jdbc.Driver Driver class name for a JDBC metastore javax.jdo.option.ConnectionUserName root username to use against metastore database javax.jdo.option.ConnectionPassword hadoop password to use against metastore database 5.安装hive和mysq完成后,将mysql的连接jar包拷贝到$HIVE_HOME/lib目录下 如果出现没有权限的问题,在mysql授权(在安装mysql的机器上执行) mysql -uroot -p #(执行下面的语句 *.*:所有库下的所有 %:任何IP地址或主机都可以连接) GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'root' WITH GRANT OPTION; FLUSH PRIVILEGES; 6. Jline包版本不一致的问题,需要拷贝hive的lib目录中jline.2.12.jar的jar包替换掉hadoop中的 /home/hadoop/app/hadoop-2.6.4/share/hadoop/yarn/lib/jline-0.9.94.jar 启动hive bin/hive ---------------------------------------------------------------------------------------------------- Hive几种使用方式: 1.Hive交互shell bin/hive 2.Hive JDBC服务(参考java jdbc连接mysql) 3.hive启动为一个服务器,来对外提供服务 bin/hiveserver2 nohup bin/hiveserver2 1>/var/log/hiveserver.log 2>/var/log/hiveserver.err & 启动成功后,可以在别的节点上用beeline去连接 bin/beeline -u jdbc:hive2://mini1:10000 -n root 或者 bin/beeline ! connect jdbc:hive2://mini1:10000 4.Hive命令 hive -e ‘sql’ bin/hive -e 'select * from t_test'
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值