实习日志Day4

黑马畅聊项目分析

数据问题

问题1:当前数据中,有一些数据的字段为空, 不是合法数据

问题2:需求中,需要统计每天、每个小时的消息量, 但是数据中没有天和小时字段,只有整体时间字段,不好处理

问题3:需求中,需要对经度和维度构建地区的可视化地图, 但是数据中GPS经纬度为一个字段,不好处理

ETL需求

需求1:对字段为空的不合法数据进行过滤

• Where过滤

需求2:通过时间字段构建天和小时字段

• Substr函数

需求3:从GPS的经纬度中提取经度和维度

• Split函数

需求4:将ETL以后的结果保存到一张新的Hive表中

• Create table …… as select ……

ETL实现

查看结果

select

msg_time,dayinfo,hourinfo,sender_gps,sender_lng,sender_lat from db_msg.tb_msg_etl limit 10;

 

  • 12
    点赞
  • 7
    收藏
    觉得还不错? 一键收藏
  • 3
    评论
Day 1: Today is my first day of computer internship. I am excited to learn and gain more experience. My mentor introduced me to the company’s software and hardware tools. Day 2: I learned the basics of programming languages like C++ and Python. My mentor guided me through some coding exercises to make sure I understood the concepts. Day 3: Today, I was introduced to database management systems. I learned how to use SQL to query, update and manage data in a relational database. Day 4: I spent the day working on a project using Java programming language. I learned how to implement object-oriented programming concepts and how to use Java libraries. Day 5: I learned about web development and how to create a simple website using HTML and CSS. I also learned about responsive design and how to make a website compatible with different devices. Day 6-10: I spent these days working on a group project. We developed a simple mobile application using Android Studio. I learned how to design user interfaces and how to integrate different functionalities into the app. Day 11-15: I worked on a project that involved data analysis using Python. I learned how to use libraries like NumPy, Pandas and Matplotlib to analyze and visualize data. Day 16-18: I worked on a cybersecurity project. I learned about different types of attacks and how to prevent them. I also learned how to use penetration testing tools. Day 19: I spent the day improving my coding skills by practicing coding challenges on different online platforms. Day 20: Today is my last day of internship. I am grateful for the opportunity to learn and gain experience. I am now more confident in my coding skills and ready to take on more challenging projects.

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 3
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值