![](https://img-blog.csdnimg.cn/20201014180756754.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
文件压缩
Deng_huakai
花开自会落
展开
-
压缩在hive中的使用
用sqoop将数据从MySQL中以snappy压缩格式导入至hive中hive (default)> create table product_info_snappy as select *from product_info where 1=2; (在hive中创建一张表,结构与 product_info相同 。这张表在MySQL的ruozedata5数据库下面。)[hadoop@ha...原创 2018-12-05 20:15:34 · 268 阅读 · 0 评论 -
spark on yarn
shell脚本log-yarn.sh如下:export HADOOP_CONF_DIR=/home/hadoop/app/hadoop-2.6.0-cdh5.7.0/etc/hadoop$SPARK_HOME/bin/spark-submit \--master yarn \--class www.ruozedata.bigdata.SparkCore02.LocalServeApp \...原创 2018-12-24 22:38:56 · 320 阅读 · 0 评论