调优:
fectch抓取(select,filter,limit) (这个适合老版本,因为老版本hive默认是minimal,现在新版本都是默认more)
hive>set hive.fetch.task.conversion=none;//转为mr
hive> select * from emp;
Query ID = yangting_20180812081546_8bbe72fd-e30b-4892-ae71-1f3704d678ed
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Job running in-process (local Hadoop)
2018-08-12 08:15:53,011 Stage-1 map = 100%, reduce = 0%
Ended Job = job_local108385281_0001
MapReduce Jobs Launched:
Stage-Stage-1: HDFS Read: 2322 HDFS Write: 1651 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
OK
7369 SMITH CLERK 7902 1980-12-17 800.0 NULL 20
7499 ALLEN SALESMAN 7698 1981-2-20 1600.0 300.0 30
7521 WARD SALESMAN 7698 1981-2-22 1250.0 500.0 30
7566 JONES MANAGER 7839 1981-4-2 2975.0 NULL 20
7654 MARTIN SALESMAN 7698 1981-9-28 1250.0 1400.0 30
7698 BLAKE MANAGER 7839 1981-5-1 2850.0 NULL 30
7782 CLARK MANAGER 7839 1981-6-9 2450.0 NULL 10
7788 SCOTT ANALYST 7566 1987-4-19 3000.0 NULL 20
7839 KING PRESIDENT NULL 1981-11-17 5000.0 NULL 10
7844 TURNER SALESMAN 7698 1981-9-8 1500.0 0.0 30
7876 ADAMS CLERK 7788 1987-5-23 1100.0 NULL 20
7900 JAMES CLERK
hive的调优以及数据倾斜
最新推荐文章于 2023-11-12 15:11:42 发布
![](https://img-home.csdnimg.cn/images/20240711042549.png)