hive性能优化

1，USE TEZ

set hive.execution.engine=tez;

2，use orcfile



3，USE VECTORIZATION

set hive.vectorized.execution.enabled = true;
set hive.vectorized.execution.reduce.enabled = true;
（

Vectorized query execution improves performance of operations like scans, aggregations, filters and joins, by performing them in batches of 1024 rows at once instead of single row each time.Introduced in Hive 0.13, this feature significantly improves query execution time, and is easily enabled with two parameters settings:）

4，COST BASED QUERY OPTIMIZATION

set hive.cbo.enable=true;
set hive.compute.query.using.stats=true;
set hive.stats.fetch.column.stats=true;
set hive.stats.fetch.partition.stats=true;
analyze table tweets compute statistics;
analyze table tweets compute statistics for columns sender, topic;
analyze table tweets compute statistics for columns;


5，WRITE GOOD SQL




6，

https://streever.atlassian.net/wiki/display/HADOOP/Hive+Performance+Tips



7，

http://www.cnblogs.com/smartloli/p/4356660.html

8 小表join大表

set hive.auto.convert.join=true;