hive Error: GC overhead limit exceeded

本文介绍了如何处理Hive运行时遇到的'Error: GC overhead limit exceeded'错误,通过调整hive-site.xml中的相关配置参数,包括Hive服务、复制和客户端的高级配置,以优化内存使用,避免垃圾收集器过载问题。
摘要由CSDN通过智能技术生成
+ hive -e 'use trainschain;insert overwrite table dwd_acct_settlecore_clear_mer_detail_h_d partition (dp,end_date)  select id,mer_clear_no,merchant_no,account_evidence_no,product,transaction_no,payment_no,pay_seq,order_id,transaction_type,ori_transaction_no,ori_order_id,country,currency,transaction_amount,customer_id,card_no,store_code,transaction_created_date,transaction_success_date,payment_method,payment_method2,promotion_amount,extra_attribute,clearing_flag,clear_status,settle_type,rate_condition_type,merchant_fee_amount,refundable_mer_fee_amount,refund_merchant_fee_amount,algorithm_type,algorithm_value,mer_batch_no,mer_clear_date,mer_set_date,set_type,mer_pay_date,trade_settled,fee_setttled,merchant_refund_fee,created_date,modified_date,effect,is_calculate_vat,vat_rate,vat_fee,refunded_vat_fee,is_refund_vat,wht_rate,wht_fee,refunded_wht_fee,is_refund_wht,is_wht_set,settle_amount,merchant_fee_no,rate_no,service_code,set_no,attach,trade_date,is_recon,account_type,refund_type,start_date,dp,end_date from trainschain.dwd_s_acct_settlecore_clear_mer_detail_i_d_his_tmp'

Logging initialized using configuration in jar:file:/export/servers/cloudera/parcels/CDH-5.14.4-1.cdh5.14.4.p0.3/jars/hive-common-1.1.0-cdh5.14.4.jar!/hive-log4j.properties
OK
Time taken: 1.177 seconds
setfacl: Permission denied. user=lixianwei6 is not the owner of inode=.hive-staging_hive_2020-03-26_09-41-50_930_2885942923653611875-1
Query ID = lixianwei6_20200326094141_b47b8591-ae35-41e1-b847-0754a3b4b8d5
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_1574761440025_893687, Tracking URL = http://THA-223-35-30.h.chinabank.com.cn:8088/proxy/application_1574761440025_893687/
Kill Command = /export/servers/cloudera/parcels/CDH-5.14.4-1.cdh5.14.4.p0.3/lib/hadoop/bin/hadoop job  -kill job_1574761440025_893687
Hadoop job information for Stage-1: number of mappers: 16; number of reducers: 0
2020-03-26 09:42:
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值