【大数据】Hive 远程调试

笑起来贼好看

已于 2023-02-11 09:47:04 修改

阅读量190

点赞数

于 2023-01-22 08:58:09 首次发布

本文链接：https://blog.csdn.net/u013412066/article/details/128748181

版权

大数据同时被 2 个专栏收录

71 篇文章 2 订阅

订阅专栏

数据结构与算法

19 篇文章 0 订阅

订阅专栏

启动远程调试

hive --debug
Listening for transport dt_socket at address: 8000
Hive Session ID = 75714884-fc1a-4701-92bf-1bdbd156c5e3
Logging initialized using configuration in file:/data/apps/hive-3.1.3/conf/hive-log4j2.properties Async: true

Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.

在这里插入图片描述
org.apache.hadoop.hive.cli.CliDriver

在这里插入图片描述

在hive 的 hive或者beeline 中输入 **dfs add reset **等等，处理逻辑都在
org.apache.hadoop.hive.ql.processors.CommandProcessorFactory

switch (hiveCommand) {
  case SET:
    return new SetProcessor();
  case RESET:
    return new ResetProcessor();
  case DFS:
    SessionState ss = SessionState.get();
    return new DfsProcessor(ss.getConf());
  case ADD:
    return new AddResourceProcessor();
  case LIST:
    return new ListResourceProcessor();
  case LLAP_CLUSTER:
    return new LlapClusterResourceProcessor();
  case LLAP_CACHE:
    return new LlapCacheResourceProcessor();
  case DELETE:
    return new DeleteResourceProcessor();
  case COMPILE:
    return new CompileProcessor();
  case RELOAD:
    return new ReloadProcessor();
  case CRYPTO:
    try {
      return new CryptoProcessor(SessionState.get().getHdfsEncryptionShim(), conf);
    } catch (HiveException e) {
      throw new SQLException("Fail to start the command processor due to the exception: ", e);
    }
  default:
    throw new AssertionError("Unknown HiveCommand " + hiveCommand);
}