探寻hdfs-audit log -2

最新推荐文章于 2023-08-02 18:25:13 发布

aiSniff

最新推荐文章于 2023-08-02 18:25:13 发布

阅读量831

点赞数 1

分类专栏： hadoop bigdata

本文链接：https://blog.csdn.net/qq_36108146/article/details/87887228

版权

bigdata 同时被 2 个专栏收录

4 篇文章 0 订阅

订阅专栏

hadoop

3 篇文章 0 订阅

订阅专栏

从SQL层面上分析：

insert 操作：

2019-02-18 18:14:35,396 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=delete src=/user/hive/.staging/job_1544610861281_0006 dst=null perm=null proto=rpc
2019-02-18 18:14:35,447 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/_tmp.-ext-10002 dst=null perm=null proto=rpc
2019-02-18 18:14:35,448 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/_tmp.-ext-10002 dst=null perm=null proto=rpc
2019-02-18 18:14:35,450 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10002 dst=null perm=null proto=rpc
2019-02-18 18:14:35,455 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=rename src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/_tmp.-ext-10002 dst=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10002 perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 18:14:35,461 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=delete src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/_task_tmp.-ext-10002 dst=null perm=null proto=rpc
2019-02-18 18:14:35,464 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10002 dst=null perm=null proto=rpc
2019-02-18 18:14:35,466 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10002 dst=null perm=null proto=rpc
2019-02-18 18:14:35,470 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10002 dst=null perm=null proto=rpc
2019-02-18 18:14:35,473 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1 dst=null perm=null proto=rpc
2019-02-18 18:14:35,474 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getAclStatus src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1 dst=null perm=null proto=rpc
2019-02-18 18:14:35,478 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10002 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 18:14:35,479 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 18:14:35,484 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=rename src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10002 dst=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 18:14:35,488 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 18:14:35,489 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 18:14:35,492 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 18:14:35,500 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setAcl src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 18:14:35,501 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 18:14:35,508 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setAcl src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000/000000_0 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 18:14:35,572 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 18:14:35,575 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 18:14:35,577 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 18:14:35,579 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 18:14:35,580 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 18:14:35,582 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/000000_0 dst=null perm=null proto=rpc
2019-02-18 18:14:35,584 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/000000_0_copy_1 dst=null perm=null proto=rpc
2019-02-18 18:14:35,586 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/000000_0_copy_2 dst=null perm=null proto=rpc
2019-02-18 18:14:35,587 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/000000_0_copy_3 dst=null perm=null proto=rpc
2019-02-18 18:14:35,590 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 18:14:35,591 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getAclStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 18:14:35,593 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000/000000_0 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 18:14:35,594 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/student/000000_0_copy_3 dst=null perm=null proto=rpc
2019-02-18 18:14:35,603 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=rename src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10000/000000_0 dst=/apps/hive/warehouse/student/000000_0_copy_3 perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 18:14:35,607 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/000000_0_copy_3 dst=null perm=null proto=rpc
2019-02-18 18:14:35,611 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student/000000_0_copy_3 dst=null perm=null proto=rpc
2019-02-18 18:14:35,618 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setAcl src=/apps/hive/warehouse/student/000000_0_copy_3 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 18:14:35,679 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 18:14:35,681 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 18:14:35,765 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/apps/hive/warehouse/student/.hive-staging_hive_2019-02-18_18-14-19_094_5433720425519101770-1/-ext-10001 dst=null perm=hive:hive:rwxrwx--x proto=rpc

以上是一个insert操作所触发的cmd。类似这样的cmd结果还有overwrite。

其实对于write操作来说，主要的是mkdirs、rename 操作。

select 操作：

2019-02-18 22:37:12,128 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:37:12,130 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:37:51,308 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:38:51,316 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:39:43,130 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/student dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:39:43,190 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=contentSummary src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:39:43,268 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:39:43,270 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:39:43,273 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:39:43,278 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:39:43,279 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:39:43,292 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=open src=/apps/hive/warehouse/student/000000_0 dst=null perm=null proto=rpc
2019-02-18 22:39:43,297 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_1 dst=null perm=null proto=rpc
2019-02-18 22:39:43,300 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_2 dst=null perm=null proto=rpc
2019-02-18 22:39:43,304 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_3 dst=null perm=null proto=rpc
2019-02-18 22:39:43,309 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_4 dst=null perm=null proto=rpc
2019-02-18 22:39:43,313 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_5 dst=null perm=null proto=rpc
2019-02-18 22:39:43,318 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_6 dst=null perm=null proto=rpc
2019-02-18 22:39:43,323 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_7 dst=null perm=null proto=rpc
2019-02-18 22:39:51,326 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:40:06,811 INFO FSNamesystem.audit: allowed=true ugi=mapred (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2019-02-18 22:40:12,109 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:40:12,112 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:40:51,337 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:41:42,825 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/student dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:41:51,345 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:42:23,818 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/student dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:42:23,976 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=contentSummary src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:42:24,538 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging dst=null perm=null proto=rpc
2019-02-18 22:42:24,539 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging dst=null perm=null proto=rpc
2019-02-18 22:42:24,548 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016 dst=null perm=null proto=rpc
2019-02-18 22:42:24,553 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/user/hive/.staging/job_1544610861281_0016 dst=null perm=hive:hdfs:rwxr-xr-x proto=rpc
2019-02-18 22:42:24,563 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0016 dst=null perm=hive:hdfs:rwx------ proto=rpc
2019-02-18 22:42:24,568 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/user/hive/.staging/job_1544610861281_0016/libjars dst=null perm=hive:hdfs:rwxr-xr-x proto=rpc
2019-02-18 22:42:24,571 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0016/libjars dst=null perm=hive:hdfs:rwx------ proto=rpc
2019-02-18 22:42:24,573 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:24,578 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:24,624 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setReplication src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:24,626 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:24,630 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:25,049 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setReplication src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,053 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:25,058 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,068 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,070 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars dst=null perm=null proto=rpc
2019-02-18 22:42:25,074 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:42:25,075 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:42:25,082 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:42:25,083 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:42:25,101 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0016/job.split dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:25,108 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0016/job.split dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:25,112 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setReplication src=/user/hive/.staging/job_1544610861281_0016/job.split dst=null perm=null proto=rpc
2019-02-18 22:42:25,152 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0016/job.splitmetainfo dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:25,156 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0016/job.splitmetainfo dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:25,199 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:25,203 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:25,250 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=delete src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:25,256 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=hive:hdfs:rwxr-x--- proto=rpc
2019-02-18 22:42:25,312 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016 dst=null perm=null proto=rpc
2019-02-18 22:42:25,314 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:25,316 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:25,318 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,320 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,321 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.split dst=null perm=null proto=rpc
2019-02-18 22:42:25,323 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.split dst=null perm=null proto=rpc
2019-02-18 22:42:25,324 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:42:25,326 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:42:25,332 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,334 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,339 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,746 INFO FSNamesystem.audit: allowed=true ugi=yarn (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/app-logs dst=null perm=null proto=rpc
2019-02-18 22:42:25,843 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,847 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:25,998 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:26,001 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:26,160 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:42:26,163 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:42:26,201 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.split dst=null perm=null proto=rpc
2019-02-18 22:42:26,203 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job.split dst=null perm=null proto=rpc
2019-02-18 22:42:26,242 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:26,245 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:29,523 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging dst=null perm=null proto=rpc
2019-02-18 22:42:29,586 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/COMMIT_STARTED dst=null perm=null proto=rpc
2019-02-18 22:42:29,588 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/COMMIT_SUCCESS dst=null perm=null proto=rpc
2019-02-18 22:42:29,590 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/COMMIT_FAIL dst=null perm=null proto=rpc
2019-02-18 22:42:29,867 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016 dst=null perm=null proto=rpc
2019-02-18 22:42:30,427 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:42:30,437 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:42:31,945 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016_1.jhist dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:32,050 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016_1_conf.xml dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:32,464 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016.summary dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:34,150 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,152 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,175 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:34,177 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:34,191 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,221 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,224 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,368 INFO FSNamesystem.audit: allowed=true ugi=yarn (auth:SIMPLE) ip=/ip.222 cmd=getfileinfo src=/app-logs dst=null perm=null proto=rpc
2019-02-18 22:42:34,433 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,435 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/user/hive/.staging/job_1544610861281_0016/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,521 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,523 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job.jar dst=null perm=null proto=rpc
2019-02-18 22:42:34,658 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:34,660 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job.xml dst=null perm=null proto=rpc
2019-02-18 22:42:38,873 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job.split dst=null perm=null proto=rpc
2019-02-18 22:42:39,580 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/apps/hive/warehouse/student/000000_0 dst=null perm=null proto=rpc
2019-02-18 22:42:40,598 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_1 dst=null perm=null proto=rpc
2019-02-18 22:42:40,607 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_2 dst=null perm=null proto=rpc
2019-02-18 22:42:40,615 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_3 dst=null perm=null proto=rpc
2019-02-18 22:42:40,624 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_4 dst=null perm=null proto=rpc
2019-02-18 22:42:40,631 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_5 dst=null perm=null proto=rpc
2019-02-18 22:42:40,644 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_6 dst=null perm=null proto=rpc
2019-02-18 22:42:40,653 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.222 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_7 dst=null perm=null proto=rpc
2019-02-18 22:42:48,571 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0016/COMMIT_STARTED dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:48,582 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0016/COMMIT_SUCCESS dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:42:48,764 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016_1.jhist dst=null perm=null proto=rpc

以上是select 操作所触发的cmd。主要的操作为open。

同时又read/write的操作：insert into ...select * ...

2019-02-18 22:42:48,771 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016_1.jhist dst=null perm=null proto=rpc
2019-02-18 22:42:48,775 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016_1.jhist dst=null perm=null proto=rpc
2019-02-18 22:42:48,992 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016_1_conf.xml dst=null perm=null proto=rpc
2019-02-18 22:42:48,995 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016_1_conf.xml dst=null perm=null proto=rpc
2019-02-18 22:42:48,999 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0016/job_1544610861281_0016_1_conf.xml dst=null perm=null proto=rpc
2019-02-18 22:42:50,178 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=delete src=/user/hive/.staging/job_1544610861281_0016 dst=null perm=null proto=rpc
2019-02-18 22:42:51,354 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:43:06,811 INFO FSNamesystem.audit: allowed=true ugi=mapred (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2019-02-18 22:43:12,101 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:43:12,103 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:43:51,363 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:44:51,373 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:45:51,382 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:46:06,815 INFO FSNamesystem.audit: allowed=true ugi=mapred (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2019-02-18 22:46:12,029 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:46:12,031 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:46:51,390 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:47:30,501 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:30,505 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:30,506 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:30,508 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse dst=null perm=null proto=rpc
2019-02-18 22:47:30,520 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/apps/hive/warehouse/test dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:47:30,523 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse dst=null perm=null proto=rpc
2019-02-18 22:47:30,525 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getAclStatus src=/apps/hive/warehouse dst=null perm=null proto=rpc
2019-02-18 22:47:30,532 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:30,534 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:30,538 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:30,545 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setAcl src=/apps/hive/warehouse/test dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:47:30,548 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:30,551 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:30,553 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:47:51,400 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:48:51,415 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:49:06,813 INFO FSNamesystem.audit: allowed=true ugi=mapred (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2019-02-18 22:49:12,124 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:49:12,126 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:49:51,428 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:50:51,438 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:51:51,448 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:52:06,814 INFO FSNamesystem.audit: allowed=true ugi=mapred (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2019-02-18 22:52:12,003 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:52:12,005 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:52:51,455 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:53:51,462 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:54:51,471 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:55:06,812 INFO FSNamesystem.audit: allowed=true ugi=mapred (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2019-02-18 22:55:12,208 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:55:12,210 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/tmp/hive dst=null perm=null proto=rpc
2019-02-18 22:55:51,481 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:56:41,893 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/test dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:56:42,036 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1 dst=null perm=null proto=rpc
2019-02-18 22:56:42,038 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1 dst=null perm=null proto=rpc
2019-02-18 22:56:42,039 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:56:42,040 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:56:42,046 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:56:42,048 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:56:42,049 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getAclStatus src=/apps/hive/warehouse/test dst=null perm=null proto=rpc
2019-02-18 22:56:42,053 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:56:42,055 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:56:42,057 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1 dst=null perm=null proto=rpc
2019-02-18 22:56:42,059 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:56:42,068 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setAcl src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:56:42,069 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:56:42,075 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setAcl src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:56:42,076 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1 dst=null perm=null proto=rpc
2019-02-18 22:56:42,078 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1 dst=null perm=null proto=rpc
2019-02-18 22:56:42,313 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=contentSummary src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:56:42,588 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10001 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:56:42,593 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_tmp.-ext-10000 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:56:42,725 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging dst=null perm=null proto=rpc
2019-02-18 22:56:42,726 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging dst=null perm=null proto=rpc
2019-02-18 22:56:42,733 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017 dst=null perm=null proto=rpc
2019-02-18 22:56:42,738 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/user/hive/.staging/job_1544610861281_0017 dst=null perm=hive:hdfs:rwxr-xr-x proto=rpc
2019-02-18 22:56:42,742 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0017 dst=null perm=hive:hdfs:rwx------ proto=rpc
2019-02-18 22:56:42,746 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=mkdirs src=/user/hive/.staging/job_1544610861281_0017/libjars dst=null perm=hive:hdfs:rwxr-xr-x proto=rpc
2019-02-18 22:56:42,749 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0017/libjars dst=null perm=hive:hdfs:rwx------ proto=rpc
2019-02-18 22:56:42,751 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:42,755 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:42,809 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setReplication src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:42,811 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=null proto=rpc
2019-02-18 22:56:42,815 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:43,260 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setReplication src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=null proto=rpc
2019-02-18 22:56:43,263 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:43,269 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:43,279 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:43,280 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars dst=null perm=null proto=rpc
2019-02-18 22:56:43,284 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:56:43,286 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:56:43,291 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:56:43,292 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/student dst=null perm=null proto=rpc
2019-02-18 22:56:43,310 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0017/job.split dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:43,314 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0017/job.split dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:43,318 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setReplication src=/user/hive/.staging/job_1544610861281_0017/job.split dst=null perm=null proto=rpc
2019-02-18 22:56:43,357 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0017/job.splitmetainfo dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:43,362 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0017/job.splitmetainfo dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:43,395 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:43,399 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=setPermission src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:43,447 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=delete src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=null proto=rpc
2019-02-18 22:56:43,453 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=create src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=hive:hdfs:rwxr-x--- proto=rpc
2019-02-18 22:56:43,505 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017 dst=null perm=null proto=rpc
2019-02-18 22:56:43,507 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=null proto=rpc
2019-02-18 22:56:43,509 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=null proto=rpc
2019-02-18 22:56:43,511 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=null proto=rpc
2019-02-18 22:56:43,512 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=null proto=rpc
2019-02-18 22:56:43,514 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.split dst=null perm=null proto=rpc
2019-02-18 22:56:43,515 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.split dst=null perm=null proto=rpc
2019-02-18 22:56:43,517 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:56:43,518 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:56:43,524 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:43,526 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:43,532 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:44,391 INFO FSNamesystem.audit: allowed=true ugi=yarn (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/app-logs dst=null perm=null proto=rpc
2019-02-18 22:56:44,499 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:44,502 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:44,622 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=null proto=rpc
2019-02-18 22:56:44,625 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=null proto=rpc
2019-02-18 22:56:44,817 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:56:44,819 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:56:44,850 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.split dst=null perm=null proto=rpc
2019-02-18 22:56:44,852 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/job.split dst=null perm=null proto=rpc
2019-02-18 22:56:44,879 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=null proto=rpc
2019-02-18 22:56:44,881 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=null proto=rpc
2019-02-18 22:56:48,173 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging dst=null perm=null proto=rpc
2019-02-18 22:56:48,256 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/COMMIT_STARTED dst=null perm=null proto=rpc
2019-02-18 22:56:48,258 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/COMMIT_SUCCESS dst=null perm=null proto=rpc
2019-02-18 22:56:48,260 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/COMMIT_FAIL dst=null perm=null proto=rpc
2019-02-18 22:56:48,559 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017 dst=null perm=null proto=rpc
2019-02-18 22:56:49,188 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:56:49,200 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/job.splitmetainfo dst=null perm=null proto=rpc
2019-02-18 22:56:50,851 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017_1.jhist dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:50,956 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017_1_conf.xml dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:51,388 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017.summary dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:56:51,489 INFO FSNamesystem.audit: allowed=true ugi=oozie (auth:SIMPLE) ip=/ip.222 cmd=listStatus src=/user/oozie/oozie-sharelib/lib dst=null perm=null proto=rpc
2019-02-18 22:56:53,036 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=null proto=rpc
2019-02-18 22:56:53,038 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.jar dst=null perm=null proto=rpc
2019-02-18 22:56:53,059 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=null proto=rpc
2019-02-18 22:56:53,061 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job.xml dst=null perm=null proto=rpc
2019-02-18 22:56:53,077 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:53,107 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:53,111 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/libjars/hive-hcatalog-core-1.1.0-cdh5.7.0.jar dst=null perm=null proto=rpc
2019-02-18 22:56:56,945 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/job.split dst=null perm=null proto=rpc
2019-02-18 22:56:57,588 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/apps/hive/warehouse/student/000000_0 dst=null perm=null proto=rpc
2019-02-18 22:56:58,440 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_1 dst=null perm=null proto=rpc
2019-02-18 22:56:58,449 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_2 dst=null perm=null proto=rpc
2019-02-18 22:56:58,458 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_3 dst=null perm=null proto=rpc
2019-02-18 22:56:58,466 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_4 dst=null perm=null proto=rpc
2019-02-18 22:56:58,475 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_5 dst=null perm=null proto=rpc
2019-02-18 22:56:58,490 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_6 dst=null perm=null proto=rpc
2019-02-18 22:56:58,500 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/apps/hive/warehouse/student/000000_0_copy_7 dst=null perm=null proto=rpc
2019-02-18 22:57:06,051 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_task_tmp.-ext-10000/_tmp.000000_0 dst=null perm=null proto=rpc
2019-02-18 22:57:06,075 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_task_tmp.-ext-10000/_tmp.000000_0 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:57:06,096 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_task_tmp.-ext-10000/_tmp.000000_0 dst=null perm=null proto=rpc
2019-02-18 22:57:06,301 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=rename src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_task_tmp.-ext-10000/_tmp.000000_0 dst=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_tmp.-ext-10000/000000_0 perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:57:06,318 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10001 dst=null perm=null proto=rpc
2019-02-18 22:57:06,332 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10001/tmpstats-0 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:57:06,470 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0017/COMMIT_STARTED dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:57:06,481 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=create src=/user/hive/.staging/job_1544610861281_0017/COMMIT_SUCCESS dst=null perm=hive:hdfs:rw-r--r-- proto=rpc
2019-02-18 22:57:06,609 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017_1.jhist dst=null perm=null proto=rpc
2019-02-18 22:57:06,619 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017_1.jhist dst=null perm=null proto=rpc
2019-02-18 22:57:06,623 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017_1.jhist dst=null perm=null proto=rpc
2019-02-18 22:57:06,686 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017_1_conf.xml dst=null perm=null proto=rpc
2019-02-18 22:57:06,691 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=getfileinfo src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017_1_conf.xml dst=null perm=null proto=rpc
2019-02-18 22:57:06,696 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=open src=/user/hive/.staging/job_1544610861281_0017/job_1544610861281_0017_1_conf.xml dst=null perm=null proto=rpc
2019-02-18 22:57:07,863 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.107 cmd=delete src=/user/hive/.staging/job_1544610861281_0017 dst=null perm=null proto=rpc
2019-02-18 22:57:08,908 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_tmp.-ext-10000 dst=null perm=null proto=rpc
2019-02-18 22:57:08,909 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_tmp.-ext-10000 dst=null perm=null proto=rpc
2019-02-18 22:57:08,911 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 22:57:08,915 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=rename src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_tmp.-ext-10000 dst=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10000 perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:57:08,919 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=delete src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/_task_tmp.-ext-10000 dst=null perm=null proto=rpc
2019-02-18 22:57:09,061 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:57:09,064 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 22:57:09,065 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:57:09,067 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:57:09,068 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=listStatus src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10000 dst=null perm=null proto=rpc
2019-02-18 22:57:09,070 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/000000_0 dst=null perm=null proto=rpc
2019-02-18 22:57:09,072 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:57:09,073 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getAclStatus src=/apps/hive/warehouse/test/tm=2019-01-02 dst=null perm=null proto=rpc
2019-02-18 22:57:09,075 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10000/000000_0 dst=null perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:57:09,077 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getEZForPath src=/apps/hive/warehouse/test/tm=2019-01-02/000000_0 dst=null perm=null proto=rpc
2019-02-18 22:57:09,082 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=rename src=/apps/hive/warehouse/test/tm=2019-01-02/.hive-staging_hive_2019-02-18_22-56-41_758_4804708390440249292-1/-ext-10000/000000_0 dst=/apps/hive/warehouse/test/tm=2019-01-02/000000_0 perm=hive:hive:rwxrwx--x proto=rpc
2019-02-18 22:57:09,087 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/000000_0 dst=null perm=null proto=rpc
2019-02-18 22:57:09,090 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=getfileinfo src=/apps/hive/warehouse/test/tm=2019-01-02/000000_0 dst=null perm=null proto=rpc

以上操作触发cmd为mkdirs/open。

由以上看出，select一定会触发open,insert 一定会触发mkdirs。即read对应open,write对应mkdirs。

Love sniffing, love technology --aisniff zk

aiSniff

关注

1
点赞
踩
3

收藏

觉得还不错? 一键收藏
0
评论
探寻hdfs-audit log -2

从SQL层面上分析：insert 操作：2019-02-18 18:14:35,396 INFO FSNamesystem.audit: allowed=true ugi=hive (auth:SIMPLE) ip=/ip.151 cmd=delete src=/user/hive/.staging/job_1544610861281_0006 d...
复制链接

扫一扫

专栏目录