今天发现服务器磁盘空间满了
[root@iZbp18gb6btbrwzehuvi1aZ data]# du -sh *|sort -rh
112G inception.log
0 test
[root@iZbp18gb6btbrwzehuvi1aZ data]# pwd
/data/kube/docker/overlay2/6493ac8010837eec70dba1d6ebc8c03a02271d80db399fe0b94d643d617ff0a8/merged/usr/local/inception/data
[root@iZbp18gb6btbrwzehuvi1aZ data]#
[root@iZbp18gb6btbrwzehuvi1aZ data]# du -sh *|sort -rh
112G inception.log
[root@iZbp18gb6btbrwzehuvi1aZ data]# pwd
/data/kube/docker/overlay2/6493ac8010837eec70dba1d6ebc8c03a02271d80db399fe0b94d643d617ff0a8/diff/usr/local/inception/data
[root@iZbp18gb6btbrwzehuvi1aZ data]# ll
total 116670352
-rw-rw---- 1 root root 118564612160 Sep 19 15:23 inception.log
排查发现是docker容器输出的错误日志导致的
根据目录名排查出容器的名称和容器id
[root@ecs-c2b3-0421038 overlay2]# docker ps | awk '{print $1}' | xargs docker inspect --format '{{.State.Pid}}, {{.Id}}, {{.Name}}, {{.GraphDriver.Data.WorkDir}}' | grep 259ffcce28e68f0cd06cfa464792db78fdd1e86959f1c86ce8415d1c501e9870
Error: No such object: CONTAINER