ceph mon自行shutdown故障记录

2019独角兽企业重金招聘Python工程师标准>>>

###日志详情

2016-06-26 19:16:51.237738 7fcc4ea8f700  5 mon.c207@1(peon).osd e10469 send_incremental [10469..10469] to osd.8 192.168.0.207:6836/9153
2016-06-26 19:16:55.527467 7fcc4f290700  0 mon.c207@1(peon).data_health(292) update_stats avail 5% total 243 GB, used 216 GB, avail 14943 MB
2016-06-26 19:16:55.527763 7fcc4f290700 -1 mon.c207@1(peon).data_health(292) reached critical levels of available space on local monitor storage -- shutdown!
2016-06-26 19:16:55.527769 7fcc4f290700  0 ** Shutdown via Data Health Service **
2016-06-26 19:16:55.527812 7fcc4ce88700 -1 mon.c207@1(peon) e5 *** Got Signal Interrupt ***
2016-06-26 19:16:55.527831 7fcc4ce88700  1 mon.c207@1(peon) e5 shutdown
2016-06-26 19:16:55.527932 7fcc4ce88700  0 quorum service shutdown
2016-06-26 19:16:55.527937 7fcc4ce88700  0 mon.c207@1(shutdown).health(292) HealthMonitor::service_shutdown 1 services
2016-06-26 19:16:55.527952 7fcc4ce88700  0 quorum service shutdown

主要在这个“reached critical levels of available space on local monitor storage”,如果mon使用的ceph数据目录所在的分区（/var/lib/ceph）硬盘使用率到达警戒值，它就会认为自己已经不存在运行所需的条件了，自己就把自己shutdown了，遇到这个错误，如果不降低磁盘的使用率是无法启动ceph mon的，各位可以视自己的实际情况清理数据。

转载于:https://my.oschina.net/xueyi28/blog/701383