mysql docker oom_docker容器OOM后 再也无法启动

docker 运行容器没有做内存限制导到OOM，容器挂掉无法docker start启动了，以下是一些系统信息，希望在这里能得到一些帮助。

dmesg信息：

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: 500 226580 283 2 22 0 0 sh

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: 500 226581 283 2 9 0 0 sh

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: 500 226582 283 2 13 0 0 sh

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: 500 226583 283 2 21 0 0 sh

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: 500 226584 283 2 7 0 0 sh

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: 0 226585 3159 16 14 0 0 sh

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: 0 226586 10638 0 23 0 0 crond

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: Out of memory: Kill process 114080 (java) score 2 or sacrifice child

Mar 5 05:43:58 GD9-YFB-DOCKER-004 kernel: Killed process 114080, UID 500, (java) total-vm:4927912kB, anon-rss:201052kB, file-rss:696kB

unregister_netdevice: waiting for lo to become free. Usage count = 42

EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts:

lo: Disabled Privacy Extensions

device veth0pl95215 entered promiscuous mode

ADDRCONF(NETDEV_UP): veth0pl95215: link is not ready

ADDRCONF(NETDEV_CHANGE): veth0pl95215: link becomes ready

br0: port 3(veth0pl95215) entering forwarding state

br0: port 3(veth0pl95215) entering disabled state

device veth0pl95215 left promiscuous mode

br0: port 3(veth0pl95215) entering disabled state

EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts:

lo: Disabled Privacy Extensions

device veth0pl95548 entered promiscuous mode

ADDRCONF(NETDEV_UP): veth0pl95548: link is not ready

br0: port 3(veth0pl95548) entering disabled state

device veth0pl95548 left promiscuous mode

br0: port 3(veth0pl95548) entering disabled state

EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts:

lo: Disabled Privacy Extensions

device veth0pl101922 entered promiscuous mode

ADDRCONF(NETDEV_UP): veth0pl101922: link is not ready

EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts:

lo: Disabled Privacy Extensions

EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts:

strace docker start信息：

futex(0xc208020b58, FUTEX_WAKE, 1) = 1

ioctl(0, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0

ioctl(1, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0

stat("/root/.docker/config.json", 0xc2080863f0) = -1 ENOENT (No such file or directory)

stat("/root/.dockercfg", 0xc208086510) = -1 ENOENT (No such file or directory)

socket(PF_FILE, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 4

setsockopt(4, SOL_SOCKET, SO_BROADCAST, , 4) = 0

connect(4, {sa_family=AF_FILE, path="/var/run/docker.sock"}, 23) = 0

epoll_create1(O_CLOEXEC) = 5

epoll_ctl(5, EPOLL_CTL_ADD, 4, {EPOLLIN|EPOLLOUT|EPOLLET|0x2000, {u32=1229620936, u64=140657113597640}}) = 0

getsockname(4, {sa_family=AF_FILE, NULL}, ) = 0

getpeername(4, {sa_family=AF_FILE, path="/var/run/docker.sock"}, ) = 0

read(4, 0xc20800f000, 4096) = -1 EAGAIN (Resource temporarily unavailable)

write(4, "POST /v1.19/containers/home.xx."..., 160) = 160

close(3) = 0

epoll_wait(5, {{EPOLLOUT, {u32=1229620936, u64=140657113597640}}}, 128, 0) = 1

epoll_wait(5, {{EPOLLIN|EPOLLOUT, {u32=1229620936, u64=140657113597640}}}, 128, 4294967295) = 1

futex(0x126f160, FUTEX_WAKE, 1) = 1

read(4, "HTTP/1.1 204 No Content\r\nDate: S"..., 4096) = 64

read(4, 0xc20800f000, 4096) = -1 EAGAIN (Resource temporarily unavailable)

write(1, "home.xx.com\n", 13home.xx.com

) = 13

exit_group(0) = ?

docker info:

Containers: 11

Images: 11

Storage Driver: devicemapper

Pool Name: docker-8:3-61210997-pool

Pool Blocksize: 65.54 kB

Backing Filesystem: extfs

Data file: /dev/loop0

Metadata file: /dev/loop1

Data Space Used: 14.49 GB

Data Space Total: 1.074 TB

Data Space Available: 1.059 TB

Metadata Space Used: 12.61 MB

Metadata Space Total: 2.147 GB

Metadata Space Available: 2.135 GB

Udev Sync Supported: true

Deferred Removal Enabled: false

Data loop file: /var/lib/docker/devicemapper/devicemapper/data

Metadata loop file: /var/lib/docker/devicemapper/devicemapper/metadata

Library Version: 1.02.89-RHEL6 (2014-09-01)

Execution Driver: native-0.2

Logging Driver: json-file

Kernel Version: 2.6.32-573.el6.x86_64

Operating System:

CPUs: 24

Total Memory: 126.1 GiB

Name: GD9-YFB-DOCKER-004

ID: J2FV:DPMQ:PN76:V7HA:APA5:OL6O:H7JT:DCIZ:WQCZ:KXX4:MDFV:KJN4

docker version:

Client version: 1.7.1

Client API version: 1.19

Go version (client): go1.4.2

Git commit (client): 786b29d/1.7.1

OS/Arch (client): linux/amd64

Server version: 1.7.1

Server API version: 1.19

Go version (server): go1.4.2

Git commit (server): 786b29d/1.7.1

OS/Arch (server): linux/amd64