| Openvz7 container hangs at out of memory [message #52907] |
Wed, 02 August 2017 15:15  |
wishd
Messages: 14
Registered: June 2017
|
Junior Member |
|
|
Odd issue coming up. If a container runs out of memory it hangs. I can not stop, enter or shut it down. dmesg shows errors like:
Running kernel 3.10.0-514.16.1.vz7.30.15
[31650.198123] Task in /machine.slice/806bac77-11c9-4300-9959-32f4795ab5c3 killed as a result of limit of /machine.slice/806bac77-11c9-4300-9959-32f4795ab5c3
[31650.198125] memory: usage 2097164kB, limit 2097152kB, failcnt 10087303
[31650.198127] memory+swap: usage 3145872kB, limit 3145728kB, failcnt 218116
[31650.198129] kmem: usage 130864kB, limit 9007199254740988kB, failcnt 0
[31650.198130] Memory cgroup stats for /machine.slice/806bac77-11c9-4300-9959-32f4795ab5c3: cache:468KB rss:1965832KB rss_huge:0KB mapped_file:232KB shmem:256KB slab_reclaimable:37376KB slab_unreclaimable:41552KB swap:1048708KB inactive_anon:846572KB active_anon:1119516KB inactive_file:8KB active_file:0KB unevictable:0KB
[31650.198143] Memory cgroup out of memory: Kill process 865079 (mysqld) score 66 or sacrifice child
[31650.198186] Killed process 9910 (mysqld) in VE "806bac77-11c9-4300-9959-32f4795ab5c3" total-vm:908868kB, anon-rss:31720kB, file-rss:0kB, shmem-rss:0kB
[31801.312842] INFO: task ps:882799 blocked for more than 120 seconds.
I have these limits:
CT-806bac77 /# free
total used free shared buff/cache available
Mem: 2097152 291924 248116 316 1557112 1550724
Swap: 1048576 7044 1041532
CT-806bac77 /# df -m
Filesystem 1M-blocks Used Available Use% Mounted on
/dev/ploop32004p1 50267 22346 25755 47% /
none 32075 0 32075 0% /sys/fs/cgroup
none 32075 0 32075 0% /dev
tmpfs 1024 0 1024 0% /dev/shm
tmpfs 1024 1 1024 1% /run
806bac77-11c9-4300-9959-32f4795ab5c3: kmemsize 56086528 58318848 9223372036854775807 9223372036854775807 0
lockedpages 0 0 524288 524288 0
privvmpages 266606 276619 9223372036854775807 9223372036854775807 0
shmpages 420 2058 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
numproc 99 171 131072 131072 0
physpages 521225 524288 524288 524288 0
vmguarpages 0 0 786432 786432 0
oomguarpages 523579 526664 0 0 0
numtcpsock 0 0 9223372036854775807 9223372036854775807 0
numflock 16 21 9223372036854775807 9223372036854775807 0
numpty 0 0 9223372036854775807 9223372036854775807 0
numsiginfo 0 57 9223372036854775807 9223372036854775807 0
tcpsndbuf 0 0 9223372036854775807 9223372036854775807 0
tcprcvbuf 0 0 9223372036854775807 9223372036854775807 0
othersockbuf 0 0 9223372036854775807 9223372036854775807 0
dgramrcvbuf 0 0 9223372036854775807 9223372036854775807 0
numothersock 0 0 9223372036854775807 9223372036854775807 0
dcachesize 16924672 16924672 9223372036854775807 9223372036854775807 0
numfile 1642 1985 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
numiptent 544 547 2000 2000 0
The load on the system runs up as well when this happens. All other vm's work fine and I can enter them. Only containers are running on this, 16 with overall plenty of free CPU and ram otherwise.
|
|
|
|
OpenVZ Forum
Members
Search
Help
Register
Login
Home
