OpenVZ Forum


Home » General » Support » Openvz7 container hangs at out of memory
Openvz7 container hangs at out of memory [message #52907] Wed, 02 August 2017 15:15 Go to previous message
wishd is currently offline  wishd
Messages: 4
Registered: June 2017
Junior Member
From: *interserver.net


Odd issue coming up. If a container runs out of memory it hangs. I can not stop, enter or shut it down. dmesg shows errors like:

Running kernel 3.10.0-514.16.1.vz7.30.15

[31650.198123] Task in /machine.slice/806bac77-11c9-4300-9959-32f4795ab5c3 killed as a result of limit of /machine.slice/806bac77-11c9-4300-9959-32f4795ab5c3
[31650.198125] memory: usage 2097164kB, limit 2097152kB, failcnt 10087303
[31650.198127] memory+swap: usage 3145872kB, limit 3145728kB, failcnt 218116
[31650.198129] kmem: usage 130864kB, limit 9007199254740988kB, failcnt 0
[31650.198130] Memory cgroup stats for /machine.slice/806bac77-11c9-4300-9959-32f4795ab5c3: cache:468KB rss:1965832KB rss_huge:0KB mapped_file:232KB shmem:256KB slab_reclaimable:37376KB slab_unreclaimable:41552KB swap:1048708KB inactive_anon:846572KB active_anon:1119516KB inactive_file:8KB active_file:0KB unevictable:0KB
[31650.198143] Memory cgroup out of memory: Kill process 865079 (mysqld) score 66 or sacrifice child
[31650.198186] Killed process 9910 (mysqld) in VE "806bac77-11c9-4300-9959-32f4795ab5c3" total-vm:908868kB, anon-rss:31720kB, file-rss:0kB, shmem-rss:0kB
[31801.312842] INFO: task ps:882799 blocked for more than 120 seconds.

I have these limits:
CT-806bac77 /# free
total used free shared buff/cache available
Mem: 2097152 291924 248116 316 1557112 1550724
Swap: 1048576 7044 1041532
CT-806bac77 /# df -m
Filesystem 1M-blocks Used Available Use% Mounted on
/dev/ploop32004p1 50267 22346 25755 47% /
none 32075 0 32075 0% /sys/fs/cgroup
none 32075 0 32075 0% /dev
tmpfs 1024 0 1024 0% /dev/shm
tmpfs 1024 1 1024 1% /run


806bac77-11c9-4300-9959-32f4795ab5c3: kmemsize 56086528 58318848 9223372036854775807 9223372036854775807 0
lockedpages 0 0 524288 524288 0
privvmpages 266606 276619 9223372036854775807 9223372036854775807 0
shmpages 420 2058 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
numproc 99 171 131072 131072 0
physpages 521225 524288 524288 524288 0
vmguarpages 0 0 786432 786432 0
oomguarpages 523579 526664 0 0 0
numtcpsock 0 0 9223372036854775807 9223372036854775807 0
numflock 16 21 9223372036854775807 9223372036854775807 0
numpty 0 0 9223372036854775807 9223372036854775807 0
numsiginfo 0 57 9223372036854775807 9223372036854775807 0
tcpsndbuf 0 0 9223372036854775807 9223372036854775807 0
tcprcvbuf 0 0 9223372036854775807 9223372036854775807 0
othersockbuf 0 0 9223372036854775807 9223372036854775807 0
dgramrcvbuf 0 0 9223372036854775807 9223372036854775807 0
numothersock 0 0 9223372036854775807 9223372036854775807 0
dcachesize 16924672 16924672 9223372036854775807 9223372036854775807 0
numfile 1642 1985 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
numiptent 544 547 2000 2000 0


The load on the system runs up as well when this happens. All other vm's work fine and I can enter them. Only containers are running on this, 16 with overall plenty of free CPU and ram otherwise.

 
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: VZ7 DCACHESIZE parameter is deprecated
Next Topic: never mind
Goto Forum:
  


Current Time: Wed Nov 22 20:13:36 GMT 2017