OpenVZ Forum


Home » General » Support » Centos6 and OpenVZ memory problems (Node restarting due to excessive usage of Memory)
Centos6 and OpenVZ memory problems [message #43470] Wed, 14 September 2011 13:01 Go to previous message
rshosting is currently offline  rshosting
Messages: 1
Registered: September 2011
Junior Member
Hello,

First of all I would like to introduce myself here.. This is Sam here and have been in web hosting business since quite a long time now..

We have been using Openvz with SolusVM control panel to offer vitual servers to our clients. Our previous servers have Centos 5 and Openvz which runs like a charm.

Recently we had our new node ordered and I thought i better go with Centos 6. I had Openvz installed along with SolusVM on the server.

However, we have noticed, Openvz is not going along that well with Centos6, and is overusing the memory on the server. The node as a result gets rebooted frequently after every couple of days.

We suspected if it was the physical memory issue on the node, however it is good and not the main problem.

Existing Node details :
Server : Dell Quad Core Xeon E5620 2.40GHz
Physical RAM : 16 GB DDR3
SWAP : 16 GB
Drives : 4 x 1TB in RAID 10
OS : Centos 6 (64 bit)
Openvz Kernel : 2.6.32-042stab036.1

Listed below are few memory related mesages from dmesg :
Quote:

[92477.082356] Node 0 Normal scan:32 a_anon:34553 i_anon:1953 a_file:0 i_file:35 unevictable:0
[92477.082366] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[92477.082376] Node 1 DMA32 scan:0 a_anon:1527 i_anon:286 a_file:0 i_file:1 unevictable:0
[92477.082386] Node 1 Normal scan:32 a_anon:41958 i_anon:2419 a_file:1 i_file:4 unevictable:0
[92477.082397] Total 82737 anon:82696 file:41 a_anon:78038 i_anon:4658 a_file:1 i_file:40 unevictable:0
[92477.082409] UB: 183 RAM: 88891 / 98304 [193] SWAP: 21808 / 32768 [193] KMEM: 24547328 / 201326592 [0] Dirty 0
[92486.775157] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[92486.775164] php cpuset=183 mems_allowed=0-1
[92486.775167] UB-183-Mem-Info:
[92486.775172] Node 0 Normal scan:1181 a_anon:40111 i_anon:4771 a_file:0 i_file:4 unevictable:0
[92486.775177] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[92486.775181] Node 1 DMA32 scan:1536 a_anon:557 i_anon:253 a_file:0 i_file:2 unevictable:0
[92486.775186] Node 1 Normal scan:1473 a_anon:42414 i_anon:4538 a_file:1 i_file:4 unevictable:0
[92486.775192] Total 92657 anon:92644 file:13 a_anon:83082 i_anon:9562 a_file:1 i_file:12 unevictable:0
[92486.775197] UB: 183 RAM: 98291 / 98304 [194] SWAP: 32793 / 32768 [194] KMEM: 22822912 / 201326592 [0] Dirty 0
[92486.775202] Out of memory in UB: kill process 364821 (mysqld) or a child
[92486.775490] Killed process 364821 (mysqld) vsz:272224kB, anon-rss:22536kB, file-rss:420kB
[92486.908373] OOM killed process mysqld (pid=364821, ve=183) exited, free=263440.
[92486.908543] UB-183-Mem-Info:
[92486.908549] Node 0 Normal scan:89444 a_anon:36719 i_anon:4781 a_file:1 i_file:127 unevictable:0
[92486.908556] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[92486.908563] Node 1 DMA32 scan:46915 a_anon:555 i_anon:261 a_file:0 i_file:0 unevictable:0
[92486.908570] Node 1 Normal scan:9272 a_anon:40212 i_anon:4538 a_file:0 i_file:5 unevictable:0
[92486.908579] Total 87199 anon:87066 file:133 a_anon:77486 i_anon:9580 a_file:1 i_file:132 unevictable:0
[92486.908587] UB: 183 RAM: 92852 / 98304 [208] SWAP: 32276 / 32768 [208] KMEM: 22646784 / 201326592 [0] Dirty 0
[92487.368083] mysqld invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[92487.368090] mysqld cpuset=183 mems_allowed=0-1
[92487.368093] Out of memory in UB: kill process 364329 (php) or a child
[92487.368173] Killed process 364329 (php) vsz:128812kB, anon-rss:28076kB, file-rss:788kB
[92487.373705] OOM killed process php (pid=364329, ve=183) exited, free=274441.
[92487.793675] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[92487.793682] php cpuset=183 mems_allowed=0-1
[92487.793685] Out of memory in UB: kill process 364914 (mysqld) or a child
[92487.793925] Killed process 364914 (mysqld) vsz:271892kB, anon-rss:13736kB, file-rss:432kB
[92487.795747] OOM killed process mysqld (pid=364914, ve=183) exited, free=270716.
[92487.924192] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[92487.924197] php cpuset=183 mems_allowed=0-1
[92487.924200] Out of memory in UB: kill process 364684 (php) or a child
[92487.924279] Killed process 364684 (php) vsz:130040kB, anon-rss:36088kB, file-rss:1056kB
[92487.933825] OOM killed process php (pid=364684, ve=183) exited, free=274379.
[94157.964842] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[94157.964847] php cpuset=188 mems_allowed=0-1
[94157.964850] UB-188-Mem-Info:
[94157.964853] Node 0 Normal scan:242 a_anon:56065 i_anon:7924 a_file:0 i_file:0 unevictable:0
[94157.964858] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[94157.964862] Node 1 DMA32 scan:0 a_anon:2847 i_anon:806 a_file:0 i_file:0 unevictable:0
[94157.964866] Node 1 Normal scan:30 a_anon:20771 i_anon:3489 a_file:9 i_file:11 unevictable:0
[94157.964871] Total 91922 anon:91902 file:20 a_anon:79683 i_anon:12219 a_file:9 i_file:11 unevictable:0
[94157.964876] UB: 188 RAM: 98145 / 98304 [12] SWAP: 32816 / 32768 [12] KMEM: 21098496 / 201326592 [0] Dirty 0
[94157.964880] Out of memory in UB: kill process 421327 (php) or a child
[94157.965144] Killed process 421327 (php) vsz:137724kB, anon-rss:37968kB, file-rss:376kB
[94157.971771] OOM killed process php (pid=421327, ve=188) exited, free=326718.
[94157.971776] UB-188-Mem-Info:
[94157.971781] Node 0 Normal scan:0 a_anon:49288 i_anon:7805 a_file:145 i_file:408 unevictable:0
[94157.971786] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[94157.971790] Node 1 DMA32 scan:0 a_anon:3019 i_anon:663 a_file:0 i_file:1 unevictable:0
[94157.971795] Node 1 Normal scan:0 a_anon:17992 i_anon:3434 a_file:133 i_file:182 unevictable:0
[94157.971801] Total 83081 anon:82201 file:880 a_anon:70299 i_anon:11902 a_file:278 i_file:602 unevictable:0
[94157.971807] UB: 188 RAM: 89295 / 98304 [12] SWAP: 31248 / 32768 [12] KMEM: 20742144 / 201326592 [0] Dirty 0
[96077.906840] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[96077.906847] php cpuset=183 mems_allowed=0-1
[96077.906850] __ratelimit: 6 callbacks suppressed
[96077.906853] UB-183-Mem-Info:
[96077.906858] Node 0 Normal scan:5276 a_anon:53731 i_anon:6033 a_file:0 i_file:6 unevictable:0
[96077.906863] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[96077.906867] Node 1 DMA32 scan:9 a_anon:3187 i_anon:664 a_file:0 i_file:0 unevictable:0
[96077.906872] Node 1 Normal scan:9192 a_anon:24625 i_anon:3222 a_file:2 i_file:29 unevictable:0
[96077.906877] Total 91498 anon:91462 file:36 a_anon:81543 i_anon:9919 a_file:2 i_file:34 unevictable:0
[96077.906883] UB: 183 RAM: 98272 / 98304 [229] SWAP: 32803 / 32768 [229] KMEM: 21028864 / 201326592 [0] Dirty 0
[96077.906888] Out of memory in UB: kill process 365734 (mysqld_safe) or a child
[96077.907231] Killed process 365766 (mysqld) vsz:280488kB, anon-rss:31424kB, file-rss:488kB
[96077.920155] OOM killed process mysqld (pid=486348, ve=183) exited, free=255613.
[96077.920161] UB-183-Mem-Info:
[96077.920165] Node 0 Normal scan:5725 a_anon:50185 i_anon:4891 a_file:0 i_file:0 unevictable:0
[96077.920170] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[96077.920175] Node 1 DMA32 scan:9 a_anon:2505 i_anon:569 a_file:0 i_file:0 unevictable:0
[96077.920180] Node 1 Normal scan:9917 a_anon:22872 i_anon:2832 a_file:2 i_file:29 unevictable:0
[96077.920185] Total 83885 anon:83854 file:31 a_anon:75562 i_anon:8292 a_file:2 i_file:29 unevictable:0
[96077.920191] UB: 183 RAM: 90762 / 98304 [229] SWAP: 22422 / 32768 [229] KMEM: 20586496 / 201326592 [0] Dirty 0
[97492.758629] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[97492.758636] php cpuset=183 mems_allowed=0-1
[97492.758640] UB-183-Mem-Info:
[97492.758644] Node 0 Normal scan:64 a_anon:42773 i_anon:4799 a_file:0 i_file:0 unevictable:0
[97492.758649] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[97492.758654] Node 1 DMA32 scan:27 a_anon:26398 i_anon:3277 a_file:0 i_file:0 unevictable:0
[97492.758658] Node 1 Normal scan:136 a_anon:13681 i_anon:2217 a_file:0 i_file:0 unevictable:0
[97492.758664] Total 93145 anon:93145 file:0 a_anon:82852 i_anon:10293 a_file:0 i_file:0 unevictable:0
[97492.758669] UB: 183 RAM: 98302 / 98304 [230] SWAP: 32788 / 32768 [230] KMEM: 19886080 / 201326592 [0] Dirty 0
[97492.758674] Out of memory in UB: kill process 365734 (mysqld_safe) or a child
[97492.759076] Killed process 486584 (mysqld) vsz:277728kB, anon-rss:23284kB, file-rss:528kB
[97492.769883] OOM killed process mysqld (pid=486668, ve=183) exited, free=266622.
[97492.770007] UB-183-Mem-Info:
[97492.770014] Node 0 Normal scan:32 a_anon:40343 i_anon:3050 a_file:2 i_file:225 unevictable:0
[97492.770021] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[97492.770028] Node 1 DMA32 scan:32 a_anon:25652 i_anon:3115 a_file:0 i_file:0 unevictable:0
[97492.770036] Node 1 Normal scan:32 a_anon:12981 i_anon:2116 a_file:1 i_file:8 unevictable:0
[97492.770044] Total 87493 anon:87257 file:236 a_anon:78976 i_anon:8281 a_file:3 i_file:233 unevictable:0
[97492.770050] UB: 183 RAM: 92719 / 98304 [238] SWAP: 24116 / 32768 [238] KMEM: 19759104 / 201326592 [0] Dirty 0
[108608.489396] CT: 188: stopped
[108609.672423] CT: 188: started
[113206.445641] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1579 11 503 0 pipe failed
[113206.445658] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1582 11 503 0 pipe failed
[113206.445671] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1580 11 503 0 pipe failed
[113206.445682] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1573 11 503 0 pipe failed
[113206.445690] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1581 11 503 0 pipe failed
[113206.445807] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1584 11 503 0 pipe failed
[113206.445815] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1578 11 503 0 pipe failed
[113206.445832] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1576 11 503 0 pipe failed
[113206.445876] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1574 11 503 0 pipe failed
[113206.445927] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 1572 11 503 0 pipe failed
[116748.152521] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 13829 11 502 0 pipe failed
[118247.634500] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4537 11 505 0 pipe failed
[118247.634519] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4531 11 505 0 pipe failed
[118247.634574] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4529 11 505 0 pipe failed
[118247.634586] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4528 11 505 0 pipe failed
[118247.634880] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4534 11 505 0 pipe failed
[118247.634946] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4532 11 505 0 pipe failed
[118247.635037] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4530 11 505 0 pipe failed
[118247.635049] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4536 11 505 0 pipe failed
[118247.635222] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4535 11 505 0 pipe failed
[118247.635258] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 4533 11 505 0 pipe failed
[130699.235446] Core dump to |/usr/libexec/abrt-hook-ccpp /var/spool/abrt 27935 11 502 0 pipe failed
[138345.100388] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138345.100394] php cpuset=188 mems_allowed=0-1
[138345.100396] UB-188-Mem-Info:
[138345.100400] Node 0 Normal scan:113 a_anon:28275 i_anon:3439 a_file:0 i_file:0 unevictable:0
[138345.100404] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[138345.100409] Node 1 DMA32 scan:0 a_anon:1 i_anon:36 a_file:0 i_file:0 unevictable:0
[138345.100413] Node 1 Normal scan:23 a_anon:52833 i_anon:8791 a_file:5 i_file:0 unevictable:0
[138345.100418] Total 93380 anon:93375 file:5 a_anon:81109 i_anon:12266 a_file:5 i_file:0 unevictable:0
[138345.100423] UB: 188 RAM: 98287 / 98304 [13] SWAP: 32812 / 32768 [13] KMEM: 19292160 / 201326592 [0] Dirty 0
[138345.100427] Out of memory in UB: kill process 799805 (mysqld_safe) or a child
[138345.100847] Killed process 799829 (mysqld) vsz:128712kB, anon-rss:8616kB, file-rss:188kB
[138345.106371] OOM killed process mysqld (pid=837278, ve=188) exited, free=387793.
[138345.106377] UB-188-Mem-Info:
[138345.106381] Node 0 Normal scan:310 a_anon:27013 i_anon:3434 a_file:16 i_file:62 unevictable:0
[138345.106386] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[138345.106391] Node 1 DMA32 scan:0 a_anon:0 i_anon:12 a_file:0 i_file:0 unevictable:0
[138345.106395] Node 1 Normal scan:0 a_anon:52136 i_anon:8655 a_file:25 i_file:40 unevictable:0
[138345.106401] Total 91393 anon:91250 file:143 a_anon:79149 i_anon:12101 a_file:41 i_file:102 unevictable:0
[138345.106407] UB: 188 RAM: 96225 / 98304 [13] SWAP: 28338 / 32768 [13] KMEM: 18788352 / 201326592 [0] Dirty 0
[138345.741929] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138345.741936] php cpuset=188 mems_allowed=0-1
[138345.741938] UB-188-Mem-Info:
[138345.741943] Node 0 Normal scan:3027 a_anon:28559 i_anon:3522 a_file:0 i_file:4 unevictable:0
[138345.741948] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[138345.741952] Node 1 DMA32 scan:17 a_anon:0 i_anon:8 a_file:0 i_file:0 unevictable:0
[138345.741956] Node 1 Normal scan:2432 a_anon:52888 i_anon:8781 a_file:0 i_file:0 unevictable:0
[138345.741961] Total 93764 anon:93758 file:6 a_anon:81447 i_anon:12311 a_file:0 i_file:6 unevictable:0
[138345.741967] UB: 188 RAM: 98301 / 98304 [14] SWAP: 32792 / 32768 [14] KMEM: 18137088 / 201326592 [0] Dirty 0
[138345.741972] Out of memory in UB: kill process 837257 (php) or a child
[138345.742211] Killed process 837257 (php) vsz:86540kB, anon-rss:39620kB, file-rss:464kB
[138345.751692] OOM killed process php (pid=837257, ve=188) exited, free=392059.
[138345.751775] UB-188-Mem-Info:
[138345.751782] Node 0 Normal scan:0 a_anon:22632 i_anon:1889 a_file:0 i_file:149 unevictable:0
[138345.751790] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[138345.751797] Node 1 DMA32 scan:8 a_anon:0 i_anon:8 a_file:0 i_file:0 unevictable:0
[138345.751804] Node 1 Normal scan:32 a_anon:51421 i_anon:7884 a_file:4 i_file:41 unevictable:0
[138345.751811] Total 84028 anon:83834 file:194 a_anon:74053 i_anon:9781 a_file:4 i_file:190 unevictable:0
[138345.751817] UB: 188 RAM: 88781 / 98304 [16] SWAP: 29801 / 32768 [16] KMEM: 17903616 / 201326592 [0] Dirty 0
[138348.159302] mysqld invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138348.159308] mysqld cpuset=188 mems_allowed=0-1
[138348.159311] Out of memory in UB: kill process 799805 (mysqld_safe) or a child
[138348.159639] Killed process 837325 (mysqld) vsz:121532kB, anon-rss:15724kB, file-rss:292kB
[138348.162007] OOM killed process mysqld (pid=837332, ve=188) exited, free=389539.
[138348.336231] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138348.336242] php cpuset=188 mems_allowed=0-1
[138348.336248] Out of memory in UB: kill process 837260 (php) or a child
[138348.336337] Killed process 837260 (php) vsz:91228kB, anon-rss:54020kB, file-rss:904kB
[138348.358052] OOM killed process php (pid=837260, ve=188) exited, free=397038.
[138349.146070] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138349.146076] php cpuset=188 mems_allowed=0-1
[138349.146079] Out of memory in UB: kill process 837344 (php) or a child
[138349.146157] Killed process 837344 (php) vsz:168060kB, anon-rss:133676kB, file-rss:1004kB
[138349.153901] OOM killed process php (pid=837344, ve=188) exited, free=414934.
[138384.643414] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138384.643421] php cpuset=188 mems_allowed=0-1
[138384.643425] Out of memory in UB: kill process 799805 (mysqld_safe) or a child
[138384.643809] Killed process 837377 (mysqld) vsz:125968kB, anon-rss:7892kB, file-rss:288kB
[138384.648328] OOM killed process mysqld (pid=839815, ve=188) exited, free=359389.
[138385.017813] mysqld invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138385.017818] mysqld cpuset=188 mems_allowed=0-1
[138385.017820] Out of memory in UB: kill process 839762 (php) or a child
[138385.017897] Killed process 839762 (php) vsz:87756kB, anon-rss:53220kB, file-rss:468kB
[138385.043087] OOM killed process php (pid=839762, ve=188) exited, free=374384.
[138386.232390] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138386.232396] php cpuset=188 mems_allowed=0-1
[138386.232399] Out of memory in UB: kill process 799805 (mysqld_safe) or a child
[138386.232681] Killed process 839972 (mysqld) vsz:117228kB, anon-rss:11048kB, file-rss:240kB
[138386.234173] OOM killed process mysqld (pid=839981, ve=188) exited, free=372243.
[138386.326274] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138386.326281] php cpuset=188 mems_allowed=0-1
[138386.326284] Out of memory in UB: kill process 839649 (php) or a child
[138386.326364] Killed process 839649 (php) vsz:93504kB, anon-rss:42840kB, file-rss:652kB
[138386.334172] OOM killed process php (pid=839649, ve=188) exited, free=383158.
[138465.335322] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138465.335329] php cpuset=188 mems_allowed=0-1
[138465.335332] Out of memory in UB: kill process 840118 (mysqld_safe) or a child
[138465.335654] Killed process 840142 (mysqld) vsz:129796kB, anon-rss:10280kB, file-rss:264kB
[138465.340396] OOM killed process mysqld (pid=843815, ve=188) exited, free=386755.
[138465.687470] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138465.687476] php cpuset=188 mems_allowed=0-1
[138465.687479] Out of memory in UB: kill process 843801 (php) or a child
[138465.687558] Killed process 843801 (php) vsz:86568kB, anon-rss:47560kB, file-rss:592kB
[138465.693545] OOM killed process php (pid=843801, ve=188) exited, free=394694.
[138466.447619] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138466.447626] php cpuset=188 mems_allowed=0-1
[138466.447629] Out of memory in UB: kill process 840118 (mysqld_safe) or a child
[138466.447924] Killed process 843875 (mysqld) vsz:116700kB, anon-rss:10700kB, file-rss:296kB
[138466.449144] OOM killed process mysqld (pid=843886, ve=188) exited, free=375503.
[138466.569203] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138466.569209] php cpuset=188 mems_allowed=0-1
[138466.569212] Out of memory in UB: kill process 843802 (php) or a child
[138466.569291] Killed process 843802 (php) vsz:90412kB, anon-rss:49552kB, file-rss:840kB
[138466.575490] OOM killed process php (pid=843802, ve=188) exited, free=382034.
[138902.738723] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138902.738728] php cpuset=188 mems_allowed=0-1
[138902.738731] __ratelimit: 22 callbacks suppressed
[138902.738732] UB-188-Mem-Info:
[138902.738735] Node 0 Normal scan:508 a_anon:58415 i_anon:7281 a_file:3 i_file:0 unevictable:0
[138902.738740] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[138902.738743] Node 1 DMA32 scan:2 a_anon:1986 i_anon:217 a_file:0 i_file:0 unevictable:0
[138902.738746] Node 1 Normal scan:66 a_anon:21006 i_anon:3516 a_file:0 i_file:0 unevictable:0
[138902.738750] Total 92424 anon:92421 file:3 a_anon:81407 i_anon:11014 a_file:3 i_file:0 unevictable:0
[138902.738755] UB: 188 RAM: 98298 / 98304 [71] SWAP: 32771 / 32768 [71] KMEM: 20668416 / 201326592 [0] Dirty 0
[138902.738758] Out of memory in UB: kill process 840118 (mysqld_safe) or a child
[138902.739034] Killed process 843926 (mysqld) vsz:128392kB, anon-rss:9852kB, file-rss:284kB
[138902.742996] OOM killed process mysqld (pid=859571, ve=188) exited, free=286757.
[138902.743001] UB-188-Mem-Info:
[138902.743005] Node 0 Normal scan:740 a_anon:57392 i_anon:7295 a_file:22 i_file:83 unevictable:0
[138902.743009] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[138902.743013] Node 1 DMA32 scan:32 a_anon:1952 i_anon:248 a_file:0 i_file:0 unevictable:0
[138902.743017] Node 1 Normal scan:32 a_anon:20058 i_anon:3022 a_file:7 i_file:41 unevictable:0
[138902.743022] Total 90120 anon:89967 file:153 a_anon:79402 i_anon:10565 a_file:29 i_file:124 unevictable:0
[138902.743027] UB: 188 RAM: 95903 / 98304 [71] SWAP: 29969 / 32768 [71] KMEM: 20217856 / 201326592 [0] Dirty 0
[138903.104004] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138903.104009] php cpuset=188 mems_allowed=0-1
[138903.104011] UB-188-Mem-Info:
[138903.104014] Node 0 Normal scan:97 a_anon:57502 i_anon:7190 a_file:0 i_file:0 unevictable:0
[138903.104017] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[138903.104020] Node 1 DMA32 scan:6 a_anon:4515 i_anon:850 a_file:0 i_file:0 unevictable:0
[138903.104023] Node 1 Normal scan:96 a_anon:19705 i_anon:3271 a_file:4 i_file:0 unevictable:0
[138903.104027] Total 93037 anon:93033 file:4 a_anon:81722 i_anon:11311 a_file:4 i_file:0 unevictable:0
[138903.104031] UB: 188 RAM: 98290 / 98304 [72] SWAP: 32802 / 32768 [72] KMEM: 19779584 / 201326592 [0] Dirty 0
[138903.104034] Out of memory in UB: kill process 859486 (php) or a child
[138903.104111] Killed process 859486 (php) vsz:80800kB, anon-rss:36316kB, file-rss:692kB
[138903.131569] OOM killed process php (pid=859486, ve=188) exited, free=299675.
[138903.131572] UB-188-Mem-Info:
[138903.131575] Node 0 Normal scan:288 a_anon:52202 i_anon:6154 a_file:433 i_file:118 unevictable:0
[138903.131578] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[138903.131581] Node 1 DMA32 scan:32 a_anon:4266 i_anon:850 a_file:2 i_file:2 unevictable:0
[138903.131584] Node 1 Normal scan:32 a_anon:17555 i_anon:3129 a_file:57 i_file:110 unevictable:0
[138903.131587] Total 84878 anon:84156 file:722 a_anon:74023 i_anon:10133 a_file:492 i_file:230 unevictable:0
[138903.131591] UB: 188 RAM: 90248 / 98304 [72] SWAP: 30451 / 32768 [72] KMEM: 19542016 / 201326592 [0] Dirty 0
[138903.727047] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138903.727058] php cpuset=188 mems_allowed=0-1
[138903.727064] Out of memory in UB: kill process 840118 (mysqld_safe) or a child
[138903.727525] Killed process 859639 (mysqld) vsz:116700kB, anon-rss:12316kB, file-rss:280kB
[138903.729430] OOM killed process mysqld (pid=859655, ve=188) exited, free=320715.
[138903.956178] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[138903.956182] php cpuset=188 mems_allowed=0-1
[138903.956185] Out of memory in UB: kill process 859482 (php) or a child
[138903.956262] Killed process 859482 (php) vsz:89192kB, anon-rss:47968kB, file-rss:804kB
[138903.969636] OOM killed process php (pid=859482, ve=188) exited, free=331042.
[140448.809835] hrtimer: interrupt took 33123 ns
[140449.673179] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[140449.673184] php cpuset=188 mems_allowed=0-1
[140449.673187] __ratelimit: 4 callbacks suppressed
[140449.673189] UB-188-Mem-Info:
[140449.673192] Node 0 Normal scan:128 a_anon:44080 i_anon:4665 a_file:0 i_file:9 unevictable:0
[140449.673197] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[140449.673200] Node 1 DMA32 scan:1 a_anon:35433 i_anon:6667 a_file:0 i_file:0 unevictable:0
[140449.673204] Node 1 Normal scan:6 a_anon:1268 i_anon:237 a_file:0 i_file:0 unevictable:0
[140449.673209] Total 92367 anon:92350 file:17 a_anon:80781 i_anon:11569 a_file:17 i_file:0 unevictable:0
[140449.673213] UB: 188 RAM: 98261 / 98304 [83] SWAP: 32775 / 32768 [83] KMEM: 22544384 / 201326592 [0] Dirty 0
[140449.673217] Out of memory in UB: kill process 840118 (mysqld_safe) or a child
[140449.673691] Killed process 859684 (mysqld) vsz:129748kB, anon-rss:8448kB, file-rss:340kB
[140449.678058] OOM killed process mysqld (pid=912278, ve=188) exited, free=246900.
[140449.678063] UB-188-Mem-Info:
[140449.678066] Node 0 Normal scan:32 a_anon:43476 i_anon:4779 a_file:57 i_file:35 unevictable:0
[140449.678071] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[140449.678075] Node 1 DMA32 scan:64 a_anon:34196 i_anon:6706 a_file:0 i_file:0 unevictable:0
[140449.678080] Node 1 Normal scan:237 a_anon:840 i_anon:230 a_file:0 i_file:21 unevictable:0
[140449.678085] Total 90340 anon:90227 file:113 a_anon:78512 i_anon:11715 a_file:57 i_file:56 unevictable:0
[140449.678091] UB: 188 RAM: 96070 / 98304 [83] SWAP: 29553 / 32768 [83] KMEM: 21970944 / 201326592 [0] Dirty 0
[140449.988462] mysqld invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[140449.988468] mysqld cpuset=188 mems_allowed=0-1
[140449.988471] UB-188-Mem-Info:
[140449.988475] Node 0 Normal scan:193 a_anon:43267 i_anon:5309 a_file:0 i_file:0 unevictable:0
[140449.988479] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[140449.988483] Node 1 DMA32 scan:0 a_anon:35882 i_anon:7090 a_file:0 i_file:0 unevictable:0
[140449.988487] Node 1 Normal scan:138 a_anon:990 i_anon:191 a_file:0 i_file:0 unevictable:0
[140449.988492] Total 92729 anon:92729 file:0 a_anon:80139 i_anon:12590 a_file:0 i_file:0 unevictable:0
[140449.988497] UB: 188 RAM: 98304 / 98304 [87] SWAP: 32779 / 32768 [87] KMEM: 21590016 / 201326592 [0] Dirty 0
[140449.988501] Out of memory in UB: kill process 912214 (php) or a child
[140449.988584] Killed process 912214 (php) vsz:81832kB, anon-rss:44424kB, file-rss:500kB
[140449.994354] OOM killed process php (pid=912214, ve=188) exited, free=251618.
[140449.994584] UB-188-Mem-Info:
[140449.994588] Node 0 Normal scan:32 a_anon:35385 i_anon:4268 a_file:42 i_file:162 unevictable:0
[140449.994593] Node 1 DMA scan:0 a_anon:0 i_anon:0 a_file:0 i_file:0 unevictable:0
[140449.994598] Node 1 DMA32 scan:32 a_anon:34309 i_anon:7148 a_file:0 i_file:1 unevictable:0
[140449.994603] Node 1 Normal scan:32 a_anon:959 i_anon:189 a_file:8 i_file:119 unevictable:0
[140449.994608] Total 82600 anon:82268 file:332 a_anon:70663 i_anon:11605 a_file:50 i_file:282 unevictable:0
[140449.994614] UB: 188 RAM: 88295 / 98304 [92] SWAP: 32080 / 32768 [92] KMEM: 21352448 / 201326592 [0] Dirty 0
[140450.378082] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[140450.378090] php cpuset=188 mems_allowed=0-1
[140450.378093] Out of memory in UB: kill process 840118 (mysqld_safe) or a child
[140450.378348] Killed process 912320 (mysqld) vsz:116700kB, anon-rss:12552kB, file-rss:284kB
[140450.379594] OOM killed process mysqld (pid=912320, ve=188) exited, free=253313.
[140450.503303] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[140450.503311] php cpuset=188 mems_allowed=0-1
[140450.503315] Out of memory in UB: kill process 912212 (php) or a child
[140450.503404] Killed process 912212 (php) vsz:83780kB, anon-rss:36716kB, file-rss:1092kB
[140450.515453] OOM killed process php (pid=912212, ve=188) exited, free=262441.
[140450.803143] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[140450.803150] php cpuset=188 mems_allowed=0-1
[140450.803153] Out of memory in UB: kill process 912215 (php) or a child
[140450.803232] Killed process 912215 (php) vsz:84768kB, anon-rss:45240kB, file-rss:1140kB
[140450.808767] OOM killed process php (pid=912215, ve=188) exited, free=258120.
[140451.471729] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[140451.471736] php cpuset=188 mems_allowed=0-1
[140451.471739] Out of memory in UB: kill process 840118 (mysqld_safe) or a child
[140451.472013] Killed process 912350 (mysqld) vsz:116700kB, anon-rss:10704kB, file-rss:304kB
[140451.473147] OOM killed process mysqld (pid=912366, ve=188) exited, free=255735.
[140451.641259] php invoked oom-killer: gfp_mask=0x200d2, order=0, oom_adj=0
[140451.641266] php cpuset=188 mems_allowed=0-1



Output directly from the server console as of now :
[root@xxxx ~]# w
13:56:38 up 1 day, 17:39, 1 user, load average: 2.08, 2.34, 2.99
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
root pts/0 203.193.165.131 13:29 0.00s 0.10s 0.06s w

[root@xxxxx ~]# free -m
total used free shared buffers cached
Mem: 15900 14561 1338 0 1151 7807
-/+ buffers/cache: 5602 10298
Swap: 18126 1563 16563

Can anyone please advise how to get rid of these excessive memory usage errors. The node is not overloaded so its not the vps's that are consuming memory. Its the openvz kernel that I believ, is not able to manage the memory distribution properly and crashing the server.

Please advise..

Thank you in advance for your help...

Report message to a moderator

[Message index]
 
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: vzctl --cpuunits --cpus
Next Topic: yum install vzkernel
Goto Forum:
  

[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Fri Jul 18 19:40:15 GMT 2025

Total time taken to generate the page: 0.04518 seconds
Powered by FUDforum Powered by Virtuozzo Containers