OpenVZ Forum: Russian » Проблема с HN

Home » International » Russian » Проблема с HN

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Проблема с HN [message #10039]

Tue, 06 February 2007 09:25

GH_ua
Messages: 5
Registered: December 2006
Location: Ukraine

Junior Member

День добрый, Уважаемые Коллеги и Авторы проекта.
Случилась неприятность.
Сервер, после более месяца аптайма при минимальной нагрузке начинает вести себя очень странно.

На самом HN начинают падать приложения, не могут fork-нуться приложения. При этом VPS-ки работают нормально.

Ранее каждый VPS был настроен по моему усмотрению согласно документации. Сейчас все настроены через "vzsplit -n 15".

Конфигурация сервера:
Gentoo
Linux 2.6.16-026test018 #8 SMP
vzctl version 3.0.0-8

Текущее состояние сервера:
load average: 0.05, 0.05, 0.03

free -mt
             total       used       free     shared    buffers     cached
Mem:           884        861         22          0        166        191
-/+ buffers/cache:        503        380
Swap:         3906          0       3906
Total:        4790        861       3928

vzmemcheck -Av
Output values in Mbytes
veid        LowMem  LowMem     RAM MemSwap MemSwap   Alloc   Alloc   Alloc
              util  commit    util    util  commit    util  commit   limit
101           5.56   24.76  193.64  193.64  555.31  297.80  555.31  608.36
102           1.64   24.76   36.47   36.47  555.31  108.73  555.31  608.36
150           2.52   24.76   37.03   37.03  555.31  133.54  555.31  608.36
151           2.73   24.76   41.19   41.19  555.31  140.12  555.31  608.36
-------------------------------------------------------------------------
Summary:     12.45   99.04  308.33  308.33 2221.24  680.19 2221.24 2433.46
         353.00  353.00  884.00 4790.00 4790.00 4790.00 4790.00 4790.00

Закину прям в сообщение и отрывки из messages в разные отрывки времени.

Сегодня в 09:41:45:

Feb  6 09:41:45 ${hostname} *** VZWDOG 1.14: time 1170754905.941194 uptime 4299510294 CPU 0 ***
Feb  6 09:41:45 ${hostname} *** cycles_per_jiffy 30665843 jiffies_per_second 100 ***
Feb  6 09:41:45 ${hostname} CPU0       CPU1
Feb  6 09:41:45 ${hostname} 0:    4572976          0    IO-APIC-edge  timer
Feb  6 09:41:45 ${hostname} 1:          8          0    IO-APIC-edge  i8042
Feb  6 09:41:45 ${hostname} 17:     971758          0   IO-APIC-level  libata, eth0
Feb  6 09:41:45 ${hostname} NMI:    4572937    4572924
Feb  6 09:41:45 ${hostname} LOC:    4565520    4565519
Feb  6 09:41:45 ${hostname} pgdat: 0: 0,229376,229376,c1000000
Feb  6 09:41:45 ${hostname} Mem-info:
Feb  6 09:41:45 ${hostname} DMA per-cpu:
Feb  6 09:41:45 ${hostname} cpu 0 hot: high 0, batch 1 used:0
Feb  6 09:41:45 ${hostname} cpu 0 cold: high 0, batch 1 used:0
Feb  6 09:41:45 ${hostname} cpu 1 hot: high 0, batch 1 used:0
Feb  6 09:41:45 ${hostname} cpu 1 cold: high 0, batch 1 used:0
Feb  6 09:41:45 ${hostname} DMA32 per-cpu: empty
Feb  6 09:41:45 ${hostname} Normal per-cpu:
Feb  6 09:41:45 ${hostname} cpu 0 hot: high 186, batch 31 used:111
Feb  6 09:41:45 ${hostname} cpu 0 cold: high 62, batch 15 used:5
Feb  6 09:41:45 ${hostname} cpu 1 hot: high 186, batch 31 used:156
Feb  6 09:41:45 ${hostname} cpu 1 cold: high 62, batch 15 used:4
Feb  6 09:41:45 ${hostname} HighMem per-cpu: empty
Feb  6 09:41:45 ${hostname} Free pages:       27600kB (0kB HighMem)
Feb  6 09:41:45 ${hostname} Active:108030 inactive:44051 dirty:137 writeback:0 unstable:0 free:6900 slab:64198 mapped:74772 pagetables:709
Feb  6 09:41:45 ${hostname} DMA free:3968kB min:68kB low:84kB high:100kB active:2608kB inactive:0kB present:16384kB pages_scanned:0 all_unrec
laimable? no
Feb  6 09:41:45 ${hostname} lowmem_reserve[]: 0 0 880 880
Feb  6 09:41:45 ${hostname} DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Feb  6 09:41:45 ${hostname} lowmem_reserve[]: 0 0 880 880
Feb  6 09:41:45 ${hostname} Normal free:23632kB min:3756kB low:4692kB high:5632kB active:429512kB inactive:176204kB present:901120kB pages_sc
anned:0 all_unreclaimable? no
Feb  6 09:41:45 ${hostname} lowmem_reserve[]: 0 0 0 0
Feb  6 09:41:45 ${hostname} HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaim
able? no
Feb  6 09:41:45 ${hostname} lowmem_reserve[]: 0 0 0 0
Feb  6 09:41:45 ${hostname} DMA: 70*4kB 11*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3968kB
Feb  6 09:41:45 ${hostname} DMA32: empty
Feb  6 09:41:45 ${hostname} Normal: 2648*4kB 370*8kB 150*16kB 52*32kB 16*64kB 9*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 23632kB
Feb  6 09:41:45 ${hostname} HighMem: empty
Feb  6 09:41:45 ${hostname} Swap cache: add 55, delete 52, find 0/0, race 0+0+0
Feb  6 09:41:45 ${hostname} Free swap  = 3999884kB
Feb  6 09:41:45 ${hostname} Total swap = 4000104kB
Feb  6 09:41:45 ${hostname} Free swap:       3999884kB
Feb  6 09:41:45 ${hostname} 229376 pages of RAM
Feb  6 09:41:45 ${hostname} 0 pages of HIGHMEM
Feb  6 09:41:45 ${hostname} 3007 reserved pages
Feb  6 09:41:45 ${hostname} 123471 pages shared
Feb  6 09:41:45 ${hostname} 3 pages swap cached
Feb  6 09:41:45 ${hostname} 137 pages dirty
Feb  6 09:41:45 ${hostname} 0 pages writeback
Feb  6 09:41:45 ${hostname} 74772 pages mapped
Feb  6 09:41:45 ${hostname} 64198 pages slab
Feb  6 09:41:45 ${hostname} 709 pages pagetables
Feb  6 09:41:45 ${hostname} VMALLOC Used: 6876KB Total: 122580KB Entries: 29
Feb  6 09:41:45 ${hostname} Max_Free: 115664KB Start: f8800000 End: fffb5000
Feb  6 09:41:45 ${hostname} disk_io: (8,0) sda r(49812 1085996 26500) w(144148 2615576 182720)
Feb  6 09:41:45 ${hostname} (8,16) sdb r(49806 1044062 29001) w(143441 2615160 183372)
Feb  6 09:41:45 ${hostname} (9,0) md0 r(0 0 0) w(0 0 0)
Feb  6 09:41:45 ${hostname} (9,7) md7 r(86290 1482786 0) w(224717 1797736 0)
Feb  6 09:41:45 ${hostname} (9,5) md5 r(54955 458194 0) w(20551 164408 0)
Feb  6 09:41:45 ${hostname} (9,3) md3 r(4837 38690 0) w(67 536 0)
Feb  6 09:41:45 ${hostname} (9,2) md2 r(5230 108482 0) w(25526 204208 0)
Feb  6 09:41:45 ${hostname} (9,1) md1 r(3507 40922 0) w(2370 18960 0)
Feb  6 09:41:45 ${hostname}
Feb  6 09:41:45 ${hostname} sched lat: 0/0/0 (0 0 0)
Feb  6 09:41:45 ${hostname} lat: A0 0 (0 0 0)L0 0 (0 0 0)H0 0 (0 0 0)L1 0 (0 0 0)H1 0 (0 0 0)
Feb  6 09:41:45 ${hostname} VEnum: 5, proc R 3, S 231, D 0, Z 0, X 0, T 0 (tot 234)

Сегодня в 10:28:46:

Feb  6 10:28:46 ${hostname} *** VZWDOG 1.14: time 1170757726.122406 uptime 4299792312 CPU 1 ***
Feb  6 10:28:46 ${hostname} *** cycles_per_jiffy 30665843 jiffies_per_second 100 ***
Feb  6 10:28:46 ${hostname} CPU0       CPU1       
Feb  6 10:28:46 ${hostname} 0:    4854994          0    IO-APIC-edge  timer
Feb  6 10:28:46 ${hostname} 1:          8          0    IO-APIC-edge  i8042
Feb  6 10:28:46 ${hostname} 17:    1037312          0   IO-APIC-level  libata, eth0
Feb  6 10:28:46 ${hostname} NMI:    4854955    4854942 
Feb  6 10:28:46 ${hostname} LOC:    4847081    4847080 
Feb  6 10:28:46 ${hostname} pgdat: 0: 0,229376,229376,c1000000
Feb  6 10:28:46 ${hostname} Mem-info:
Feb  6 10:28:46 ${hostname} DMA per-cpu:
Feb  6 10:28:46 ${hostname} cpu 0 hot: high 0, batch 1 used:0
Feb  6 10:28:46 ${hostname} cpu 0 cold: high 0, batch 1 used:0
Feb  6 10:28:46 ${hostname} cpu 1 hot: high 0, batch 1 used:0
Feb  6 10:28:46 ${hostname} cpu 1 cold: high 0, batch 1 used:0
Feb  6 10:28:46 ${hostname} DMA32 per-cpu: empty
Feb  6 10:28:46 ${hostname} Normal per-cpu:
Feb  6 10:28:46 ${hostname} cpu 0 hot: high 186, batch 31 used:21
Feb  6 10:28:46 ${hostname} cpu 0 cold: high 62, batch 15 used:13
Feb  6 10:28:46 ${hostname} cpu 1 hot: high 186, batch 31 used:142
Feb  6 10:28:46 ${hostname} cpu 1 cold: high 62, batch 15 used:23
Feb  6 10:28:46 ${hostname} HighMem per-cpu: empty
Feb  6 10:28:46 ${hostname} Free pages:       11784kB (0kB HighMem)
Feb  6 10:28:46 ${hostname} Active:110204 inactive:47210 dirty:158 writeback:0 unstable:0 free:2946 slab:62804 mapped:78179 pagetables:785
Feb  6 10:28:46 ${hostname} DMA free:3808kB min:68kB low:84kB high:100kB active:3220kB inactive:176kB present:16384kB pages_scanned:0 all_unreclaimable? no
Feb  6 10:28:46 ${hostname} lowmem_reserve[]: 0 0 880 880
Feb  6 10:28:46 ${hostname} DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Feb  6 10:28:46 ${hostname} lowmem_reserve[]: 0 0 880 880
Feb  6 10:28:46 ${hostname} Normal free:7976kB min:3756kB low:4692kB high:5632kB active:437596kB inactive:188664kB present:901120kB pages_scanned:0 all_unreclaimable? no
Feb  6 10:28:46 ${hostname} lowmem_reserve[]: 0 0 0 0
Feb  6 10:28:46 ${hostname} HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Feb  6 10:28:46 ${hostname} lowmem_reserve[]: 0 0 0 0
Feb  6 10:28:46 ${hostname} DMA: 38*4kB 7*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3808kB
Feb  6 10:28:46 ${hostname} DMA32: empty
Feb  6 10:28:46 ${hostname} Normal: 706*4kB 76*8kB 8*16kB 2*32kB 0*64kB 4*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 7976kB
Feb  6 10:28:46 ${hostname} HighMem: empty
Feb  6 10:28:46 ${hostname} Swap cache: add 55, delete 52, find 0/0, race 0+0+0
Feb  6 10:28:46 ${hostname} Free swap  = 3999884kB
Feb  6 10:28:46 ${hostname} Total swap = 4000104kB
Feb  6 10:28:46 ${hostname} Free swap:       3999884kB
Feb  6 10:28:46 ${hostname} 229376 pages of RAM
Feb  6 10:28:46 ${hostname} 0 pages of HIGHMEM
Feb  6 10:28:46 ${hostname} 3007 reserved pages
Feb  6 10:28:46 ${hostname} 132171 pages shared
Feb  6 10:28:46 ${hostname} 3 pages swap cached
Feb  6 10:28:46 ${hostname} 158 pages dirty
Feb  6 10:28:46 ${hostname} 0 pages writeback
Feb  6 10:28:46 ${hostname} 78179 pages mapped
Feb  6 10:28:46 ${hostname} 62804 pages slab
Feb  6 10:28:46 ${hostname} 785 pages pagetables
Feb  6 10:28:46 ${hostname} VMALLOC Used: 6876KB Total: 122580KB Entries: 29
Feb  6 10:28:46 ${hostname} Max_Free: 115664KB Start: f8800000 End: fffb5000
Feb  6 10:28:46 ${hostname} disk_io: (8,0) sda r(51094 1114404 26567) w(154372 2758808 190326)
Feb  6 10:28:46 ${hostname} (8,16) sdb r(51041 1065590 29048) w(153622 2758392 191021)
Feb  6 10:28:46 ${hostname} (9,0) md0 r(0 0 0) w(0 0 0)
Feb  6 10:28:46 ${hostname} (9,7) md7 r(88876 1531818 0) w(237886 1903088 0)
Feb  6 10:28:46 ${hostname} (9,5) md5 r(54962 458306 0) w(20684 165472 0)
Feb  6 10:28:46 ${hostname} (9,3) md3 r(4837 38690 0) w(67 536 0)
Feb  6 10:28:46 ${hostname} (9,2) md2 r(5236 108538 0) w(26904 215232 0)
Feb  6 10:28:46 ${hostname} (9,1) md1 r(3539 41658 0) w(2370 18960 0)
Feb  6 10:28:46 ${hostname} 
Feb  6 10:28:46 ${hostname} sched lat: 0/0/0 (0 0 0)
Feb  6 10:28:46 ${hostname} lat: A0 0 (0 0 0)L0 0 (0 0 0)H0 0 (0 0 0)L1 0 (0 0 0)H1 0 (0 0 0)
Feb  6 10:28:46 ${hostname} VEnum: 5, proc R 3, S 252, D 0, Z 0, X 0, T 0 (tot 255)

Вчера (перед чудесами):

Feb  5 03:38:20 ${hostname} *** VZWDOG 1.14: time 1170646700.990759 uptime 4626898399 CPU 1 ***
Feb  5 03:38:20 ${hostname} *** cycles_per_jiffy 30665693 jiffies_per_second 100 ***
Feb  5 03:38:20 ${hostname} CPU0       CPU1       
Feb  5 03:38:20 ${hostname} 0:  331961046          0    IO-APIC-edge  timer
Feb  5 03:38:20 ${hostname} 1:          9          0    IO-APIC-edge  i8042
Feb  5 03:38:20 ${hostname} 17:   76564954          0   IO-APIC-level  libata, eth0
Feb  5 03:38:20 ${hostname} NMI:  331961008  331960995 
Feb  5 03:38:20 ${hostname} LOC:  331468420  331468419 
Feb  5 03:38:20 ${hostname} pgdat: 0: 0,229376,229376,c1000000
Feb  5 03:38:20 ${hostname} Mem-info:
Feb  5 03:38:20 ${hostname} DMA per-cpu:
Feb  5 03:38:20 ${hostname} cpu 0 hot: high 0, batch 1 used:0
Feb  5 03:38:20 ${hostname} cpu 0 cold: high 0, batch 1 used:0
Feb  5 03:38:20 ${hostname} cpu 1 hot: high 0, batch 1 used:0
Feb  5 03:38:20 ${hostname} cpu 1 cold: high 0, batch 1 used:0
Feb  5 03:38:20 ${hostname} DMA32 per-cpu: empty
Feb  5 03:38:20 ${hostname} Normal per-cpu:
Feb  5 03:38:20 ${hostname} cpu 0 hot: high 186, batch 31 used:123
Feb  5 03:38:20 ${hostname} cpu 0 cold: high 62, batch 15 used:8
Feb  5 03:38:20 ${hostname} cpu 1 hot: high 186, batch 31 used:131
Feb  5 03:38:20 ${hostname} cpu 1 cold: high 62, batch 15 used:13
Feb  5 03:38:20 ${hostname} HighMem per-cpu: empty
Feb  5 03:38:20 ${hostname} Free pages:        9196kB (0kB HighMem)
Feb  5 03:38:20 ${hostname} Active:112545 inactive:42019 dirty:613 writeback:0 unstable:0 free:2299 slab:65905 mapped:94551 pagetables:1033
Feb  5 03:38:20 ${hostname} DMA free:3976kB min:68kB low:84kB high:100kB active:3148kB inactive:4kB present:16384kB pages_scanned:0 all_unreclaimable? no
Feb  5 03:38:20 ${hostname} lowmem_reserve[]: 0 0 880 880
Feb  5 03:38:20 ${hostname} DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Feb  5 03:38:20 ${hostname} lowmem_reserve[]: 0 0 880 880
Feb  5 03:38:20 ${hostname} Normal free:5220kB min:3756kB low:4692kB high:5632kB active:447032kB inactive:168072kB present:901120kB pages_scanned:0 all_unreclaimable? no
Feb  5 03:38:20 ${hostname} lowmem_reserve[]: 0 0 0 0
Feb  5 03:38:20 ${hostname} HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Feb  5 03:38:20 ${hostname} lowmem_reserve[]: 0 0 0 0
Feb  5 03:38:20 ${hostname} DMA: 92*4kB 3*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB
Feb  5 03:38:20 ${hostname} DMA32: empty
Feb  5 03:38:20 ${hostname} Normal: 1*4kB 170*8kB 43*16kB 3*32kB 4*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 5220kB
Feb  5 03:38:20 ${hostname} HighMem: empty
Feb  5 03:38:20 ${hostname} Swap cache: add 58, delete 58, find 0/0, race 0+0+0
Feb  5 03:38:20 ${hostname} Free swap  = 3999884kB
Feb  5 03:38:20 ${hostname} Total swap = 4000104kB
Feb  5 03:38:20 ${hostname} Free swap:       3999884kB
Feb  5 03:38:20 ${hostname} 229376 pages of RAM
Feb  5 03:38:20 ${hostname} 0 pages of HIGHMEM
Feb  5 03:38:20 ${hostname} 3007 reserved pages
Feb  5 03:38:20 ${hostname} 143330 pages shared
Feb  5 03:38:20 ${hostname} 0 pages swap cached
Feb  5 03:38:20 ${hostname} 613 pages dirty
Feb  5 03:38:20 ${hostname} 0 pages writeback
Feb  5 03:38:20 ${hostname} 94551 pages mapped
Feb  5 03:38:20 ${hostname} 65905 pages slab
Feb  5 03:38:20 ${hostname} 1033 pages pagetables
Feb  5 03:38:20 ${hostname} VMALLOC Used: 6888KB Total: 122580KB Entries: 30
Feb  5 03:38:20 ${hostname} Max_Free: 115680KB Start: f8800000 End: fffb5000
Feb  5 03:38:20 ${hostname} disk_io: (8,0) sda r(2224301 487614478 3108286) w(10529774 201084456 14573011)
Feb  5 03:38:20 ${hostname} (8,16) sdb r(1635526 22729548 44890) w(11055335 665490776 17675275)
Feb  5 03:38:20 ${hostname} (9,0) md0 r(0 0 0) w(0 0 0)
Feb  5 03:38:20 ${hostname} (9,7) md7 r(1603623 30738370 0) w(19351270 154810160 0)
Feb  5 03:38:20 ${hostname} (9,5) md5 r(1674329 13851554 0) w(1084302 8674416 0)
Feb  5 03:38:20 ${hostname} (9,3) md3 r(2034 16266 0) w(83347 666776 0)
Feb  5 03:38:20 ${hostname} (9,2) md2 r(89313 1080970 0) w(1311068 10488544 0)
Feb  5 03:38:20 ${hostname} (9,1) md1 r(15594 249058 0) w(4880 39040 0)
Feb  5 03:38:20 ${hostname} 
Feb  5 03:38:20 ${hostname} sched lat: 0/0/0 (0 0 0)
Feb  5 03:38:20 ${hostname} lat: A0 0 (0 0 0)L0 0 (0 0 0)H0 0 (0 0 0)L1 0 (0 0 0)H1 0 (0 0 0)
Feb  5 03:38:20 ${hostname} VEnum: 5, proc R 2, S 328, D 0, Z 0, X 0, T 0 (tot 331)

Меня настораживает строчка "Free pages" которая постоянно уменьшается.
Извиняюсь за может быть большое сообщение но ситуация уже входит в систему (2-й раз).

Спасибо.

Report message to a moderator

Re: Проблема с HN [message #10040 is a reply to message #10039]

Tue, 06 February 2007 09:49

Vasily Tarasov
Messages: 1345
Registered: January 2006

Senior Member

Добрый день,

Вы используете старое ядро. С момента его выхода было исправленно огромное количество проблем с утечкой памяти. Обновитесь до 028test015 и с большой вероятностью проблема исчезнет.

[Updated on: Tue, 06 February 2007 09:49]

Report message to a moderator

Re: Проблема с HN [message #10041 is a reply to message #10040]

Tue, 06 February 2007 10:12

GH_ua
Messages: 5
Registered: December 2006
Location: Ukraine

Junior Member

Не сочтите за труд подскажите ещё по такому вопросу.
В репозитарии Gentoo на данный момент доступны версии:

openvz-sources-023.032.ebuild
openvz-sources-023.037.ebuild
openvz-sources-023.040.ebuild
openvz-sources-028.005.ebuild
openvz-sources-028.007.ebuild
openvz-sources-028.010.ebuild

Какую версию посоветуете в данной ситуации?

Спасибо.

Report message to a moderator

Re: Проблема с HN [message #10042 is a reply to message #10041]

Tue, 06 February 2007 10:29

Vasily Tarasov
Messages: 1345
Registered: January 2006

Senior Member

Если у вас "важная" production машина, то, пожалуй,
openvz-sources-023.040.ebuild. Но если не хватает функциональности этого ядра, то пользуйтесь openvz-sources-028.010.ebuild. В этом случае нужно будет частенько обновляться до новых ядер - ибо это development-ядро.

Report message to a moderator

Re: Проблема с HN [message #10043 is a reply to message #10042]

Tue, 06 February 2007 10:34

GH_ua
Messages: 5
Registered: December 2006
Location: Ukraine

Junior Member

Да машина важная да ещё и стоит за тридевять земель.
Будем тестить и в конце концов поставим думаю.

Спасибо. О результатах сообщу.

Report message to a moderator

Previous Topic:	SOLVED 2.6.18 и новые ошибки
Next Topic:	CLOSED IO

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sun Aug 03 03:14:16 GMT 2025

Total time taken to generate the page: 0.92836 seconds