I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
http://download.openvz.org/debian on Debian Etch one week ago and
experienced kernel oops (complete freezing, off/on necessary) after 2-3
days of running (3 times). Oops is always after cron.daily scripts (in
my case 06:25) but not everyday. Yesterday I configured netconsole for
capturing useful info, enclosed.

Hardware was tested very strong on installation. With stock Debian
kernel (initrd.img-2.6.18-5-amd64) server does not have any problem (3
months of operation). There are 3 VPS running, without really using.

Enclosed last entry in syslog (before crash). Looks like problem is
invoking  by /usr/share/vzctl/scripts/vpsnetclean
or /usr/share/vzctl/scripts/vpsreboot. Booth scripts are from vzctl
package, I installed it from http://debian.systs.org/

# vzctl --version
vzctl version 3.0.18-1dso1

I am leaving office now, additional info (if necessary) I can send
tomorrow.

Martin Trtusek

netconsole: network logging started
Warning: /proc/ide/hd?/settings interface is obsolete, and will be removed soon!
st: Version 20050830, fixed bufsize 32768, s/g segs 256
sd 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:1:0: Attached scsi generic sg1 type 0
sd 1:0:0:0: Attached scsi generic sg2 type 0
sd 1:0:1:0: Attached scsi generic sg3 type 0
BIOS EDD facility v0.16 2004-Jun-25, 4 devices found
----------- [cut here ] --------- [please bite here ] ---------
Kernel BUG at kernel/sched.c:3798
invalid opcode: 0000 [1] SMP 
CPU: 0 
Modules linked in: edd joydev sg st sr_mod netconsole vzethdev vznetdev simfs vzrst vzcpt vzdquota vzmon vzdev button ac battery ip6table_filter ip6_tables iptable_raw xt_policy xt_multiport ipt_ULOG ipt_TTL ipt_ttl ipt_TOS ipt_tos ipt_TCPMSS ipt_SAME ipt_REJECT ipt_REDIRECT ipt_recent ipt_owner ipt_NETMAP ipt_MASQUERADE ipt_LOG ipt_iprange ipt_hashlimit ipt_ECN ipt_ecn ipt_DSCP ipt_dscp ipt_CLUSTERIP ipt_ah ipt_addrtype ip_nat_tftp ip_nat_snmp_basic ip_nat_pptp ip_nat_irc ip_nat_ftp ip_nat_amanda ip_conntrack_tftp ip_conntrack_pptp ip_conntrack_netbios_ns ip_conntrack_irc ip_conntrack_ftp ts_kmp ip_conntrack_amanda xt_tcpmss xt_pkttype xt_physdev bridge xt_NFQUEUE xt_MARK xt_mark xt_mac xt_limit xt_length xt_helper xt_dccp xt_conntrack xt_CONNMARK xt_connmark xt_CLASSIFY xt_tcpudp xt_state iptable_nat ip_nat ip_conntrack iptable_mangle nfnetlink iptable_filter ip_tables x_tables ipv6 dummy aes_x86_64 sha512 sha256 loop evdev psmouse i2c_i801 shpchp pci_hotplug serio_raw i2c_core pcspkr floppy ext3 jbd mbcache raid10 ide_generic sd_mod ide_cd cdrom ata_piix libata generic piix ide_core ehci_hcd e1000 uhci_hcd thermal processor fan cciss scsi_mod dm_snapshot dm_mirror dm_crypt dm_mod raid456 xor raid1 md_mod
Pid: 0, comm: swapper Not tainted 2.6.18-openvz-13-39.1d1-amd64 #1
RIP: 0060:[<ffffffff8027fd35>]  [<ffffffff8027fd35>] rebalance_tick+0x391/0x57a
RSP: 0068:ffffffff804c4b18  EFLAGS: 00010046
RAX: ffffffff804e1980 RBX: ffffffff804e1980 RCX: 0000000000000020
RDX: 0000000000000020 RSI: ffffffff804e17d0 RDI: 0000000000000001
RBP: ffffffff804c4bb8 R08: ffffffff804c4b68 R09: ffffffff804c4b68
R10: 0000000000000000 R11: 0000000000000002 R12: ffff810001020340
R13: ffff81011b0c2000 R14: ffff81011b0c2000 R15: ffffffff804e2c80
FS:  0000000000000000(0000) GS:ffffffff80526000(0000) knlGS:0000000000000000
CS:  0060 DS: 0068 ES: 0068 CR0: 000000008005003b
CR2: 0000000000a10048 CR3: 000000010196d000 CR4: 00000000000006e0
Process swapper (pid: 0, veid=0, threadinfo ffffffff80534000, task ffffffff80449be0)
Stack:  0000000000000002 ffff810101161240 0000000000000000 ffffffff804e2c80
 0000000202555ed8 ffff81011b0c2000 ffffffff8027b532 0000000000000001
 0000000000000003 0000000000000082 00000000ffffffff 000047783a3fde8a
Call Trace:
 <IRQ> [<ffffffff8027b532>] vcpu_attach+0x7e/0xc3
 [<ffffffff8028a68f>] update_process_times+0x5c/0x68
 [<ffffffff8026c8e1>] smp_local_timer_interrupt+0x23/0x47
 [<ffffffff8026ce7f>] smp_apic_timer_interrupt+0x99/0x9f
 [<ffffffff8025bdda>] apic_timer_interrupt+0x66/0x6c
 [<ffffffff8024e78d>] bio_fs_destructor+0x0/0xc
 [<ffffffff88124830>] :libata:ata_scsi_rw_xlat+0x0/0x37e
 [<ffffffff8022d780>] mempool_free+0x10/0x74
 [<ffffffff8023f729>] bio_free+0x33/0x43
 [<ffffffff8023f176>] end_bio_bh_io_sync+0x37/0x3b
 [<ffffffff88042255>] :dm_mod:dec_pending+0xab/0xce
 [<ffffffff88042392>] :dm_mod:clone_endio+0x7f/0x9b
 [<ffffffff88162aa6>] :raid10:raid_end_bio_io+0x2c/0x80
 [<ffffffff881645b2>] :raid10:raid10_end_read_request+0x66/0xe9
 [<ffffffff803010b1>] elv_next_request+0x141/0x151
 [<ffffffff8022b938>] __end_that_request_first+0x153/0x49e
 [<ffffffff803117ce>] swiotlb_unmap_sg+0x9c/0xed
 [<ffffffff8806b597>] :scsi_mod:scsi_delete_timer+0x12/0x59
 [<ffffffff8806cbf9>] :scsi_mod:scsi_end_request+0x27/0xcb
 [<ffffffff8806cdf3>] :scsi_mod:scsi_io_completion+0x156/0x334
 [<ffffffff881203fd>] :libata:ata_hsm_move+0x642/0x661
 [<ffffffff881584a3>] :sd_mod:sd_rw_intr+0x217/0x244
 [<ffffffff8806d091>] :scsi_mod:scsi_device_unbusy+0x67/0x81
 [<ffffffff80236488>] blk_done_softirq+0x5f/0x6d
 [<ffffffff8021030f>] __do_softirq+0x98/0x138
 [<ffffffff8025c43c>] call_softirq+0x1c/0x28
 [<ffffffff802661c3>] do_softirq+0x2c/0x7d
 [<ffffffff802662d6>] do_IRQ+0xc2/0xcb
 [<ffffffff80255128>] mwait_idle+0x0/0x4a
 [<ffffffff8025b761>] ret_from_intr+0x0/0xa
 <EOI> [<ffffffff8025515e>] mwait_idle+0x36/0x4a
 [<ffffffff8024703e>] cpu_idle+0x60/0x7f
 [<ffffffff8053e7be>] start_kernel+0x23b/0x240
 [<ffffffff8053e288>] _sinittext+0x288/0x28c


Code: 0f 0b 68 df 6e 40 80 c2 d6 0e 4c 39 eb 48 89 5d 88 0f 84 57 
RIP  [<ffffffff8027fd35>] rebalance_tick+0x391/0x57a
 RSP <ffffffff804c4b18>
Kernel panic - not syncing: Aiee, killing interrupt handler!

Oct 10 06:15:01 vochomurka /USR/SBIN/CRON[14743]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null;
fi)
Oct 10 06:15:01 vochomurka /USR/SBIN/CRON[14745]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; chmod -R o+r /var/www/munin; fi)
Oct 10 06:15:01 vochomurka /USR/SBIN/CRON[14747]: (root) CMD (/usr/share/vzctl/scripts/vpsreboot)
Oct 10 06:15:01 vochomurka /USR/SBIN/CRON[14749]: (root) CMD (/usr/share/vzctl/scripts/vpsnetclean)
Oct 10 06:17:01 vochomurka /USR/SBIN/CRON[16783]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Oct 10 06:17:10 vochomurka ntpdate[16786]: adjust time server 195.113.144.238 offset -0.007761 sec
Oct 10 06:20:01 vochomurka /USR/SBIN/CRON[16788]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null;
fi)
Oct 10 06:20:01 vochomurka /USR/SBIN/CRON[16790]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; chmod -R o+r /var/www/munin; fi)
Oct 10 06:20:01 vochomurka /USR/SBIN/CRON[16792]: (root) CMD (/usr/share/vzctl/scripts/vpsreboot)
Oct 10 06:20:01 vochomurka /USR/SBIN/CRON[16794]: (root) CMD (/usr/share/vzctl/scripts/vpsnetclean)
Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18831]: (root) CMD (test -x /usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.daily ))
Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18833]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null;
fi)
Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18839]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; chmod -R o+r /var/www/munin; fi)
Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18840]: (root) CMD (/usr/share/vzctl/scripts/vpsreboot)
Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18842]: (root) CMD (/usr/share/vzctl/scripts/vpsnetclean)
Oct 10 07:19:13 vochomurka syslogd 1.4.1#18: restart.

Hi Martin,

have you tried the new 028stab045 OpenVZ linux-kernel ?

Regards / Gruss,
Thorsten Schifferdecker

Am Mi, 10.10.2007, 05:54, schrieb Martin Trtusek:
> I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
> http://download.openvz.org/debian on Debian Etch one week ago and
> experienced kernel oops (complete freezing, off/on necessary) after 2-3
> days of running (3 times). Oops is always after cron.daily scripts (in
> my case 06:25) but not everyday. Yesterday I configured netconsole for
> capturing useful info, enclosed.
>
> Hardware was tested very strong on installation. With stock Debian
> kernel (initrd.img-2.6.18-5-amd64) server does not have any problem (3
> months of operation). There are 3 VPS running, without really using.
>
> Enclosed last entry in syslog (before crash). Looks like problem is
> invoking  by /usr/share/vzctl/scripts/vpsnetclean
> or /usr/share/vzctl/scripts/vpsreboot. Booth scripts are from vzctl
> package, I installed it from http://debian.systs.org/
>
> # vzctl --version
> vzctl version 3.0.18-1dso1
>
> I am leaving office now, additional info (if necessary) I can send
> tomorrow.
>
> Martin Trtusek

I'm had a similar crash using the latest 686 kernel from
download.openvz.org: 
linux-image-2.6.18-openvz-13-39.1d2-686_028.39.1d2_i386.deb

 vzctl --version
 vzctl version 3.0.11

Two boxes are using it, one is fine, the other hung once.
All the logs had was this:

Oct  5 19:15:01 penguin /USR/SBIN/CRON[31518]: (root) CMD (/usr/share/vzctl/scripts/vpsnetclean)
Oct  8 10:34:35 penguin syslogd 1.4.1#18: restart.

There was some spew on the console, but I didn't know how to capture that.


   E Frank Ball                efball@efball.com


On Wed, Oct 10, 2007 at 07:54:11AM +0200, Martin Trtusek wrote:
 > I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
 > http://download.openvz.org/debian on Debian Etch one week ago and
 > experienced kernel oops (complete freezing, off/on necessary) after 2-3
 > days of running (3 times). Oops is always after cron.daily scripts (in
 > my case 06:25) but not everyday. Yesterday I configured netconsole for
 > capturing useful info, enclosed.
 > 
 > Hardware was tested very strong on installation. With stock Debian
 > kernel (initrd.img-2.6.18-5-amd64) server does not have any problem (3
 > months of operation). There are 3 VPS running, without really using.
 > 
 > Enclosed last entry in syslog (before crash). Looks like problem is
 > invoking  by /usr/share/vzctl/scripts/vpsnetclean
 > or /usr/share/vzctl/scripts/vpsreboot. Booth scripts are from vzctl
 > package, I installed it from http://debian.systs.org/
 > 
 > # vzctl --version
 > vzctl version 3.0.18-1dso1
 > 
 > I am leaving office now, additional info (if necessary) I can send
 > tomorrow.
 > 
 > Martin Trtusek

 > netconsole: network logging started
 > Warning: /proc/ide/hd?/settings interface is obsolete, and will be removed soon!
 > st: Version 20050830, fixed bufsize 32768, s/g segs 256
 > sd 0:0:0:0: Attached scsi generic sg0 type 0
 > sd 0:0:1:0: Attached scsi generic sg1 type 0
 > sd 1:0:0:0: Attached scsi generic sg2 type 0
 > sd 1:0:1:0: Attached scsi generic sg3 type 0
 > BIOS EDD facility v0.16 2004-Jun-25, 4 devices found
 > ----------- [cut here ] --------- [please bite here ] ---------
 > Kernel BUG at kernel/sched.c:3798
 > invalid opcode: 0000 [1] SMP 
 > CPU: 0 
 > Modules linked in: edd joydev sg st sr_mod netconsole vzethdev vznetdev simfs vzrst vzcpt vzdquota vzmon vzdev button ac battery ip6table_filter ip6_tables iptable_raw xt_policy xt_multiport ipt_ULOG ipt_TTL ipt_ttl ipt_TOS ipt_tos ipt_TCPMSS ipt_SAME ipt_REJECT ipt_REDIRECT ipt_recent ipt_owner ipt_NETMAP ipt_MASQUERADE ipt_LOG ipt_iprange ipt_hashlimit ipt_ECN ipt_ecn ipt_DSCP ipt_dscp ipt_CLUSTERIP ipt_ah ipt_addrtype ip_nat_tftp ip_nat_snmp_basic ip_nat_pptp ip_nat_irc ip_nat_ftp ip_nat_amanda ip_conntrack_tftp ip_conntrack_pptp ip_conntrack_netbios_ns ip_conntrack_irc ip_conntrack_ftp ts_kmp ip_conntrack_amanda xt_tcpmss xt_pkttype xt_physdev bridge xt_NFQUEUE xt_MARK xt_mark xt_mac xt_limit xt_length xt_helper xt_dccp xt_conntrack xt_CONNMARK xt_connmark xt_CLASSIFY xt_tcpudp xt_state iptable_nat ip_nat ip_conntrack iptable_mangle nfnetlink iptable_filter ip_tables x_tables ipv6 dummy aes_x86_64 sha512 sha256 loop evdev psmouse i2c_i801 shpchp pci_hotplug serio_raw !
 i2c_core pcspkr floppy ext3 jbd mbcache raid10 ide_generic sd_mod ide_cd cdrom ata_piix libata generic piix ide_core ehci_hcd e1000 uhci_hcd thermal processor fan cciss scsi_mod dm_snapshot dm_mirror dm_crypt dm_mod raid456 xor raid1 md_mod
 > Pid: 0, comm: swapper Not tainted 2.6.18-openvz-13-39.1d1-amd64 #1
 > RIP: 0060:[<ffffffff8027fd35>]  [<ffffffff8027fd35>] rebalance_tick+0x391/0x57a
 > RSP: 0068:ffffffff804c4b18  EFLAGS: 00010046
 > RAX: ffffffff804e1980 RBX: ffffffff804e1980 RCX: 0000000000000020
 > RDX: 0000000000000020 RSI: ffffffff804e17d0 RDI: 0000000000000001
 > RBP: ffffffff804c4bb8 R08: ffffffff804c4b68 R09: ffffffff804c4b68
 > R10: 0000000000000000 R11: 0000000000000002 R12: ffff810001020340
 > R13: ffff81011b0c2000 R14: ffff81011b0c2000 R15: ffffffff804e2c80
 > FS:  0000000000000000(0000) GS:ffffffff80526000(0000) knlGS:0000000000000000
 > CS:  0060 DS: 0068 ES: 0068 CR0: 000000008005003b
 > CR2: 0000000000a10048 CR3: 000000010196d000 CR4: 00000000000006e0
 > Process swapper (pid: 0, veid=0, threadinfo ffffffff80534000, task ffffffff80449be0)
 > Stack:  0000000000000002 ffff810101161240 0000000000000000 ffffffff804e2c80
 >  0000000202555ed8 ffff81011b0c2000 ffffffff8027b532 0000000000000001
 >  0000000000000003 0000000000000082 00000000ffffffff 000047783a3fde8a
 > Call Trace:
 >  <IRQ> [<ffffffff8027b532>] vcpu_attach+0x7e/0xc3
 >  [<ffffffff8028a68f>] update_process_times+0x5c/0x68
 >  [<ffffffff8026c8e1>] smp_local_timer_interrupt+0x23/0x47
 >  [<ffffffff8026ce7f>] smp_apic_timer_interrupt+0x99/0x9f
 >  [<ffffffff8025bdda>] apic_timer_interrupt+0x66/0x6c
 >  [<ffffffff8024e78d>] bio_fs_destructor+0x0/0xc
 >  [<ffffffff88124830>] :libata:ata_scsi_rw_xlat+0x0/0x37e
 >  [<ffffffff8022d780>] mempool_free+0x10/0x74
 >  [<ffffffff8023f729>] bio_free+0x33/0x43
 >  [<ffffffff8023f176>] end_bio_bh_io_sync+0x37/0x3b
 >  [<ffffffff88042255>] :dm_mod:dec_pending+0xab/0xce
 >  [<ffffffff88042392>] :dm_mod:clone_endio+0x7f/0x9b
 >  [<ffffffff88162aa6>] :raid10:raid_end_bio_io+0x2c/0x80
 >  [<ffffffff881645b2>] :raid10:raid10_end_read_request+0x66/0xe9
 >  [<ffffffff803010b1>] elv_next_request+0x141/0x151
 >  [<ffffffff8022b938>] __end_that_request_first+0x153/0x49e
 >  [<ffffffff803117ce>] swiotlb_unmap_sg+0x9c/0xed
 >  [<ffffffff8806b597>] :scsi_mod:scsi_delete_timer+0x12/0x59
 >  [<ffffffff8806cbf9>] :scsi_mod:scsi_end_request+0x27/0xcb
 >  [<ffffffff8806cdf3>] :scsi_mod:scsi_io_completion+0x156/0x334
 >  [<ffffffff881203fd>] :libata:ata_hsm_move+0x642/0x661
 >  [<ffffffff881584a3>] :sd_mod:sd_rw_intr+0x217/0x244
 >  [<ffffffff8806d091>] :scsi_mod:scsi_device_unbusy+0x67/0x81
 >  [<ffffffff80236488>] blk_done_softirq+0x5f/0x6d
 >  [<ffffffff8021030f>] __do_softirq+0x98/0x138
 >  [<ffffffff8025c43c>] call_softirq+0x1c/0x28
 >  [<ffffffff802661c3>] do_softirq+0x2c/0x7d
 >  [<ffffffff802662d6>] do_IRQ+0xc2/0xcb
 >  [<ffffffff80255128>] mwait_idle+0x0/0x4a
 >  [<ffffffff8025b761>] ret_from_intr+0x0/0xa
 >  <EOI> [<ffffffff8025515e>] mwait_idle+0x36/0x4a
 >  [<ffffffff8024703e>] cpu_idle+0x60/0x7f
 >  [<ffffffff8053e7be>] start_kernel+0x23b/0x240
 >  [<ffffffff8053e288>] _sinittext+0x288/0x28c
 > 
 > 
 > Code: 0f 0b 68 df 6e 40 80 c2 d6 0e 4c 39 eb 48 89 5d 88 0f 84 57 
 > RIP  [<ffffffff8027fd35>] rebalance_tick+0x391/0x57a
 >  RSP <ffffffff804c4b18>
 > Kernel panic - not syncing: Aiee, killing interrupt handler!

 > Oct 10 06:15:01 vochomurka /USR/SBIN/CRON[14743]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null;
 > fi)
 > Oct 10 06:15:01 vochomurka /USR/SBIN/CRON[14745]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; chmod -R o+r /var/www/munin; fi)
 > Oct 10 06:15:01 vochomurka /USR/SBIN/CRON[14747]: (root) CMD (/usr/share/vzctl/scripts/vpsreboot)
 > Oct 10 06:15:01 vochomurka /USR/SBIN/CRON[14749]: (root) CMD (/usr/share/vzctl/scripts/vpsnetclean)
 > Oct 10 06:17:01 vochomurka /USR/SBIN/CRON[16783]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
 > Oct 10 06:17:10 vochomurka ntpdate[16786]: adjust time server 195.113.144.238 offset -0.007761 sec
 > Oct 10 06:20:01 vochomurka /USR/SBIN/CRON[16788]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null;
 > fi)
 > Oct 10 06:20:01 vochomurka /USR/SBIN/CRON[16790]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; chmod -R o+r /var/www/munin; fi)
 > Oct 10 06:20:01 vochomurka /USR/SBIN/CRON[16792]: (root) CMD (/usr/share/vzctl/scripts/vpsreboot)
 > Oct 10 06:20:01 vochomurka /USR/SBIN/CRON[16794]: (root) CMD (/usr/share/vzctl/scripts/vpsnetclean)
 > Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18831]: (root) CMD (test -x /usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.daily ))
 > Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18833]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null;
 > fi)
 > Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18839]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; chmod -R o+r /var/www/munin; fi)
 > Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18840]: (root) CMD (/usr/share/vzctl/scripts/vpsreboot)
 > Oct 10 06:25:01 vochomurka /USR/SBIN/CRON[18842]: (root) CMD (/usr/share/vzctl/scripts/vpsnetclean)
 > Oct 10 07:19:13 vochomurka syslogd 1.4.1#18: restart.

-- 

   E Frank Ball                efball@efball.com

I test it now. After boot to this kernel I had black screen. Monitor was
not in suspend mode, but no characters displayed. Keyboard was working
(NumLock worked and Ctrl+Alt+Del worked too). As I remember, the same
situation was with 028stab039 which I tried before 13-39.1d1.

After boot to previous kernel I look to config of 028stab045 (before
purging it). It looks like there is a lot of changes versus standard
debian stock kernel (diff has about 70kB :-o). Perhabs something is
missing for my hardware, no power look for what.

Regards
Martin Trtusek

Thorsten Schifferdecker pí¹e v St 10. 10. 2007 v 10:54 +0000:
> Hi Martin,
> 
> have you tried the new 028stab045 OpenVZ linux-kernel ?
> 
> Regards / Gruss,
> Thorsten Schifferdecker
> 
> Am Mi, 10.10.2007, 05:54, schrieb Martin Trtusek:
> > I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
> > http://download.openvz.org/debian on Debian Etch one week ago and
> > experienced kernel oops (complete freezing, off/on necessary) after 2-3
> > days of running (3 times). Oops is always after cron.daily scripts (in
> > my case 06:25) but not everyday. Yesterday I configured netconsole for
> > capturing useful info, enclosed.
> >
> > Hardware was tested very strong on installation. With stock Debian
> > kernel (initrd.img-2.6.18-5-amd64) server does not have any problem (3
> > months of operation). There are 3 VPS running, without really using.
> >
> > Enclosed last entry in syslog (before crash). Looks like problem is
> > invoking  by /usr/share/vzctl/scripts/vpsnetclean
> > or /usr/share/vzctl/scripts/vpsreboot. Booth scripts are from vzctl
> > package, I installed it from http://debian.systs.org/
> >
> > # vzctl --version
> > vzctl version 3.0.18-1dso1
> >
> > I am leaving office now, additional info (if necessary) I can send
> > tomorrow.
> >
> > Martin Trtusek

The same kernel on i386 is working without oops (uptime 22 days). Should
I fulfill a bug ?

Unfortunately previous hardware are not available for test now (it is in
production, with 2.6.18-openvz-13-1etch4 kernel). Probably after next
week we will have similar one for 1-2 week testing.

Martin Trtusek

Martin Trtusek pí¹e v St 10. 10. 2007 v 07:54 +0200:
> I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
> http://download.openvz.org/debian on Debian Etch one week ago and
> experienced kernel oops (complete freezing, off/on necessary) after 2-3
> days of running (3 times). Oops is always after cron.daily scripts (in
> my case 06:25) but not everyday. Yesterday I configured netconsole for
> capturing useful info, enclosed.
> 
> Hardware was tested very strong on installation. With stock Debian
> kernel (initrd.img-2.6.18-5-amd64) server does not have any problem (3
> months of operation). There are 3 VPS running, without really using.
> 
> Enclosed last entry in syslog (before crash). Looks like problem is
> invoking  by /usr/share/vzctl/scripts/vpsnetclean
> or /usr/share/vzctl/scripts/vpsreboot. Booth scripts are from vzctl
> package, I installed it from http://debian.systs.org/
> 
> # vzctl --version
> vzctl version 3.0.18-1dso1
> 
> I am leaving office now, additional info (if necessary) I can send
> tomorrow.
> 
> Martin Trtusek

On Wed, Oct 24, 2007 at 06:31:39AM +0200, Martin Trtusek wrote:
 > The same kernel on i386 is working without oops (uptime 22 days). Should
 > I fulfill a bug ?
 > 
 > Unfortunately previous hardware are not available for test now (it is in
 > production, with 2.6.18-openvz-13-1etch4 kernel). Probably after next
 > week we will have similar one for 1-2 week testing.
 > 
 > Martin Trtusek
 > 
 > Martin Trtusek pí?e v St 10. 10. 2007 v 07:54 +0200:
 > > I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
 > > http://download.openvz.org/debian on Debian Etch one week ago and
 > > experienced kernel oops (complete freezing, off/on necessary) after 2-3
 > > days of running (3 times). Oops is always after cron.daily scripts (in
 > > my case 06:25) but not everyday. Yesterday I configured netconsole for
 > > capturing useful info, enclosed.


I've seen three crashes with
linux-image-2.6.18-openvz-13-39.1d2-686_028.39.1d2_i386.deb 

I changed my production server back to 2.6.18-openvz-12-1etch1-686.

I captured the output this time:

preparing to turn dcache accounting on, size 4294967293 pages, watermarks 0 21800
UBC: turning dcache accounting on succeeded, usage 1236258, time 0.040
------------[ cut here ]------------
kernel BUG at kernel/sched.c:3798!
invalid opcode: 0000 [#1]
SMP 
Modules linked in:  netconsole tcp_diag inet_diag hp100 nfs simfs
vznetdev vzethdev vzrst ip_nat vzcpt ip_conntrack nfnetlink vzdquota
vzmon vzdev xt_length ipt_ttl xt_tcpmss ipt_TCPMSS iptable_mangle
iptable_filter xt_multiport xt_limit ipt_tos ipt_REJECT ip_tables
x_tables nfsd exportfs lockd nfs_acl sunrpc ppdev lp ipv6 nls_iso8859_1
isofs dm_snapshot dm_mirror dm_mod uhci_hcd ehci_hcd usb_storage
ide_generic loop snd_cs46xx gameport snd_seq_dummy snd_seq_oss
snd_seq_midi snd_seq_midi_event snd_seq tsdev snd_rawmidi snd_seq_device
snd_ac97_codec snd_ac97_bus snd_pcm_oss snd_mixer_oss i2c_piix4 snd_pcm
i2c_core snd_timer parport_pc psmouse rtc serio_raw snd evdev soundcore
snd_page_alloc shpchp pci_hotplug parport sworks_agp agpgart floppy
pcspkr ide_floppy ext3 jbd mbcache sd_mod ide_cd cdrom ide_disk ohci_hcd
usbcore aic7xxx scsi_transport_spi scsi_mod serverworks generic ide_core
e100 mii processor
CPU:    1, VCPU: -1.1
EIP:    0060:[<c01163a8>]    Not tainted VLI
EFLAGS: 00010046   (2.6.18-openvz-13-39.1d2-686 #1) 
EIP is at rebalance_tick+0x2fa/0x485
eax: 0000005e   ebx: c035c6c0   ecx: 00000008   edx: dfb05d94
esi: c2214180   edi: dfb99000   ebp: dfb05db0   esp: dfb05d64
ds: 007b   es: 007b   ss: 0068
Process swapper (pid: 0, veid: 0, ti=dfb04000 task=dfb01220 task.ti=dfb04000)
Stack: 00000000 00000000 dfb98000 dfb98000 330b1369 00000001 00000002 00000001 
       dfb99000 1fb2c449 dfb99000 00000003 000000ff 0000005e 00000000 00000000 
       dfb01220 00000001 00000000 c1f78da4 c012476b dfb05dd0 f524a414 00000202 
 Call Trace:
 [<c012476b>] update_process_times+0x52/0x5c
 [<c010c9d2>] smp_apic_timer_interrupt+0x9b/0xa1
 [<c010342b>] apic_timer_interrupt+0x1f/0x24
 [<c0281338>] _spin_unlock_irqrestore+0x8/0x9
 [<c012d3f6>] __wake_up_bit+0x29/0x2e
 [<c016515e>] end_buffer_async_write+0xe3/0x105
 [<c014a30c>] mempool_free+0x5f/0x63
 [<c0164939>] end_bio_bh_io_sync+0x0/0x39
 [<c0164967>] end_bio_bh_io_sync+0x2e/0x39
 [<c016618d>] bio_endio+0x50/0x55
 [<c01a835d>] __end_that_request_first+0x11b/0x425
 [<f891f12d>] scsi_end_request+0x1a/0xa9 [scsi_mod]
 [<c014a30c>] mempool_free+0x5f/0x63
 [<f891f2ff>] scsi_io_completion+0x143/0x2ed [scsi_mod]
 [<f89553b2>] sd_rw_intr+0x1eb/0x215 [sd_mod]
 [<f891b3bd>] scsi_finish_command+0x73/0x77 [scsi_mod]
 [<c01a9f25>] blk_done_softirq+0x4d/0x58
 [<c01205aa>] __do_softirq+0x84/0x109
 [<c0120665>] do_softirq+0x36/0x3a
 [<c0104ea4>] do_IRQ+0x8a/0x92
 [<c010339a>] common_interrupt+0x1a/0x20
 [<c0101731>] default_idle+0x0/0x59
 [<c0101762>] default_idle+0x31/0x59
 [<c01017e8>] cpu_idle+0x5e/0x74
Code:  0c 85 c0 0f 84 4e 01 00 00 53 89 c2 8b 4d b8 ff 75 e8 8b 45 dc e8
a7 cf ff ff 89 c3 58 85 db 5a 0f 84 31 01 00 00 39 7d d4 75 0b <0f> 0b
66 b8 d6 0e b8 a3 61 29 c0 39 fb 89 5d d4 0f 84 16 01 00
EIP: [<c01163a8>] rebalance_tick+0x2fa/0x485 SS:ESP 0068:dfb05d64
Kernel panic - not syncing: Fatal exception in interrupt
BUG: warning at arch/i386/kernel/smp.c:550/smp_call_function()
 [<c010b093>] smp_call_function+0x53/0xfe
 [<c011bfce>] vprintk+0x26/0x3a
 [<c010b151>] smp_send_stop+0x13/0x1c
 [<c011b322>] panic+0x4c/0xe2
 [<c0103d59>] die+0x252/0x269
 [<c0104617>] do_invalid_op+0x0/0x9d
 [<c01046a8>] do_invalid_op+0x91/0x9d
 [<c01163a8>] rebalance_tick+0x2fa/0x485
 [<f8e3c87a>] ipt_do_table+0x2a1/0x2cb [ip_tables]
 [<c01b2b10>] __next_cpu+0x12/0x21
 [<c0113533>] find_busiest_group+0x185/0x46e
 [<f8f5e982>] venet_entry_lookup+0x2c/0x5a [vznetdev]
 [<c01034dd>] error_code+0x39/0x40
 [<c01163a8>] rebalance_tick+0x2fa/0x485
 [<c012476b>] update_process_times+0x52/0x5c
 [<c010c9d2>] smp_apic_timer_interrupt+0x9b/0xa1
 [<c010342b>] apic_timer_interrupt+0x1f/0x24
 [<c0281338>] _spin_unlock_irqrestore+0x8/0x9
 [<c012d3f6>] __wake_up_bit+0x29/0x2e
 [<c016515e>] end_buffer_async_write+0xe3/0x105
 [<c014a30c>] mempool_free+0x5f/0x63
 [<c0164939>] end_bio_bh_io_sync+0x0/0x39
 [<c0164967>] end_bio_bh_io_sync+0x2e/0x39
 [<c016618d>] bio_endio+0x50/0x55
 [<c01a835d>] __end_that_request_first+0x11b/0x425
 [<f891f12d>] scsi_end_request+0x1a/0xa9 [scsi_mod]
 [<c014a30c>] mempool_free+0x5f/0x63
 [<f891f2ff>] scsi_io_completion+0x143/0x2ed [scsi_mod]
 [<f89553b2>] sd_rw_intr+0x1eb/0x215 [sd_mod]
 [<f891b3bd>] scsi_finish_command+0x73/0x77 [scsi_mod]
 [<c01a9f25>] blk_done_softirq+0x4d/0x58
 [<c01205aa>] __do_softirq+0x84/0x109
 [<c0120665>] do_softirq+0x36/0x3a
 [<c0104ea4>] do_IRQ+0x8a/0x92
 [<c010339a>] common_interrupt+0x1a/0x20
 [<c0101731>] default_idle+0x0/0x59
 [<c0101762>] default_idle+0x31/0x59
 [<c01017e8>] cpu_idle+0x5e/0x74



-- 

   E Frank Ball                efball@efball.com

Thorsten,

Alexey Dobriyan told me that you said you found some misprint
in OVZ patch ported to debian.
Is it true? Can you please point to this? Any patch?

to Frank, can you try using 2.6.18-mainstream-OVZ kernel until this
is resolved in Debian branch and thus confirm that it's purely debian-kernel problem?

Thanks,
Kirill


E Frank Ball III wrote:
> On Wed, Oct 24, 2007 at 06:31:39AM +0200, Martin Trtusek wrote:
>  > The same kernel on i386 is working without oops (uptime 22 days). Should
>  > I fulfill a bug ?
>  > 
>  > Unfortunately previous hardware are not available for test now (it is in
>  > production, with 2.6.18-openvz-13-1etch4 kernel). Probably after next
>  > week we will have similar one for 1-2 week testing.
>  > 
>  > Martin Trtusek
>  > 
>  > Martin Trtusek pí?e v St 10. 10. 2007 v 07:54 +0200:
>  > > I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
>  > > http://download.openvz.org/debian on Debian Etch one week ago and
>  > > experienced kernel oops (complete freezing, off/on necessary) after 2-3
>  > > days of running (3 times). Oops is always after cron.daily scripts (in
>  > > my case 06:25) but not everyday. Yesterday I configured netconsole for
>  > > capturing useful info, enclosed.
> 
> 
> I've seen three crashes with
> linux-image-2.6.18-openvz-13-39.1d2-686_028.39.1d2_i386.deb 
> 
> I changed my production server back to 2.6.18-openvz-12-1etch1-686.
> 
> I captured the output this time:
> 
> preparing to turn dcache accounting on, size 4294967293 pages, watermarks 0 21800
> UBC: turning dcache accounting on succeeded, usage 1236258, time 0.040
> ------------[ cut here ]------------
> kernel BUG at kernel/sched.c:3798!
> invalid opcode: 0000 [#1]
> SMP 
> Modules linked in:  netconsole tcp_diag inet_diag hp100 nfs simfs
> vznetdev vzethdev vzrst ip_nat vzcpt ip_conntrack nfnetlink vzdquota
> vzmon vzdev xt_length ipt_ttl xt_tcpmss ipt_TCPMSS iptable_mangle
> iptable_filter xt_multiport xt_limit ipt_tos ipt_REJECT ip_tables
> x_tables nfsd exportfs lockd nfs_acl sunrpc ppdev lp ipv6 nls_iso8859_1
> isofs dm_snapshot dm_mirror dm_mod uhci_hcd ehci_hcd usb_storage
> ide_generic loop snd_cs46xx gameport snd_seq_dummy snd_seq_oss
> snd_seq_midi snd_seq_midi_event snd_seq tsdev snd_rawmidi snd_seq_device
> snd_ac97_codec snd_ac97_bus snd_pcm_oss snd_mixer_oss i2c_piix4 snd_pcm
> i2c_core snd_timer parport_pc psmouse rtc serio_raw snd evdev soundcore
> snd_page_alloc shpchp pci_hotplug parport sworks_agp agpgart floppy
> pcspkr ide_floppy ext3 jbd mbcache sd_mod ide_cd cdrom ide_disk ohci_hcd
> usbcore aic7xxx scsi_transport_spi scsi_mod serverworks generic ide_core
> e100 mii processor
> CPU:    1, VCPU: -1.1
> EIP:    0060:[<c01163a8>]    Not tainted VLI
> EFLAGS: 00010046   (2.6.18-openvz-13-39.1d2-686 #1) 
> EIP is at rebalance_tick+0x2fa/0x485
> eax: 0000005e   ebx: c035c6c0   ecx: 00000008   edx: dfb05d94
> esi: c2214180   edi: dfb99000   ebp: dfb05db0   esp: dfb05d64
> ds: 007b   es: 007b   ss: 0068
> Process swapper (pid: 0, veid: 0, ti=dfb04000 task=dfb01220 task.ti=dfb04000)
> Stack: 00000000 00000000 dfb98000 dfb98000 330b1369 00000001 00000002 00000001 
>        dfb99000 1fb2c449 dfb99000 00000003 000000ff 0000005e 00000000 00000000 
>        dfb01220 00000001 00000000 c1f78da4 c012476b dfb05dd0 f524a414 00000202 
>  Call Trace:
>  [<c012476b>] update_process_times+0x52/0x5c
>  [<c010c9d2>] smp_apic_timer_interrupt+0x9b/0xa1
>  [<c010342b>] apic_timer_interrupt+0x1f/0x24
>  [<c0281338>] _spin_unlock_irqrestore+0x8/0x9
>  [<c012d3f6>] __wake_up_bit+0x29/0x2e
>  [<c016515e>] end_buffer_async_write+0xe3/0x105
>  [<c014a30c>] mempool_free+0x5f/0x63
>  [<c0164939>] end_bio_bh_io_sync+0x0/0x39
>  [<c0164967>] end_bio_bh_io_sync+0x2e/0x39
>  [<c016618d>] bio_endio+0x50/0x55
>  [<c01a835d>] __end_that_request_first+0x11b/0x425
>  [<f891f12d>] scsi_end_request+0x1a/0xa9 [scsi_mod]
>  [<c014a30c>] mempool_free+0x5f/0x63
>  [<f891f2ff>] scsi_io_completion+0x143/0x2ed [scsi_mod]
>  [<f89553b2>] sd_rw_intr+0x1eb/0x215 [sd_mod]
>  [<f891b3bd>] scsi_finish_command+0x73/0x77 [scsi_mod]
>  [<c01a9f25>] blk_done_softirq+0x4d/0x58
>  [<c01205aa>] __do_softirq+0x84/0x109
>  [<c0120665>] do_softirq+0x36/0x3a
>  [<c0104ea4>] do_IRQ+0x8a/0x92
>  [<c010339a>] common_interrupt+0x1a/0x20
>  [<c0101731>] default_idle+0x0/0x59
>  [<c0101762>] default_idle+0x31/0x59
>  [<c01017e8>] cpu_idle+0x5e/0x74
> Code:  0c 85 c0 0f 84 4e 01 00 00 53 89 c2 8b 4d b8 ff 75 e8 8b 45 dc e8
> a7 cf ff ff 89 c3 58 85 db 5a 0f 84 31 01 00 00 39 7d d4 75 0b <0f> 0b
> 66 b8 d6 0e b8 a3 61 29 c0 39 fb 89 5d d4 0f 84 16 01 00
> EIP: [<c01163a8>] rebalance_tick+0x2fa/0x485 SS:ESP 0068:dfb05d64
> Kernel panic - not syncing: Fatal exception in interrupt
> BUG: warning at arch/i386/kernel/smp.c:550/smp_call_function()
>  [<c010b093>] smp_call_function+0x53/0xfe
>  [<c011bfce>] vprintk+0x26/0x3a
>  [<c010b151>] smp_send_stop+0x13/0x1c
>  [<c011b322>] panic+0x4c/0xe2
>  [<c0103d59>] die+0x252/0x269
>  [<c0104617>] do_invalid_op+0x0/0x9d
>  [<c01046a8>] do_invalid_op+0x91/0x9d
>  [<c01163a8>] rebalance_tick+0x2fa/0x485
>  [<f8e3c87a>] ipt_do_table+0x2a1/0x2cb [ip_tables]
>  [<c01b2b10>] __next_cpu+0x12/0x21
>  [<c0113533>] find_busiest_group+0x185/0x46e
>  [<f8f5e982>] venet_entry_lookup+0x2c/0x5a [vznetdev]
>  [<c01034dd>] error_code+0x39/0x40
>  [<c01163a8>] rebalance_tick+0x2fa/0x485
>  [<c012476b>] update_process_times+0x52/0x5c
>  [<c010c9d2>] smp_apic_timer_interrupt+0x9b/0xa1
>  [<c010342b>] apic_timer_interrupt+0x1f/0x24
>  [<c0281338>] _spin_unlock_irqrestore+0x8/0x9
>  [<c012d3f6>] __wake_up_bit+0x29/0x2e
>  [<c016515e>] end_buffer_async_write+0xe3/0x105
>  [<c014a30c>] mempool_free+0x5f/0x63
>  [<c0164939>] end_bio_bh_io_sync+0x0/0x39
>  [<c0164967>] end_bio_bh_io_sync+0x2e/0x39
>  [<c016618d>] bio_endio+0x50/0x55
>  [<c01a835d>] __end_that_request_first+0x11b/0x425
>  [<f891f12d>] scsi_end_request+0x1a/0xa9 [scsi_mod]
>  [<c014a30c>] mempool_free+0x5f/0x63
>  [<f891f2ff>] scsi_io_completion+0x143/0x2ed [scsi_mod]
>  [<f89553b2>] sd_rw_intr+0x1eb/0x215 [sd_mod]
>  [<f891b3bd>] scsi_finish_command+0x73/0x77 [scsi_mod]
>  [<c01a9f25>] blk_done_softirq+0x4d/0x58
>  [<c01205aa>] __do_softirq+0x84/0x109
>  [<c0120665>] do_softirq+0x36/0x3a
>  [<c0104ea4>] do_IRQ+0x8a/0x92
>  [<c010339a>] common_interrupt+0x1a/0x20
>  [<c0101731>] default_idle+0x0/0x59
>  [<c0101762>] default_idle+0x31/0x59
>  [<c01017e8>] cpu_idle+0x5e/0x74
> 
> 
>

Hi Kirill, hi Frank,

@Kirill:
yes i found a misprint, which affected the debian linux tree only
028stab045, done in my linux-patch-openvz.

I can take a look between Ola's 028stab039 and my patches and mail the
diff to Alex and you.

@Frank:
I've built the the OpenVZ kernels called fzakernel, it's the debian kernel
config plus OpenVZ support, version 028stab048;
see
http://debian.systs.org/openvz/166/new-openvz-flavour-added-fzakernel-version-028stab481/

Regards,
 Thorsten

Am Mo, 29.10.2007, 17:34, schrieb Kirill Korotaev:
> Thorsten,
>
> Alexey Dobriyan told me that you said you found some misprint
> in OVZ patch ported to debian.
> Is it true? Can you please point to this? Any patch?
>
> to Frank, can you try using 2.6.18-mainstream-OVZ kernel until this is
resolved in Debian branch and thus confirm that it's purely
> debian-kernel problem?
>
> Thanks,
> Kirill
>
>
> E Frank Ball III wrote:
>> On Wed, Oct 24, 2007 at 06:31:39AM +0200, Martin Trtusek wrote:
>>  > The same kernel on i386 is working without oops (uptime 22 days).
>> Should
>>  > I fulfill a bug ?
>>  >
>>  > Unfortunately previous hardware are not available for test now (it is
>> in
>>  > production, with 2.6.18-openvz-13-1etch4 kernel). Probably after
next week we will have similar one for 1-2 week testing.
>>  >
>>  > Martin Trtusek
>>  >
>>  > Martin Trtusek pí?e v St 10. 10. 2007 v 07:54 +0200:
>>  > > I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
>>  > > http://download.openvz.org/debian on Debian Etch one week ago and
experienced kernel oops (complete freezing, off/on necessary)
after
>> 2-3
>>  > > days of running (3 times). Oops is always after cron.daily scripts
>> (in
>>  > > my case 06:25) but not everyday. Yesterday I configured netconsole
>> for
>>  > > capturing useful info, enclosed.
>>
>>
>> I've seen three crashes with
>> linux-image-2.6.18-openvz-13-39.1d2-686_028.39.1d2_i386.deb
>>
>> I changed my production server back to 2.6.18-openvz-12-1etch1-686.
>>
>> I captured the output this time:
>>
>> preparing to turn dcache accounting on, size 4294967293 pages,
>> watermarks 0 21800
>> UBC: turning dcache accounting on succeeded, usage 1236258, time 0.040
------------[ cut here ]------------
>> kernel BUG at kernel/sched.c:3798!
>> invalid opcode: 0000 [#1]
>> SMP
>> Modules linked in:  netconsole tcp_diag inet_diag hp100 nfs simfs
vznetdev vzethdev vzrst ip_nat vzcpt ip_conntrack nfnetlink vzdquota
vzmon vzdev xt_length ipt_ttl xt_tcpmss ipt_TCPMSS iptable_mangle
iptable_filter xt_multiport xt_limit ipt_tos ipt_REJECT ip_tables
x_tables nfsd exportfs lockd nfs_acl sunrpc ppdev lp ipv6 nls_iso8859_1
isofs dm_snapshot dm_mirror dm_mod uhci_hcd ehci_hcd usb_storage
ide_generic loop snd_cs46xx gameport snd_seq_dummy snd_seq_oss
>> snd_seq_midi snd_seq_midi_event snd_seq tsdev snd_rawmidi
snd_seq_device snd_ac97_codec snd_ac97_bus snd_pcm_oss snd_mixer_oss
i2c_piix4 snd_pcm i2c_core snd_timer parport_pc psmouse rtc serio_raw
snd evdev soundcore snd_page_alloc shpchp pci_hotplug parport
sworks_agp agpgart floppy pcspkr ide_floppy ext3 jbd mbcache sd_mod
ide_cd cdrom ide_disk ohci_hcd usbcore aic7xxx scsi_transport_spi
scsi_mod serverworks generic ide_core e100 mii processor
>> CPU:    1, VCPU: -1.1
>> EIP:    0060:[<c01163a8>]    Not tainted VLI
>> EFLAGS: 00010046   (2.6.18-openvz-13-39.1d2-686 #1)
>> EIP is at rebalance_tick+0x2fa/0x485
>> eax: 0000005e   ebx: c035c6c0   ecx: 00000008   edx: dfb05d94
>> esi: c2214180   edi: dfb99000   ebp: dfb05db0   esp: dfb05d64
>> ds: 007b   es: 007b   ss: 0068
>> Process swapper (pid: 0, veid: 0, ti=dfb04000 task=dfb01220
>> task.ti=dfb04000)
>> Stack: 00000000 00000000 dfb98000 dfb98000 330b1369 00000001 00000002
00000001
>>        dfb99000 1fb2c449 dfb99000 00000003 000000ff 0000005e 00000000
>> 00000000
>>        dfb01220 00000001 00000000 c1f78da4 c012476b dfb05dd0 f524a414
>> 00000202
>>  Call Trace:
>>  [<c012476b>] update_process_times+0x52/0x5c
>>  [<c010c9d2>] smp_apic_timer_interrupt+0x9b/0xa1
>>  [<c010342b>] apic_timer_interrupt+0x1f/0x24
>>  [<c0281338>] _spin_unlock_irqrestore+0x8/0x9
>>  [<c012d3f6>] __wake_up_bit+0x29/0x2e
>>  [<c016515e>] end_buffer_async_write+0xe3/0x105
>>  [<c014a30c>] mempool_free+0x5f/0x63
>>  [<c0164939>] end_bio_bh_io_sync+0x0/0x39
>>  [<c0164967>] end_bio_bh_io_sync+0x2e/0x39
>>  [<c016618d>] bio_endio+0x50/0x55
>>  [<c01a835d>] __end_that_request_first+0x11b/0x425
>>  [<f891f12d>] scsi_end_request+0x1a/0xa9 [scsi_mod]
>>  [<c014a30c>] mempool_free+0x5f/0x63
>>  [<f891f2ff>] scsi_io_completion+0x143/0x2ed [scsi_mod]
>>  [<f89553b2>] sd_rw_intr+0x1eb/0x215 [sd_mod]
>>  [<f891b3bd>] scsi_finish_command+0x73/0x77 [scsi_mod]
>>  [<c01a9f25>] blk_done_softirq+0x4d/0x58
>>  [<c01205aa>] __do_softirq+0x84/0x109
>>  [<c0120665>] do_softirq+0x36/0x3a
>>  [<c0104ea4>] do_IRQ+0x8a/0x92
>>  [<c010339a>] common_interrupt+0x1a/0x20
>>  [<c0101731>] default_idle+0x0/0x59
>>  [<c0101762>] default_idle+0x31/0x59
>>  [<c01017e8>] cpu_idle+0x5e/0x74
>> Code:  0c 85 c0 0f 84 4e 01 00 00 53 89 c2 8b 4d b8 ff 75 e8 8b 45 dc
e8 a7 cf ff ff 89 c3 58 85 db 5a 0f 84 31 01 00 00 39 7d d4 75 0b <0f>
0b 66 b8 d6 0e b8 a3 61 29 c0 39 fb 89 5d d4 0f 84 16 01 00
>> EIP: [<c01163a8>] rebalance_tick+0x2fa/0x485 SS:ESP 0068:dfb05d64
Kernel panic - not syncing: Fatal exception in interrupt
>> BUG: warning at arch/i386/kernel/smp.c:550/smp_call_function()
>>  [<c010b093>] smp_call_function+0x53/0xfe
>>  [<c011bfce>] vprintk+0x26/0x3a
>>  [<c010b151>] smp_send_stop+0x13/0x1c
>>  [<c011b322>] panic+0x4c/0xe2
>>  [<c0103d59>] die+0x252/0x269
>>  [<c0104617>] do_invalid_op+0x0/0x9d
>>  [<c01046a8>] do_invalid_op+0x91/0x9d
>>  [<c01163a8>] rebalance_tick+0x2fa/0x485
>>  [<f8e3c87a>] ipt_do_table+0x2a1/0x2cb [ip_tables]
>>  [<c01b2b10>] __next_cpu+0x12/0x21
>>  [<c0113533>] find_busiest_group+0x185/0x46e
>>  [<f8f5e982>] venet_entry_lookup+0x2c/0x5a [vznetdev]
>>  [<c01034dd>] error_code+0x39/0x40
>>  [<c01163a8>] rebalance_tick+0x2fa/0x485
>>  [<c012476b>] update_process_times+0x52/0x5c
>>  [<c010c9d2>] smp_apic_timer_interrupt+0x9b/0xa1
>>  [<c010342b>] apic_timer_interrupt+0x1f/0x24
>>  [<c0281338>] _spin_unlock_irqrestore+0x8/0x9
>>  [<c012d3f6>] __wake_up_bit+0x29/0x2e
>>  [<c016515e>] end_buffer_async_write+0xe3/0x105
>>  [<c014a30c>] mempool_free+0x5f/0x63
>>  [<c0164939>] end_bio_bh_io_sync+0x0/0x39
>>  [<c0164967>] end_bio_bh_io_sync+0x2e/0x39
>>  [<c016618d>] bio_endio+0x50/0x55
>>  [<c01a835d>] __end_that_request_first+0x11b/0x425
>>  [<f891f12d>] scsi_end_request+0x1a/0xa9 [scsi_mod]
>>  [<c014a30c>] mempool_free+0x5f/0x63
>>  [<f891f2ff>] scsi_io_completion+0x143/0x2ed [scsi_mod]
>>  [<f89553b2>] sd_rw_intr+0x1eb/0x215 [sd_mod]
>>  [<f891b3bd>] scsi_finish_command+0x73/0x77 [scsi_mod]
>>  [<c01a9f25>] blk_done_softirq+0x4d/0x58
>>  [<c01205aa>] __do_softirq+0x84/0x109
>>  [<c0120665>] do_softirq+0x36/0x3a
>>  [<c0104ea4>] do_IRQ+0x8a/0x92
>>  [<c010339a>] common_interrupt+0x1a/0x20
>>  [<c0101731>] default_idle+0x0/0x59
>>  [<c0101762>] default_idle+0x31/0x59
>>  [<c01017e8>] cpu_idle+0x5e/0x74

Frank,

can you please try this kernel?

Thanks,
Kirill

Thorsten Schifferdecker wrote:
> Hi Kirill, hi Frank,
> 
> @Kirill:
> yes i found a misprint, which affected the debian linux tree only
> 028stab045, done in my linux-patch-openvz.
> 
> I can take a look between Ola's 028stab039 and my patches and mail the
> diff to Alex and you.
> 
> @Frank:
> I've built the the OpenVZ kernels called fzakernel, it's the debian kernel
> config plus OpenVZ support, version 028stab048;
> see
> http://debian.systs.org/openvz/166/new-openvz-flavour-added-fzakernel-version-028stab481/
> 
> Regards,
>  Thorsten
> 
> Am Mo, 29.10.2007, 17:34, schrieb Kirill Korotaev:
> 
>>Thorsten,
>>
>>Alexey Dobriyan told me that you said you found some misprint
>>in OVZ patch ported to debian.
>>Is it true? Can you please point to this? Any patch?
>>
>>to Frank, can you try using 2.6.18-mainstream-OVZ kernel until this is
> 
> resolved in Debian branch and thus confirm that it's purely
> 
>>debian-kernel problem?
>>
>>Thanks,
>>Kirill
>>
>>
>>E Frank Ball III wrote:
>>
>>>On Wed, Oct 24, 2007 at 06:31:39AM +0200, Martin Trtusek wrote:
>>> > The same kernel on i386 is working without oops (uptime 22 days).
>>>Should
>>> > I fulfill a bug ?
>>> >
>>> > Unfortunately previous hardware are not available for test now (it is
>>>in
>>> > production, with 2.6.18-openvz-13-1etch4 kernel). Probably after
> 
> next week we will have similar one for 1-2 week testing.
> 
>>> >
>>> > Martin Trtusek
>>> >
>>> > Martin Trtusek pí?e v St 10. 10. 2007 v 07:54 +0200:
>>> > > I installed kernel 2.6.18-openvz-13-39.1d1-amd64 from
>>> > > http://download.openvz.org/debian on Debian Etch one week ago and
> 
> experienced kernel oops (complete freezing, off/on necessary)
> after
> 
>>>2-3
>>> > > days of running (3 times). Oops is always after cron.daily scripts
>>>(in
>>> > > my case 06:25) but not everyday. Yesterday I configured netconsole
>>>for
>>> > > capturing useful info, enclosed.
>>>
>>>
>>>I've seen three crashes with
>>>linux-image-2.6.18-openvz-13-39.1d2-686_028.39.1d2_i386.deb
>>>
>>>I changed my production server back to 2.6.18-openvz-12-1etch1-686.
>>>
>>>I captured the output this time:
>>>
>>>preparing to turn dcache accounting on, size 4294967293 pages,
>>>watermarks 0 21800
>>>UBC: turning dcache accounting on succeeded, usage 1236258, time 0.040
> 
> ------------[ cut here ]------------
> 
>>>kernel BUG at kernel/sched.c:3798!
>>>invalid opcode: 0000 [#1]
>>>SMP
>>>Modules linked in:  netconsole tcp_diag inet_diag hp100 nfs simfs
> 
> vznetdev vzethdev vzrst ip_nat vzcpt ip_conntrack nfnetlink vzdquota
> vzmon vzdev xt_length ipt_ttl xt_tcpmss ipt_TCPMSS iptable_mangle
> iptable_filter xt_multiport xt_limit ipt_tos ipt_REJECT ip_tables
> x_tables nfsd exportfs lockd nfs_acl sunrpc ppdev lp ipv6 nls_iso8859_1
> isofs dm_snapshot dm_mirror dm_mod uhci_hcd ehci_hcd usb_storage
> ide_generic loop snd_cs46xx gameport snd_seq_dummy snd_seq_oss
> 
>>>snd_seq_midi snd_seq_midi_event snd_seq tsdev snd_rawmidi
> 
> snd_seq_device snd_ac97_codec snd_ac97_bus snd_pcm_oss snd_mixer_oss
> i2c_piix4 snd_pcm i2c_core snd_timer parport_pc psmouse rtc serio_raw
> snd evdev soundcore snd_page_alloc shpchp pci_hotplug parport
> sworks_agp agpgart floppy pcspkr ide_floppy ext3 jbd mbcache sd_mod
> ide_cd cdrom ide_disk ohci_hcd usbcore aic7xxx scsi_transport_spi
> scsi_mod serverworks generic ide_core e100 mii processor
> 
>>>CPU:    1, VCPU: -1.1
>>>EIP:    0060:[<c01163a8>]    Not tainted VLI
>>>EFLAGS: 00010046   (2.6.18-openvz-13-39.1d2-686 #1)
>>>EIP is at rebalance_tick+0x2fa/0x485
>>>eax: 0000005e   ebx: c035c6c0   ecx: 00000008   edx: dfb05d94
>>>esi: c2214180   edi: dfb99000   ebp: dfb05db0   esp: dfb05d64
>>>ds: 007b   es: 007b   ss: 0068
>>>Process swapper (pid: 0, veid: 0, ti=dfb04000 task=dfb01220
>>>task.ti=dfb04000)
>>>Stack: 00000000 00000000 dfb98000 dfb98000 330b1369 00000001 00000002
> 
> 00000001
> 
>>>       dfb99000 1fb2c449 dfb99000 00000003 000000ff 0000005e 00000000
>>>00000000
>>>       dfb01220 00000001 00000000 c1f78da4 c012476b dfb05dd0 f524a414
>>>00000202
>>> Call Trace:
>>> [<c012476b>] update_process_times+0x52/0x5c
>>> [<c010c9d2>] smp_apic_timer_interrupt+0x9b/0xa1
>>> [<c010342b>] apic_timer_interrupt+0x1f/0x24
>>> [<c0281338>] _spin_unlock_irqrestore+0x8/0x9
>>> [<c012d3f6>] __wake_up_bit+0x29/0x2e
>>> [<c016515e>] end_buffer_async_write+0xe3/0x105
>>> [<c014a30c>] mempool_free+0x5f/0x63
>>> [<c0164939>] end_bio_bh_io_sync+0x0/0x39
>>> [<c0164967>] end_bio_bh_io_sync+0x2e/0x39
>>> [<c016618d>] bio_endio+0x50/0x55
>>> [<c01a835d>] __end_that_request_first+0x11b/0x425
>>> [<f891f12d>] scsi_end_request+0x1a/0xa9 [scsi_mod]
>>> [<c014a30c>] mempool_free+0x5f/0x63
>>> [<f891f2ff>] scsi_io_completion+0x143/0x2ed [scsi_mod]
>>> [<f89553b2>] sd_rw_intr+0x1eb/0x215 [sd_mod]
>>> [<f891b3bd>] scsi_finish_command+0x73/0x77 [scsi_mod]
>>> [<c01a9f25>] blk_done_softirq+0x4d/0x58
>>> [<c01205aa>] __do_softirq+0x84/0x109
>>> [<c0120665>] do_softirq+0x36/0x3a
>>> [<c0104ea4>] do_IRQ+0x8a/0x92
>>> [<c010339a>] common_interrupt+0x1a/0x20
>>> [<c0101731>] default_idle+0x0/0x59
>>> [<c0101762>] default_idle+0x31/0x59
>>> [<c01017e8>] cpu_idle+0x5e/0x74
>>>Code:  0c 85 c0 0f 84 4e 01 00 00 53 89 c2 8b 4d b8 ff 75 e8 8b 45 dc
> 
> e8 a7 cf ff ff 89 c3 58 85 db 5a 0f 84 31 01 00 00 39 7d d4 75 0b <0f>
> 0b 66 b8 d6 0e b8 a3 61 29 c0 39 fb 89 5d d4 0f 84 16 01 00
> 
>>>EIP: [<c01163a8>] rebalance_tick+0x2fa/0x485 SS:ESP 0068:dfb05d64
> 
> Kernel panic - not syncing: Fatal exception in interrupt
> 
>>>BUG: warning at arch/i386/kernel/smp.c:550/smp_call_function()
>>> [<c010b093>] smp_call_function+0x53/0xfe
>>> [<c011bfce>] vprintk+0x26/0x3a
>>> [<c010b151>] smp_send_stop+0x13/0x1c
>>> [<c011b322>] panic+0x4c/0xe2
>>> [<c0103d59>] die+0x252/0x269
>>> [<c0104617>] do_invalid_op+0x0/0x9d
>>> [<c01046a8>] do_invalid_op+0x91/0x9d
>>> [<c01163a8>] rebalance_tick+0x2fa/0x485
>>> [<f8e3c87a>] ipt_do_table+0x2a1/0x2cb [ip_tables]
>>> [<c01b2b10>] __next_cpu+0x12/0x21
>>> [<c0113533>] find_busiest_group+0x185/0x46e
>>> [<f8f5e982>] venet_entry_lookup+0x2c/0x5a [vznetdev]
>>> [<c01034dd>] error_code+0x39/0x40
>>> [<c01163a8>] rebalance_tick+0x2fa/0x485
>>> [<c012476b>] update_process_times+0x52/0x5c
>>> [<c010c9d2>] smp_apic_timer_interrupt+0x9b/0xa1
>>> [<c010342b>] apic_timer_interrupt+0x1f/0x24
>>> [<c0281338>] _spin_unlock_irqrestore+0x8/0x9
>>> [<c012d3f6>] __wake_up_bit+0x29/0x2e
>>> [<c016515e>] end_buffer_async_write+0xe3/0x105
>>> [<c014a30c>] mempool_free+0x5f/0x63
>>> [<c0164939>] end_bio_bh_io_sync+0x0/0x39
>>> [<c0164967>] end_bio_bh_io_sync+0x2e/0x39
>>> [<c016618d>] bio_endio+0x50/0x55
>>> [<c01a835d>] __end_that_request_first+0x11b/0x425
>>> [<f891f12d>] scsi_end_request+0x1a/0xa9 [scsi_mod]
>>> [<c014a30c>] mempool_free+0x5f/0x63
>>> [<f891f2ff>] scsi_io_completion+0x143/0x2ed [scsi_mod]
>>> [<f89553b2>] sd_rw_intr+0x1eb/0x215 [sd_mod]
>>> [<f891b3bd>] scsi_finish_command+0x73/0x77 [scsi_mod]
>>> [<c01a9f25>] blk_done_softirq+0x4d/0x58
>>> [<c01205aa>] __do_softirq+0x84/0x109
>>> [<c0120665>] do_softirq+0x36/0x3a
>>> [<c0104ea4>] do_IRQ+0x8a/0x92
>>> [<c010339a>] common_interrupt+0x1a/0x20
>>> [<c0101731>] default_idle+0x0/0x59
>>> [<c0101762>] default_idle+0x31/0x59
>>> [<c01017e8>] cpu_idle+0x5e/0x74
> 
>

Kirill,

It's running.  It will take time to see how stable it is.

cat /proc/version 
Linux version 2.6.18-fza-5-686 () (tsd@debian.systs.org)


   E Frank Ball                efball@efball.com

On Tue, Nov 06, 2007 at 06:34:10PM +0300, Kirill Korotaev wrote:
 > Frank,
 > 
 > can you please try this kernel?
 > 
 > Thanks,
 > Kirill
 > 
 > Thorsten Schifferdecker wrote:
 > > Hi Kirill, hi Frank,
 > > 
 > > @Kirill:
 > > yes i found a misprint, which affected the debian linux tree only
 > > 028stab045, done in my linux-patch-openvz.
 > > 
 > > I can take a look between Ola's 028stab039 and my patches and mail the
 > > diff to Alex and you.
 > > 
 > > @Frank:
 > > I've built the the OpenVZ kernels called fzakernel, it's the debian kernel
 > > config plus OpenVZ support, version 028stab048;
 > > see
 > > http://debian.systs.org/openvz/166/new-openvz-flavour-added-fzakernel-version-028stab481/
 > > 
 > > Regards,
 > >  Thorsten

On Mon, Nov 05, 2007 at 05:48:38PM -0000, Thorsten Schifferdecker wrote:
 > Hi Kirill, hi Frank,
 > 
 > @Kirill:
 > yes i found a misprint, which affected the debian linux tree only
 > 028stab045, done in my linux-patch-openvz.
 > 
 > I can take a look between Ola's 028stab039 and my patches and mail the
 > diff to Alex and you.
 > 
 > @Frank:
 > I've built the the OpenVZ kernels called fzakernel, it's the debian kernel
 > config plus OpenVZ support, version 028stab048;
 > see
 > http://debian.systs.org/openvz/166/new-openvz-flavour-added-fzakernel-version-028stab481/
 > 
 > Regards,
 >  Thorsten


Thorsten,

I've had your fzakernel-2.6.18-686 kernel running on two boxes for a
month now, and it works great.  No more crashes.

I'm a little confused by something, your website also has the
ovzkernel-2.6.18 kernel that appears to be the same version
(028stab48.1) and is 23 minutes newer than the fzakernel.  What's the
difference?  I tried that one, but my automounter (amd) doesn't work on
the host anymore (it does work in the VEs).

-- 

   E Frank Ball                efball@efball.com

Hello Frank,

E Frank Ball III wrote:

> I've had your fzakernel-2.6.18-686 kernel running on two boxes for a
> month now, and it works great.  No more crashes.

Perfect! ;-)
> 
> I'm a little confused by something, your website also has the
> ovzkernel-2.6.18 kernel that appears to be the same version
> (028stab48.1) and is 23 minutes newer than the fzakernel.  What's the
> difference?  I tried that one, but my automounter (amd) doesn't work on
> the host anymore (it does work in the VEs).
> 

The main difference between fza and ovz:

fza used the debian kernel config plus openvz
ovz used the orignal kernel config from openvz.org

The time difference are releated to the build-queue only.

Plz post the loaded modules at your Hdw-Node, on which kernel work the
automounter-daemon ?

Bye,
  Thorsten

On Tue, Dec 11, 2007 at 08:42:06AM +0100, Thorsten Schifferdecker wrote:
>
> E Frank Ball III wrote:
>
>> I'm a little confused by something, your website also has the
>> ovzkernel-2.6.18 kernel that appears to be the same version
>> (028stab48.1) and is 23 minutes newer than the fzakernel.  What's the
>> difference?  I tried that one, but my automounter (amd) doesn't work on
>> the host anymore (it does work in the VEs).
>
>
> Plz post the loaded modules at your Hdw-Node, on which kernel work the
> automounter-daemon ?
>
>  Thorsten


I tried going back to the 2.6.18-fza-5-686 kernel, but the automounter
(amd) still wasn't working.  This kernel had been working fine.  Then I
remembered I upgraded this box from etch/stable to lenny/testing.  After
the upgrade amd kept working fine until I rebooted.  So now amd doesn't
work with any of these kernels:  2.6.18-fza-5-686,
2.6.18-fza-028stab051.1-686, 2.6.18-ovz-028stab051.1-smp.
But it does work with 2.6.18-openvz-12-1etch1-686.

I'm not seeing any errors in the log files, just a "directory
not found" error when I try to cd to a mount point.

Here is the output of lsmod with the working
2.6.18-openvz-12-1etch1-686 kernel:

Module                  Size  Used by
 hp100                  19104  0 
 vzethdev               10152  0 
 vznetdev               16384  7 
 simfs                   5068  3 
 vzrst                 118964  0 
 ip_nat                 17712  1 vzrst
 vzcpt                  95620  0 
 ip_conntrack           56224  3 vzrst,ip_nat,vzcpt
 nfnetlink               6712  2 ip_nat,ip_conntrack
 vzdquota               36212  3 [permanent]
 vzmon                  40328  7 vzethdev,vznetdev,vzrst,vzcpt
 vzdev                   3588  4 vzethdev,vznetdev,vzdquota,vzmon
 xt_tcpudp               3136  0 
 xt_length               2048  0 
 ipt_ttl                 1984  0 
 xt_tcpmss               2336  0 
 ipt_TCPMSS              4192  0 
 iptable_mangle          4704  3 
 iptable_filter          4608  3 
 xt_multiport            3264  0 
 xt_limit                2752  0 
 ipt_tos                 1760  0 
 ipt_REJECT              5280  0 
 ip_tables              13992  2 iptable_mangle,iptable_filter
 x_tables               15204  10 xt_tcpudp,xt_length,ipt_ttl,xt_tcpmss,ipt_TCPMSS,xt_multiport,xt_limit,ipt_tos,ipt_REJECT,ip_tables
 nfsd                  199184  13 
 exportfs                5856  1 nfsd
 ppdev                   8676  0 
 lp                     11012  0 
 nfs                   204524  5 
 lockd                  54440  3 nfsd,nfs
 nfs_acl                 3584  2 nfsd,nfs
 sunrpc                140124  11 nfsd,nfs,lockd,nfs_acl
 ipv6                  235424  43 vzrst,vzcpt,vzmon
 nls_iso8859_1           4256  12 
 isofs                  32572  14 
 dm_snapshot            15552  0 
 dm_mirror              19152  0 
 dm_mod                 50264  2 dm_snapshot,dm_mirror
 uhci_hcd               21164  0 
 ehci_hcd               28168  0 
 usb_storage            71808  0 
 ide_generic             1408  0 [permanent]
 loop                   15048  28 
 snd_cs46xx             76360  0 
 gameport               14632  2 snd_cs46xx
 tsdev                   7520  0 
 snd_seq_dummy           3844  0 
 snd_seq_oss            28768  0 
 snd_seq_midi            8192  0 
 snd_seq_midi_event      7008  2 snd_seq_oss,snd_seq_midi
 snd_seq                45680  6 snd_seq_dummy,snd_seq_oss,snd_seq_midi,snd_seq_midi_event
 snd_rawmidi            22560  2 snd_cs46xx,snd_seq_midi
 snd_seq_device          7820  5 snd_seq_dummy,snd_seq_oss,snd_seq_midi,snd_seq,snd_rawmidi
 snd_ac97_codec         83104  1 snd_cs46xx
 snd_ac97_bus            2400  1 snd_ac97_codec
 snd_pcm_oss            38368  0 
 snd_mixer_oss          15200  1 snd_pcm_oss
 snd_pcm                68676  3 snd_cs46xx,snd_ac97_codec,snd_pcm_oss
 ide_floppy             16256  0 
 snd_timer              20996  2 snd_seq,snd_pcm
 psmouse                35016  0 
 floppy                 53156  0 
 snd                    47012  10 snd_cs46xx,snd_seq_oss,snd_seq,snd_rawmidi,snd_seq_device,snd_ac97_codec,snd_pcm_oss,snd_mixer_oss,snd_pcm,snd_timer
 parport_pc             32132  1 
 parport                33576  3 ppdev,lp,parport_pc
 serio_raw               6660  0 
 soundcore               9248  1 snd
 rtc                    12468  0 
 snd_page_alloc          9640  2 snd_cs46xx,snd_pcm
 sworks_agp              9152  1 
 shpchp                 33024  0 
 pci_hotplug            28704  1 shpchp
 agpgart                29896  1 sworks_agp
 i2c_piix4               8140  0 
 i2c_core               19712  1 i2c_piix4
 pcspkr                  3072  0 
 evdev                   9088  1 
 ext3                  119592  4 
 jbd                    57736  1 ext3
 mbcache                 8356  1 ext3
 sd_mod                 19040  4 
 ide_cd                 36064  0 
 cdrom                  32640  1 ide_cd
 ide_disk               14848  3 
 ohci_hcd               18276  0 
 aic7xxx               150996  3 
 scsi_transport_spi     22336  1 aic7xxx
 scsi_mod              124424  4 usb_storage,sd_mod,aic7xxx,scsi_transport_spi
 usbcore               112708  5 uhci_hcd,ehci_hcd,usb_storage,ohci_hcd
 serverworks             8328  0 [permanent]
 generic                 5476  0 [permanent]
 ide_core              110632  7 usb_storage,ide_generic,ide_floppy,ide_cd,ide_disk,serverworks,generic
 e100                   32232  0 
 mii                     5344  1 e100
 processor              25800  0 


-- 

   E Frank Ball                efball@efball.com