OpenVZ Forum: Support » File System Related Kernel Crash

Home » General » Support » File System Related Kernel Crash

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Thu, 26 March 2009 18:00

mperkel
Messages: 253
Registered: December 2006

Senior Member

I've had this bug for a long time. I turned on some debugging and here's what I captured. The problem always happens during backups where I'm running rsync and there's a lot of disk activity. Is this useful and if not how do I make it useful?

ar 26 02:42:09 vpsa kernel: ------------[ cut here ]------------
Mar 26 02:42:09 vpsa kernel: kernel BUG at fs/jbd/journal.c:569!
Mar 26 02:42:09 vpsa kernel: invalid opcode: 0000 [1] SMP
Mar 26 02:42:09 vpsa kernel: CPU: 1
Mar 26 02:42:09 vpsa kernel: Modules linked in: vzethdev simfs vzrst vzcpt tun vzdquota xt_tcpudp xt_length ipt_ttl xt_tcpmss xt_TCPMSS iptable_mangle iptable_filter xt_multiport xt_limit ipt_tos ipt_REJECT ip_tables x_tables autofs4 fuse sunrpc vznetdev vzmon vzdev ipv6 cpufreq_ondemand powernow_k8 freq_table dm_mirror dm_multipath dm_mod snd_hda_intel snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_mixer_oss snd_pcm parport_pc snd_timer parport snd_page_alloc firewire_ohci k8temp firewire_core snd_hwdep serio_raw pcspkr hwmon crc_itu_t snd soundcore forcedeth pata_amd i2c_nforce2 i2c_core button sg usb_storage ahci pata_atiixp pata_acpi sata_nv ata_generic libata sd_mod scsi_mod ext3 jbd mbcache uhci_hcd ohci_hcd ehci_hcd
Mar 26 02:42:09 vpsa kernel: Pid: 2356, comm: kjournald Not tainted 2.6.24 #3 ovz008
Mar 26 02:42:09 vpsa kernel: RIP: 0010:[<ffffffff8802652c>] [<ffffffff8802652c>] :jbd:journal_next_log_block+0x26/0x77
Mar 26 02:42:09 vpsa kernel: RSP: 0018:ffff81022550de10 EFLAGS: 00010246
Mar 26 02:42:09 vpsa kernel: RAX: ffff81021c494000 RBX: ffff81022d0d6848 RCX: ffffffff88026522
Mar 26 02:42:09 vpsa kernel: RDX: 0000000000000001 RSI: 0000000000000142 RDI: ffff81022d0d6870
Mar 26 02:42:09 vpsa kernel: RBP: ffff81022d0d6848 R08: 0000000000000000 R09: 0000000000000000
Mar 26 02:42:09 vpsa kernel: R10: ffffffff88026522 R11: ffff81022550de98 R12: ffff81022d0d6870
Mar 26 02:42:09 vpsa kernel: R13: ffff81022550de90 R14: ffff810031df0a80 R15: ffff81010b0a486c
Mar 26 02:42:09 vpsa kernel: FS: 00002ac9dc03a490(0000) GS:ffff81022fc02708(0000) knlGS:0000000000000000
Mar 26 02:42:09 vpsa kernel: CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Mar 26 02:42:09 vpsa kernel: CR2: 00000000006bb424 CR3: 0000000213117000 CR4: 00000000000006a0
Mar 26 02:42:09 vpsa kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 26 02:42:09 vpsa kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 26 02:42:09 vpsa kernel: Process kjournald (pid: 2356, veid=0, threadinfo ffff81022550c000, task ffff81021c494000)
Mar 26 02:42:09 vpsa kernel: Stack: ffff81022d0d6848 ffff81010b0a4864 ffff81022d0d6848 ffff81009cae35e8
Mar 26 02:42:09 vpsa kernel: ffff810216137a40 ffffffff880229c5 ffff810225cc5000 0000010b2c8898b8
Mar 26 02:42:09 vpsa kernel: 0000079400000000 000000d600000000 0000000000000000 ffff81021c494000
Mar 26 02:42:09 vpsa kernel: Call Trace:
Mar 26 02:42:09 vpsa kernel: [<ffffffff880229c5>] :jbd:journal_commit_transaction+0x8ad/0x11a0
Mar 26 02:42:09 vpsa kernel: [<ffffffff81048ca2>] autoremove_wake_function+0x0/0x2e
Mar 26 02:42:09 vpsa kernel: [<ffffffff88026921>] :jbd:kjournald+0x134/0x380
Mar 26 02:42:09 vpsa kernel: [<ffffffff81048ca2>] autoremove_wake_function+0x0/0x2e
Mar 26 02:42:09 vpsa kernel: [<ffffffff880267ed>] :jbd:kjournald+0x0/0x380
Mar 26 02:42:09 vpsa kernel: [<ffffffff81048b88>] kthread+0x47/0x73
Mar 26 02:42:09 vpsa kernel: [<ffffffff8125e844>] trace_hardirqs_on_thunk+0x35/0x3a
Mar 26 02:42:09 vpsa kernel: [<ffffffff8100cf58>] child_rip+0xa/0x12
Mar 26 02:42:09 vpsa kernel: [<ffffffff8100c66f>] restore_args+0x0/0x30
Mar 26 02:42:09 vpsa kernel: [<ffffffff81048a11>] kthreadd+0x115/0x13a
Mar 26 02:42:09 vpsa kernel: [<ffffffff81048a11>] kthreadd+0x115/0x13a
Mar 26 02:42:09 vpsa kernel: [<ffffffff81048b41>] kthread+0x0/0x73
Mar 26 02:42:09 vpsa kernel: [<ffffffff8100cf4e>] child_rip+0x0/0x12
Mar 26 02:42:09 vpsa kernel:
Mar 26 02:42:09 vpsa kernel:
Mar 26 02:42:09 vpsa kernel: Code: 0f 0b eb fe 48 8b ab e8 02 00 00 48 ff 8b f8 02 00 00 48 8d
Mar 26 02:42:09 vpsa kernel: RIP [<ffffffff8802652c>] :jbd:journal_next_log_block+0x26/0x77
Mar 26 02:42:09 vpsa kernel: RSP <ffff81022550de10>
Mar 26 02:42:09 vpsa kernel: ---[ end trace 7fb65a5bfb475762 ]---
Mar 26 02:43:13 vpsa kernel: BUG: soft lockup - CPU#0 stuck for 11s! [crond:18009]
Mar 26 02:43:13 vpsa kernel: CPU 0:
Mar 26 02:43:13 vpsa kernel: Modules linked in: vzethdev simfs vzrst vzcpt tun vzdquota xt_tcpudp xt_length ipt_ttl xt_tcpmss xt_TCPMSS iptable_mangle iptable_filter xt_multiport xt_limit ipt_tos ipt_REJECT ip_tables x_tables autofs4 fuse sunrpc vznetdev vzmon vzdev ipv6 cpufreq_ondemand powernow_k8 freq_table dm_mirror dm_multipath dm_mod snd_hda_intel snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_mixer_oss snd_pcm parport_pc snd_timer parport snd_page_alloc firewire_ohci k8temp firewire_core snd_hwdep serio_raw pcspkr hwmon crc_itu_t snd soundcore forcedeth pata_amd i2c_nforce2 i2c_core button sg usb_storage ahci pata_atiixp pata_acpi sata_nv ata_generic libata sd_mod scsi_mod ext3 jbd mbcache uhci_hcd ohci_hcd ehci_hcd
Mar 26 02:43:13 vpsa kernel: Pid: 18009, comm: crond Tainted: G D 2.6.24 #3 ovz008
Mar 26 02:43:13 vpsa kernel: RIP: 0010:[<ffffffff81118f95>] [<ffffffff81118f95>] _raw_spin_lock+0x81/0xf6
Mar 26 02:43:13 vpsa kernel: RSP: 0018:ffff810044415c48 EFLAGS: 00000246
Mar 26 02:43:13 vpsa kernel: RAX: 0000000000000000 RBX: 0000000010c8e945 RCX: 00000000823a18f3
Mar 26 02:43:13 vpsa kernel: RDX: 0000000000006f12 RSI: 0000000000000000 RDI: 0000000000000001
Mar 26 02:43:13 vpsa kernel: RBP: 0000000000000000 R08: 0000000000000002 R09: 0000000000000000
Mar 26 02:43:13 vpsa kernel: R10: ffffffff88020cce R11: ffffffff8109af2a R12: 000000009b4c0310
Mar 26 02:43:13 vpsa kernel: R13: ffff81007fb54000 R14: ffff810044414000 R15: 0000000000000001
Mar 26 02:43:13 vpsa kernel: FS: 00002abfe26bb390(0000) GS:ffffffff813cf000(0000) knlGS:0000000000000000
Mar 26 02:43:13 vpsa kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 26 02:43:13 vpsa kernel: CR2: 00002abfe16ff000 CR3: 00000001a1801000 CR4: 00000000000006a0
Mar 26 02:43:13 vpsa kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 26 02:43:13 vpsa kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 26 02:43:13 vpsa kernel:
Mar 26 02:43:13 vpsa kernel: Call Trace:
Mar 26 02:43:13 vpsa kernel: [<ffffffff81118fa2>] _raw_spin_lock+0x8e/0xf6
Mar 26 02:43:13 vpsa kernel: [<ffffffff88020cce>] :jbd:start_this_handle+0xd4/0x490
Mar 26 02:43:13 vpsa kernel: [<ffffffff88020cce>] :jbd:start_this_handle+0xd4/0x490
Mar 26 02:43:13 vpsa kernel: [<ffffffff88021141>] :jbd:journal_start+0xb7/0x108
Mar 26 02:43:13 vpsa kernel: [<ffffffff88036c7e>] :ext3:ext3_dirty_inode+0x28/0xb5
Mar 26 02:43:13 vpsa kernel: [<ffffffff810bfb72>] __mark_inode_dirty+0x29/0x177
Mar 26 02:43:13 vpsa kernel: [<ffffffff81078baa>] generic_file_aio_read+0x11f/0x162
Mar 26 02:43:13 vpsa kernel: [<ffffffff810a2920>] do_sync_read+0xc9/0x10c
Mar 26 02:43:13 vpsa kernel: [<ffffffff81048ca2>] autoremove_wake_function+0x0/0x2e
Mar 26 02:43:13 vpsa kernel: [<ffffffff8125f084>] _spin_lock_irqsave+0x35/0x3e
Mar 26 02:43:13 vpsa kernel: [<ffffffff810a30f0>] vfs_read+0xaa/0x152
Mar 26 02:43:13 vpsa kernel: [<ffffffff810a352a>] sys_read+0x49/0xc4
Mar 26 02:43:13 vpsa kernel: [<ffffffff8100c01e>] system_call+0x7e/0x83
Mar 26 02:43:13 vpsa kernel:
Mar 26 02:43:25 vpsa kernel: BUG: soft lockup - CPU#0 stuck for 11s! [crond:18009]
Mar 26 02:43:25 vpsa kernel: CPU 0:
Mar 26 02:43:25 vpsa kernel: Modules linked in: vzethdev simfs vzrst vzcpt tun vzdquota xt_tcpudp xt_length ipt_ttl xt_tcpmss xt_TCPMSS iptable_mangle iptable_filter xt_multiport xt_limit ipt_tos ipt_REJECT ip_tables x_tables autofs4 fuse sunrpc vznetdev vzmon vzdev ipv6 cpufreq_ondemand powernow_k8 freq_table dm_mirror dm_multipath dm_mod snd_hda_intel snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_mixer_oss snd_pcm parport_pc snd_timer parport snd_page_alloc firewire_ohci k8temp firewire_core snd_hwdep serio_raw pcspkr hwmon crc_itu_t snd soundcore forcedeth pata_amd i2c_nforce2 i2c_core button sg usb_storage ahci pata_atiixp pata_acpi sata_nv ata_generic libata sd_mod scsi_mod ext3 jbd mbcache uhci_hcd ohci_hcd ehci_hcd
Mar 26 02:43:25 vpsa kernel: Pid: 18009, comm: crond Tainted: G D 2.6.24 #3 ovz008
Mar 26 02:43:25 vpsa kernel: RIP: 0010:[<ffffffff81116057>] [<ffffffff81116057>] __delay+0x2/0x10
Mar 26 02:43:25 vpsa kernel: RSP: 0018:ffff810044415c40 EFLAGS: 00000206
Mar 26 02:43:25 vpsa kernel: RAX: 000000005ce8b076 RBX: 0000000021fc8839 RCX: 000000005ce8b044
Mar 26 02:43:25 vpsa kernel: RDX: 0000000000006f15 RSI: 0000000000000000 RDI: 0000000000000001
Mar 26 02:43:25 vpsa kernel: RBP: 0000000000000000 R08: 0000000000000002 R09: 0000000000000000
Mar 26 02:43:25 vpsa kernel: R10: ffffffff88020cce R11: ffffffff8109af2a R12: 000000009b4c0310
Mar 26 02:43:25 vpsa kernel: R13: ffff81007fb54000 R14: ffff810044414000 R15: 0000000000000001
Mar 26 02:43:25 vpsa kernel: FS: 00002abfe26bb390(0000) GS:ffffffff813cf000(0000) knlGS:0000000000000000
Mar 26 02:43:25 vpsa kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 26 02:43:25 vpsa kernel: CR2: 00002abfe16ff000 CR3: 00000001a1801000 CR4: 00000000000006a0
Mar 26 02:43:25 vpsa kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 26 02:43:25 vpsa kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 26 02:43:25 vpsa kernel:
Mar 26 02:43:25 vpsa kernel: Call Trace:
Mar 2 ...

[ Show the rest of the message ]

Junk Email Filter
http://www.junkemailfilter.com

Report message to a moderator

Re: File System Related Kernel Crash [message #35458 is a reply to message #35449]

Fri, 27 March 2009 08:38

maratrus
Messages: 1495
Registered: August 2007
Location: Moscow

Senior Member

Hello Marc,

have you tried to file a bug into bugzilla?

Report message to a moderator

Re: File System Related Kernel Crash [message #35473 is a reply to message #35449]

Fri, 27 March 2009 13:10

mperkel
Messages: 253
Registered: December 2006

Senior Member

I will if someone says that this is useful. I'm not sure if I have the right debug settings set. It's sort of a bug preview.

Junk Email Filter
http://www.junkemailfilter.com

Report message to a moderator

Re: File System Related Kernel Crash [message #35497 is a reply to message #35473]

Tue, 31 March 2009 10:09

maratrus
Messages: 1495
Registered: August 2007
Location: Moscow

Senior Member

In my opinion this should go to bugzilla.
Moreover,
http://forum.openvz.org/index.php?t=msg&th=415&start =0&

Quote:

If you are not sure if this is a bug report or just your misconfiguration - file a bug report first, then ask for support here citing all the details and giving the link to bugzilla bug.

Report message to a moderator

Previous Topic:	which ve's start on machine boot
Next Topic:	Anyone here has a root server at Hetzner.de? Which kernel do you use?

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Jul 17 13:29:13 GMT 2024

Total time taken to generate the page: 0.03715 seconds