PDA

View Full Version : Kernel Panic - CPU Caused It?



Cody
28th May 2006, 10:55 PM
I've been having kernel panics on my server every 1-3 days lately. I have posted the /var/log/messages. Anyone with any insight would be greatly appreciated!

It would be useful to note this is a Dual-Processor PowerPC 450MHz Powermac.

Cody


May 27 23:03:24 thor kernel: BUG: spinlock recursion on CPU#0, hald-addon-stor/20461 (Not tainted)
May 27 23:03:24 thor kernel: lock: c03a0020, .magic: dead4ead, .owner: hald-addon-stor/20461, .owner_cpu: 0
May 27 23:03:24 thor kernel: Call Trace:
May 27 23:03:24 thor kernel: [D0043B50] [C0007B1C] show_stack+0x54/0x184 (unreliable)
May 27 23:03:24 thor kernel: [D0043B70] [C0130308] spin_bug+0xc4/0x144
May 27 23:03:24 thor kernel: [D0043BA0] [C01305B0] _raw_spin_lock+0x50/0x178
May 27 23:03:24 thor kernel: [D0043BC0] [C02C9DD0] _spin_lock+0x10/0x20
May 27 23:03:24 thor kernel: [D0043BD0] [C001250C] smp_call_function+0x54/0x238
May 27 23:03:24 thor kernel: [D0043C00] [C0027D90] tau_timeout_smp+0x40/0x58
May 27 23:03:24 thor kernel: [D0043C10] [C0041EC4] run_timer_softirq+0x174/0x1fc
May 27 23:03:24 thor kernel: [D0043C40] [C003BD50] __do_softirq+0x8c/0x158
May 27 23:03:24 thor kernel: [D0043C60] [C003BE74] do_softirq+0x58/0x70
May 27 23:03:24 thor kernel: [D0043C70] [C000CAF0] timer_interrupt+0x57c/0x590
May 27 23:03:24 thor kernel: [D0043CE0] [C001048C] ret_from_except+0x0/0x14
May 27 23:03:24 thor kernel: --- Exception: 901 at smp_call_function+0x6c/0x238
May 27 23:03:24 thor kernel: LR = smp_call_function+0x64/0x238
May 27 23:03:24 thor kernel: [D0043DA0] [C001250C] smp_call_function+0x54/0x238 (unreliable)
May 27 23:03:24 thor kernel: [D0043DD0] [C008D970] invalidate_bdev+0x2c/0x54
May 27 23:03:24 thor kernel: [D0043DF0] [C00AB6B8] __invalidate_device+0x48/0x60
May 27 23:03:24 thor kernel: [D0043E10] [C009547C] check_disk_change+0x48/0xac
May 27 23:03:24 thor kernel: [D0043E20] [E1037D84] sd_open+0xa8/0x168 [sd_mod]
May 27 23:03:24 thor kernel: [D0043E40] [C0095984] do_open+0xdc/0x4e8
May 27 23:03:24 thor kernel: [D0043E80] [C0095FF0] blkdev_open+0x38/0x80
May 27 23:03:24 thor kernel: [D0043EA0] [C008877C] __dentry_open+0x110/0x258
May 27 23:03:24 thor kernel: [D0043EC0] [C00889F8] do_filp_open+0x44/0x60
May 27 23:03:24 thor kernel: [D0043F20] [C0088A6C] do_sys_open+0x58/0xec
May 27 23:03:25 thor kernel: [D0043F40] [C000FDE0] ret_from_syscall+0x0/0x38
May 27 23:03:25 thor kernel: --- Exception: c01 at 0xff19a34
May 27 23:03:25 thor kernel: LR = 0xff199dc
May 27 23:03:25 thor kernel: Kernel panic - not syncing: bad locking
May 27 23:03:25 thor kernel: Call Trace:
May 27 23:03:25 thor kernel: [D0043B00] [C0007B1C] show_stack+0x54/0x184 (unreliable)
May 27 23:03:25 thor kernel: [D0043B20] [C0035144] panic+0x88/0x1d0
May 27 23:03:25 thor kernel: [D0043B70] [C0130334] spin_bug+0xf0/0x144
May 27 23:03:25 thor kernel: [D0043BA0] [C01305B0] _raw_spin_lock+0x50/0x178
May 27 23:03:25 thor kernel: [D0043BC0] [C02C9DD0] _spin_lock+0x10/0x20
May 27 23:03:25 thor kernel: [D0043BD0] [C001250C] smp_call_function+0x54/0x238
May 27 23:03:25 thor kernel: [D0043C00] [C0027D90] tau_timeout_smp+0x40/0x58
May 27 23:03:25 thor kernel: [D0043C10] [C0041EC4] run_timer_softirq+0x174/0x1fc
May 27 23:03:25 thor kernel: [D0043C40] [C003BD50] __do_softirq+0x8c/0x158
May 27 23:03:25 thor kernel: [D0043C60] [C003BE74] do_softirq+0x58/0x70
May 27 23:03:25 thor kernel: [D0043C70] [C000CAF0] timer_interrupt+0x57c/0x590
May 27 23:03:25 thor kernel: [D0043CE0] [C001048C] ret_from_except+0x0/0x14
May 27 23:03:25 thor kernel: --- Exception: 901 at smp_call_function+0x6c/0x238
May 27 23:03:25 thor kernel: LR = smp_call_function+0x64/0x238
May 27 23:03:25 thor kernel: [D0043DA0] [C001250C] smp_call_function+0x54/0x238 (unreliable)
May 27 23:03:25 thor kernel: [D0043DD0] [C008D970] invalidate_bdev+0x2c/0x54
May 27 23:03:25 thor kernel: [D0043DF0] [C00AB6B8] __invalidate_device+0x48/0x60
May 27 23:03:25 thor kernel: [D0043E10] [C009547C] check_disk_change+0x48/0xac
May 27 23:03:25 thor kernel: [D0043E20] [E1037D84] sd_open+0xa8/0x168 [sd_mod]
May 27 23:03:25 thor kernel: [D0043E40] [C0095984] do_open+0xdc/0x4e8
May 27 23:03:25 thor kernel: [D0043E80] [C0095FF0] blkdev_open+0x38/0x80
May 27 23:03:25 thor kernel: [D0043EA0] [C008877C] __dentry_open+0x110/0x258
May 27 23:03:25 thor kernel: [D0043EC0] [C00889F8] do_filp_open+0x44/0x60
May 27 23:03:25 thor kernel: [D0043F20] [C0088A6C] do_sys_open+0x58/0xec
May 27 23:03:25 thor kernel: [D0043F40] [C000FDE0] ret_from_syscall+0x0/0x38
May 27 23:03:25 thor kernel: --- Exception: c01 at 0xff19a34
May 27 23:03:25 thor kernel: LR = 0xff199dc
May 27 23:03:26 thor kernel: <0>BUG: spinlock lockup on CPU#0, hald-addon-stor/20461, c03a0020 (Not tainted)
May 27 23:03:26 thor kernel: Call Trace:
May 27 23:03:26 thor kernel: [D0043AA0] [C0007B1C] show_stack+0x54/0x184 (unreliable)
May 27 23:03:26 thor kernel: [D0043AC0] [C013069C] _raw_spin_lock+0x13c/0x178
May 27 23:03:26 thor kernel: [D0043AE0] [C02C9DD0] _spin_lock+0x10/0x20
May 27 23:03:26 thor kernel: [D0043AF0] [C001250C] smp_call_function+0x54/0x238
May 27 23:03:26 thor kernel: [D0043B20] [C0035150] panic+0x94/0x1d0
May 27 23:03:26 thor kernel: [D0043B70] [C0130334] spin_bug+0xf0/0x144
May 27 23:03:26 thor kernel: [D0043BA0] [C01305B0] _raw_spin_lock+0x50/0x178
May 27 23:03:26 thor kernel: [D0043BC0] [C02C9DD0] _spin_lock+0x10/0x20
May 27 23:03:26 thor kernel: [D0043BD0] [C001250C] smp_call_function+0x54/0x238
May 27 23:03:26 thor kernel: [D0043C00] [C0027D90] tau_timeout_smp+0x40/0x58
May 27 23:03:26 thor kernel: [D0043C10] [C0041EC4] run_timer_softirq+0x174/0x1fc
May 27 23:03:26 thor kernel: [D0043C40] [C003BD50] __do_softirq+0x8c/0x158
May 27 23:03:26 thor kernel: [D0043C60] [C003BE74] do_softirq+0x58/0x70
May 27 23:03:26 thor kernel: [D0043C70] [C000CAF0] timer_interrupt+0x57c/0x590
May 27 23:03:26 thor kernel: [D0043CE0] [C001048C] ret_from_except+0x0/0x14
May 27 23:03:26 thor kernel: --- Exception: 901 at smp_call_function+0x6c/0x238
May 27 23:03:26 thor kernel: LR = smp_call_function+0x64/0x238
May 27 23:03:26 thor kernel: [D0043DA0] [C001250C] smp_call_function+0x54/0x238 (unreliable)
May 27 23:03:26 thor kernel: [D0043DD0] [C008D970] invalidate_bdev+0x2c/0x54
May 27 23:03:26 thor kernel: [D0043DF0] [C00AB6B8] __invalidate_device+0x48/0x60
May 27 23:03:26 thor kernel: [D0043E10] [C009547C] check_disk_change+0x48/0xac
May 27 23:03:26 thor kernel: [D0043E20] [E1037D84] sd_open+0xa8/0x168 [sd_mod]
May 27 23:03:26 thor kernel: [D0043E40] [C0095984] do_open+0xdc/0x4e8
May 27 23:03:26 thor kernel: [D0043E80] [C0095FF0] blkdev_open+0x38/0x80
May 27 23:03:26 thor kernel: [D0043EA0] [C008877C] __dentry_open+0x110/0x258
May 27 23:03:26 thor kernel: [D0043EC0] [C00889F8] do_filp_open+0x44/0x60
May 27 23:03:26 thor kernel: [D0043F20] [C0088A6C] do_sys_open+0x58/0xec
May 27 23:03:26 thor kernel: [D0043F40] [C000FDE0] ret_from_syscall+0x0/0x38

Cody
28th May 2006, 11:01 PM
May 27 23:03:26 thor kernel: --- Exception: c01 at 0xff19a34
May 27 23:03:26 thor kernel: LR = 0xff199dc
May 27 23:03:35 thor kernel: BUG: soft lockup detected on CPU#0!
May 27 23:03:35 thor kernel: NIP: C0130634 LR: C013069C CTR: 00000000
May 27 23:03:35 thor kernel: REGS: d0043a10 TRAP: 0901 Not tainted (2.6.16-1.2111_FC5smp)
May 27 23:03:35 thor kernel: MSR: 00009032 <EE,ME,IR,DR> CR: 4414C024 XER: 00000000
May 27 23:03:35 thor kernel: TASK = d020a0d0[20461] 'hald-addon-stor' THREAD: d0042000 CPU: 0
May 27 23:03:35 thor kernel: GPR00: 00000001 D0043AC0 D020A0D0 00000000 D020A0D0 00000010 C03A0000 00000000
May 27 23:03:35 thor kernel: GPR08: 00000001 00000000 017AE800 00000000 00985AB4
May 27 23:03:35 thor kernel: NIP [C0130634] _raw_spin_lock+0xd4/0x178
May 27 23:03:35 thor kernel: LR [C013069C] _raw_spin_lock+0x13c/0x178
May 27 23:03:35 thor kernel: Call Trace:
May 27 23:03:35 thor kernel: [D0043AC0] [C013069C] _raw_spin_lock+0x13c/0x178 (unreliable)
May 27 23:03:35 thor kernel: [D0043AE0] [C02C9DD0] _spin_lock+0x10/0x20
May 27 23:03:35 thor kernel: [D0043AF0] [C001250C] smp_call_function+0x54/0x238
May 27 23:03:35 thor kernel: [D0043B20] [C0035150] panic+0x94/0x1d0
May 27 23:03:35 thor kernel: [D0043B70] [C0130334] spin_bug+0xf0/0x144
May 27 23:03:35 thor kernel: [D0043BA0] [C01305B0] _raw_spin_lock+0x50/0x178
May 27 23:03:35 thor kernel: [D0043BC0] [C02C9DD0] _spin_lock+0x10/0x20
May 27 23:03:35 thor kernel: [D0043BD0] [C001250C] smp_call_function+0x54/0x238
May 27 23:03:35 thor kernel: [D0043C00] [C0027D90] tau_timeout_smp+0x40/0x58
May 27 23:03:35 thor kernel: [D0043C10] [C0041EC4] run_timer_softirq+0x174/0x1fc
May 27 23:03:35 thor kernel: [D0043C40] [C003BD50] __do_softirq+0x8c/0x158
May 27 23:03:35 thor kernel: [D0043C60] [C003BE74] do_softirq+0x58/0x70
May 27 23:03:35 thor kernel: [D0043C70] [C000CAF0] timer_interrupt+0x57c/0x590
May 27 23:03:35 thor kernel: [D0043CE0] [C001048C] ret_from_except+0x0/0x14
May 27 23:03:35 thor kernel: --- Exception: 901 at smp_call_function+0x6c/0x238
May 27 23:03:35 thor kernel: LR = smp_call_function+0x64/0x238
May 27 23:03:35 thor kernel: [D0043DA0] [C001250C] smp_call_function+0x54/0x238 (unreliable)
May 27 23:03:35 thor kernel: [D0043DD0] [C008D970] invalidate_bdev+0x2c/0x54
May 27 23:03:35 thor kernel: [D0043DF0] [C00AB6B8] __invalidate_device+0x48/0x60
May 27 23:03:35 thor kernel: [D0043E10] [C009547C] check_disk_change+0x48/0xac
May 27 23:03:35 thor kernel: [D0043E20] [E1037D84] sd_open+0xa8/0x168 [sd_mod]
May 27 23:03:35 thor kernel: [D0043E40] [C0095984] do_open+0xdc/0x4e8
May 27 23:03:35 thor kernel: [D0043E80] [C0095FF0] blkdev_open+0x38/0x80
May 27 23:03:35 thor kernel: [D0043EA0] [C008877C] __dentry_open+0x110/0x258
May 27 23:03:35 thor kernel: [D0043EC0] [C00889F8] do_filp_open+0x44/0x60
May 27 23:03:35 thor kernel: [D0043F20] [C0088A6C] do_sys_open+0x58/0xec
May 27 23:03:35 thor kernel: [D0043F40] [C000FDE0] ret_from_syscall+0x0/0x38
May 27 23:03:35 thor kernel: --- Exception: c01 at 0xff19a34
May 27 23:03:35 thor kernel: LR = 0xff199dc
May 27 23:03:35 thor kernel: Instruction dump:
May 27 23:03:35 thor kernel: Debug: sleeping function called from invalid context at arch/powerpc/kernel/process.c:363
May 27 23:03:35 thor kernel: in_atomic():1, irqs_disabled():1
May 27 23:03:35 thor kernel: Call Trace:
May 27 23:03:35 thor kernel: [D0043900] [C0007B1C] show_stack+0x54/0x184 (unreliable)
May 27 23:03:35 thor kernel: [D0043920] [C002DA70] __might_sleep+0xbc/0xd0
May 27 23:03:35 thor kernel: [D0043930] [C0008514] show_regs+0x240/0x2bc
May 27 23:03:35 thor kernel: [D0043950] [C0061B24] softlockup_tick+0xa0/0xbc
May 27 23:03:35 thor kernel: [D0043970] [C0041710] do_timer+0x428/0x43c
May 27 23:03:35 thor kernel: [D0043990] [C000C6B8] timer_interrupt+0x144/0x590
May 27 23:03:35 thor kernel: [D0043A00] [C001048C] ret_from_except+0x0/0x14
May 27 23:03:35 thor kernel: --- Exception: 901 at _raw_spin_lock+0xd4/0x178
May 27 23:03:35 thor kernel: LR = _raw_spin_lock+0x13c/0x178
May 27 23:03:35 thor kernel: [D0043AE0] [C02C9DD0] _spin_lock+0x10/0x20
May 27 23:03:35 thor kernel: [D0043AF0] [C001250C] smp_call_function+0x54/0x238
May 27 23:03:35 thor kernel: [D0043B20] [C0035150] panic+0x94/0x1d0
May 27 23:03:35 thor kernel: [D0043B70] [C0130334] spin_bug+0xf0/0x144
May 27 23:03:35 thor kernel: [D0043BA0] [C01305B0] _raw_spin_lock+0x50/0x178
May 27 23:03:35 thor kernel: [D0043BC0] [C02C9DD0] _spin_lock+0x10/0x20
May 27 23:03:35 thor kernel: [D0043BD0] [C001250C] smp_call_function+0x54/0x238
May 27 23:03:35 thor kernel: [D0043C00] [C0027D90] tau_timeout_smp+0x40/0x58
May 27 23:03:35 thor kernel: [D0043C10] [C0041EC4] run_timer_softirq+0x174/0x1fc
May 27 23:03:35 thor kernel: [D0043C40] [C003BD50] __do_softirq+0x8c/0x158
May 27 23:03:35 thor kernel: [D0043C60] [C003BE74] do_softirq+0x58/0x70
May 27 23:03:35 thor kernel: [D0043C70] [C000CAF0] timer_interrupt+0x57c/0x590
May 27 23:03:35 thor kernel: [D0043CE0] [C001048C] ret_from_except+0x0/0x14
May 27 23:03:35 thor kernel: --- Exception: 901 at smp_call_function+0x6c/0x238
May 27 23:03:35 thor kernel: LR = smp_call_function+0x64/0x238
May 27 23:03:35 thor kernel: [D0043DA0] [C001250C] smp_call_function+0x54/0x238 (unreliable)
May 27 23:03:35 thor kernel: [D0043DD0] [C008D970] invalidate_bdev+0x2c/0x54
May 27 23:03:35 thor kernel: [D0043DF0] [C00AB6B8] __invalidate_device+0x48/0x60
May 27 23:03:35 thor kernel: [D0043E10] [C009547C] check_disk_change+0x48/0xac
May 27 23:03:35 thor kernel: [D0043E20] [E1037D84] sd_open+0xa8/0x168 [sd_mod]
May 27 23:03:35 thor kernel: [D0043E40] [C0095984] do_open+0xdc/0x4e8
May 27 23:03:35 thor kernel: [D0043E80] [C0095FF0] blkdev_open+0x38/0x80
May 27 23:03:35 thor kernel: [D0043EA0] [C008877C] __dentry_open+0x110/0x258
May 27 23:03:35 thor kernel: [D0043EC0] [C00889F8] do_filp_open+0x44/0x60
May 27 23:03:35 thor kernel: [D0043F20] [C0088A6C] do_sys_open+0x58/0xec
May 27 23:03:35 thor kernel: [D0043F40] [C000FDE0] ret_from_syscall+0x0/0x38
May 27 23:03:35 thor kernel: --- Exception: c01 at 0xff19a34
May 27 23:03:35 thor kernel: LR = 0xff199dc
May 27 23:03:35 thor kernel: 3cc0c03a 39000001 4800002c 7c00f828 2c000000 40820010 7d00f92d 40a2fff0
May 27 23:03:35 thor kernel: 4c00012c 2f800000 419e0078 318c0001 <7d6b0194> 8126b920 1d2900fa 7d2a4b78

Cody
29th May 2006, 03:18 AM
Bump it up