PROBLEM alert - Host fas03 is DOWN

Stephen John Smoogen smooge at gmail.com
Sat Sep 11 01:24:16 UTC 2010


On Fri, Sep 10, 2010 at 19:11, Stephen John Smoogen <smooge at gmail.com> wrote:
> The fas servers seem to be going into a repeatable OOPS. At present
> all I can see doing is
>
> /usr/sbin/xm destroy fasXX
> /usr/sbin/xm create fasXX
>
> on their master server.
>

For those interested... the oops is usually

Sep 11 01:10:23 fas03 kernel: ------------[ cut here ]------------
Sep 11 01:10:23 fas03 kernel: WARNING: at block/blk-core.c:338
blk_start_queue+0x6c/0x70() (Not tainted)
Sep 11 01:10:23 fas03 kernel: Modules linked in: xen_blkfront dm_mod
[last unloaded: scsi_wait_scan]
Sep 11 01:10:23 fas03 kernel: Pid: 0, comm: swapper Not tainted
2.6.32-44.2.el6.i686 #1
Sep 11 01:10:23 fas03 kernel: Call Trace:
Sep 11 01:10:23 fas03 kernel: [<c044fc97>] ? warn_slowpath_common+0x77/0xb0
Sep 11 01:10:23 fas03 kernel: [<c05ca5dc>] ? blk_start_queue+0x6c/0x70
Sep 11 01:10:23 fas03 kernel: [<c044fce3>] ? warn_slowpath_null+0x13/0x20
Sep 11 01:10:23 fas03 kernel: [<c05ca5dc>] ? blk_start_queue+0x6c/0x70
Sep 11 01:10:23 fas03 kernel: [<ed63896b>] ?
kick_pending_request_queues+0x1b/0x30 [xen_blkfront]
Sep 11 01:10:23 fas03 kernel: [<ed638b80>] ?
blkif_interrupt+0x200/0x220 [xen_blkfront]
Sep 11 01:10:23 fas03 kernel: [<c04ad7c5>] ? handle_IRQ_event+0x45/0x140
Sep 11 01:10:23 fas03 kernel: [<c042f4b9>] ?
pvclock_clocksource_read+0x169/0x190
Sep 11 01:10:23 fas03 kernel: [<c04b0b81>] ? move_native_irq+0x11/0x50
Sep 11 01:10:23 fas03 kernel: [<c04afe13>] ? handle_level_irq+0x63/0xe0
Sep 11 01:10:23 fas03 kernel: [<c040c042>] ? handle_irq+0x32/0x60
Sep 11 01:10:23 fas03 kernel: [<c066141c>] ? __xen_evtchn_do_upcall+0x12c/0x150
Sep 11 01:10:23 fas03 kernel: [<c0661475>] ? xen_evtchn_do_upcall+0x25/0x40
Sep 11 01:10:23 fas03 kernel: [<c040a57f>] ? xen_do_upcall+0x7/0xc
Sep 11 01:10:23 fas03 kernel: [<c04023a7>] ? hypercall_page+0x3a7/0x1010
Sep 11 01:10:23 fas03 kernel: [<c0406b4f>] ? xen_safe_halt+0xf/0x20
Sep 11 01:10:23 fas03 kernel: [<c040470c>] ? xen_idle+0x1c/0x30
Sep 11 01:10:23 fas03 kernel: [<c0408764>] ? cpu_idle+0x94/0xd0
Sep 11 01:10:23 fas03 kernel: [<c0a5496e>] ? start_kernel+0x38d/0x392
Sep 11 01:10:23 fas03 kernel: [<c0a5441f>] ? unknown_bootoption+0x0/0x190
Sep 11 01:10:23 fas03 kernel: [<c0a57ca4>] ? xen_start_kernel+0x54e/0x554
Sep 11 01:10:23 fas03 kernel: [<c04090ad>] ? do_signal+0x39d/0xa50
Sep 11 01:10:23 fas03 kernel: ---[ end trace ef051dddccbf0b4f ]---
Sep 11 01:10:23 fas03 kernel: ------------[ cut here ]------------







-- 
Stephen J Smoogen.
“The core skill of innovators is error recovery, not failure avoidance.”
Randy Nelson, President of Pixar University.
"We have a strategic plan. It's called doing things.""
— Herb Kelleher, founder Southwest Airlines


More information about the infrastructure mailing list