BUG: soft lockup - CPU#0 stuck for 29s! [X:811] (70 lines?)

[Frank Murphy]

Can someone point me to the correct kernel component for bz.
Abrt added me to: https://bugzilla.redhat.com/show_bug.cgi?id=713687

But that seems to be completly different.
Snipped from /var/log/messages:

Feb 23 12:14:03 test07 kernel: [ 6068.185344] BUG: soft lockup - CPU#0 
stuck for 29s! [X:811]
Feb 23 12:14:03 test07 kernel: [ 6068.186283] Modules linked in: nfs 
nfs_acl auth_rpcgss fscache lockd sunrpc nf_conntrack_ipv4 
nf_defrag_ipv4 xt_state nf_conntrack microcode virtio_net virtio_balloon 
i6300esb virtio_blk [last unloaded: scsi_wait_scan]
Feb 23 12:14:03 test07 kernel: [ 6068.186283] Modules linked in: nfs 
nfs_acl auth_rpcgss fscache lockd sunrpc nf_conntrack_ipv4 
nf_defrag_ipv4 xt_state nf_conntrack microcode virtio_net virtio_balloon 
i6300esb virtio_blk [last unloaded: scsi_wait_scan]
Feb 23 12:14:03 test07 kernel: [ 6068.186283]
Feb 23 12:14:03 test07 kernel: [ 6068.186283] Pid: 811, comm: X Not 
tainted 3.3.0-0.rc4.git0.1.fc18.i686 #1 Bochs Bochs
Feb 23 12:14:03 test07 kernel: [ 6068.186283] EIP: 0060:[<c043d885>] 
EFLAGS: 00203206 CPU: 0
Feb 23 12:14:03 test07 kernel: [ 6068.186283] EIP is at 
__do_softirq+0x55/0x190
Feb 23 12:14:03 test07 kernel: [ 6068.186283] EAX: 00000000 EBX: 
00000008 ECX: 00000000 EDX: 00000000
Feb 23 12:14:03 test07 kernel: [ 6068.186283] ESI: f6722000 EDI: 
c043d830 EBP: f440bff8 ESP: f440bfc4
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  DS: 007b ES: 007b FS: 
00d8 GS: 00e0 SS: 0068
Feb 23 12:14:03 test07 kernel: [ 6068.186283] Process X (pid: 811, 
ti=f440a000 task=f35bcb60 task.ti=f6722000)
Feb 23 12:14:03 test07 kernel: [ 6068.186283] Stack:
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  00000000 00000000 
00000000 00000000 00000000 00000000 00000000 0000000a
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  00000100 00000008 
f6723f68 f6722000 c043d830 f6723f78 c0405346
Feb 23 12:14:03 test07 kernel: [ 6068.186283] Call Trace:
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c043d830>] ? 
remote_softirq_receive+0x40/0x40
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  <IRQ>
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c043dc0d>] ? 
irq_exit+0x9d/0xb0
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c0404fbb>] ? 
do_IRQ+0x4b/0xc0
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c043dbd7>] ? 
irq_exit+0x67/0xb0
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c041f77e>] ? 
smp_apic_timer_interrupt+0x5e/0x90
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c092d8f0>] ? 
common_interrupt+0x30/0x38
Feb 23 12:14:03 test07 kernel: [ 6068.186283] Code: 00 01 00 00 64 a1 ec 
36 c4 c0 89 5d f0 89 45 e4 c7 45 e8 0a 00 00 00 8d b4 26 00 00 00 00 64 
c7 05 c0 7f c4 c0 00 00 00 00 fb 90 <8d> 74 26 00 bf 00 fa b3 c0 eb 08 
83 c7 04 d1 6d f0 74 57 f6 45
Feb 23 12:14:03 test07 kernel: [ 6068.186283] Call Trace:
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c043d830>] ? 
remote_softirq_receive+0x40/0x40
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  <IRQ>  [<c043dc0d>] ? 
irq_exit+0x9d/0xb0
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c0404fbb>] ? 
do_IRQ+0x4b/0xc0
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c043dbd7>] ? 
irq_exit+0x67/0xb0
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c041f77e>] ? 
smp_apic_timer_interrupt+0x5e/0x90
Feb 23 12:14:03 test07 kernel: [ 6068.186283]  [<c092d8f0>] ? 
common_interrupt+0x30/0x38
Feb 23 12:14:04 test07 abrt-dump-oops[318]: abrt-dump-oops: Found oopses: 1
Feb 23 12:14:05 test07 abrt-dump-oops[318]: abrt-dump-oops: Can't open 
'/etc/abrt/abrt.conf'
Feb 23 12:14:05 test07 abrt-dump-oops[318]: abrt-dump-oops: Creating 
dump directories
Feb 23 12:14:05 test07 abrtd: Directory 'oops-2012-02-23-12:14:04-318-0' 
creation detected
Feb 23 12:14:05 test07 abrt-dump-oops: Reported 1 kernel oopses to Abrt
Feb 23 12:14:05 test07 abrtd: Can't open file 
'/var/spool/abrt/oops-2012-02-23-12:14:04-318-0/uid': No such file or 
directory
Feb 23 12:14:07 test07 abrtd: New problem directory 
/var/spool/abrt/oops-2012-02-23-12:14:04-318-0, processing
Feb 23 12:14:07 test07 abrtd: Can't open file 
'/var/spool/abrt/oops-2012-02-23-12:14:04-318-0/uid': No such file or 
directory
Feb 23 12:23:15 test07 kernel: [ 6619.931865] BUG: soft lockup - CPU#0 
stuck for 28s! [X:811]




-- 
Regards,
Frank
"Jack of all, fubars"

[Josh Boyer]

On Thu, Feb 23, 2012 at 01:03:07PM +0000, Frank Murphy wrote:
>  Can someone point me to the correct kernel component for bz.
>  Abrt added me to: https://bugzilla.redhat.com/show_bug.cgi?id=713687
>  
>  But that seems to be completly different. 
There was a request to have abrt ignore any part of the stack trace that
started with '?' because those are guestimations by the kernel.  Before
abrt started ignoring those, it would take almost identical stack traces
and hash them differently, which was leading to a lot of duplicates.

My guess here is that because _all_ of your stack entries start with
'?', abrt didn't work quite as expected.

As for the problem itself, soft lockups inside of virtual guests seem to
be somewhat of a norm these days.  There is work on-going to get the
host and the KVM guest talk to each other in this regard.  See bug

https://bugzilla.redhat.com/show_bug.cgi?id=794478

josh

[Frank Murphy]

On 23/02/12 13:51, Josh Boyer wrote:

>  https://bugzilla.redhat.com/show_bug.cgi?id=794478
>
>  josh 
Thanks Josh.

-- 
Regards,
Frank
"Jack of all, fubars"