Kernel crash on FC16

[Roi Dayan]

Hi,

After discovery I select a LUN and give it a name, I click OK and I get a
kernel crash.
The kernel version is 3.1.0-7
I pasted the log below.
Any idea?

Thanks,
Roi


Mar  6 18:00:55 xena018 kernel: [  339.762969] ------------[ cut here
]------------

Mar  6 18:00:55 xena018 kernel: [  339.763233] kernel BUG at
block/blk-flush.c:323!

Mar  6 18:00:55 xena018 kernel: [  339.763496] invalid opcode: 0000 [#1] SMP

Mar  6 18:00:55 xena018 kernel: [  339.763839] CPU 6

Mar  6 18:00:55 xena018 kernel: [  339.763885] Modules linked in:
ebtable_nat ebtables 8021q garp bonding lockd bridge stp llc be2iscsi
iscsi_boot_sysfs bnx2i cnic uio cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio
iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ib_ipoib rdma_ucm
xt_multiport ib_ucm ib_uverbs ib_umad rdma_cm ib_cm ip6t_REJECT iw_cm
nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ib_addr nf_conntrack
ip6table_filter ib_sa ip6_tables dm_round_robin dm_multipath mlx4_ib ib_mad
ib_core sunrpc vhost_net igb i7core_edac edac_core i2c_i801 ioatdma macvtap
macvlan tun virtio_net iTCO_wdt i2c_core kvm_intel iTCO_vendor_support dca
kvm joydev mlx4_core serio_raw microcode uinput [last unloaded: ib_iser]

Mar  6 18:00:55 xena018 kernel: [  339.769133]

Mar  6 18:00:55 xena018 kernel: [  339.769387] Pid: 3217, comm: mkfs.ext2
Not tainted 3.1.0-7.fc16.x86_64 #1 Supermicro X8DTU/X8DTU

Mar  6 18:00:55 xena018 kernel: [  339.770000] RIP:
0010:[<ffffffff8120e16f>]  [<ffffffff8120e16f>] blk_insert_flush+0x84/0x101

Mar  6 18:00:55 xena018 kernel: [  339.770529] RSP: 0018:ffff880629ab3c28
EFLAGS: 00010046

Mar  6 18:00:55 xena018 kernel: [  339.770785] RAX: 0000000000000000 RBX:
ffff880319410e30 RCX: 0000000008018215

Mar  6 18:00:55 xena018 kernel: [  339.771050] RDX: 0000000000000000 RSI:
0000000000000001 RDI: ffff8806291cd008

Mar  6 18:00:55 xena018 kernel: [  339.771314] RBP: ffff880629ab3c38 R08:
ffff8806291cd008 R09: 0000000000000001

Mar  6 18:00:55 xena018 kernel: [  339.771571] R10: 0000000000000001 R11:
ffff880622982378 R12: ffff880319410e30

Mar  6 18:00:55 xena018 kernel: [  339.771827] R13: 0000000000000046 R14:
0000000000000005 R15: ffff88061f0c4c00

Mar  6 18:00:55 xena018 kernel: [  339.772085] FS:  00007fedacb44780(0000)
GS:ffff88063fc00000(0000) knlGS:0000000000000000

Mar  6 18:00:55 xena018 kernel: [  339.772542] CS:  0010 DS: 0000 ES: 0000
CR0: 0000000080050033

Mar  6 18:00:55 xena018 kernel: [  339.772794] CR2: 00000000017f4e70 CR3:
0000000628c25000 CR4: 00000000000006e0

Mar  6 18:00:55 xena018 kernel: [  339.773056] DR0: 0000000000000000 DR1:
0000000000000000 DR2: 0000000000000000

Mar  6 18:00:55 xena018 kernel: [  339.773316] DR3: 0000000000000000 DR6:
00000000ffff0ff0 DR7: 0000000000000400

Mar  6 18:00:55 xena018 kernel: [  339.773573] Process mkfs.ext2 (pid:
3217, threadinfo ffff880629ab2000, task ffff88062569dcc0)

Mar  6 18:00:55 xena018 kernel: [  339.774033] Stack:

Mar  6 18:00:55 xena018 kernel: [  339.774284]  ffff8806291cd008
ffff8806291cd008 ffff880629ab3c68 ffffffff812069f0

Mar  6 18:00:55 xena018 kernel: [  339.774909]  ffff8806291cd008
ffff880319410e30 0000000000000046 0000000000000005

Mar  6 18:00:55 xena018 kernel: [  339.775530]  ffff880629ab3c98
ffffffff8120b234 ffff8806291cd008 ffff880622982378

Mar  6 18:00:55 xena018 kernel: [  339.776153] Call Trace:

Mar  6 18:00:55 xena018 kernel: [  339.776405]  [<ffffffff812069f0>]
__elv_add_request+0x1a5/0x1df

Mar  6 18:00:55 xena018 kernel: [  339.776659]  [<ffffffff8120b234>]
blk_insert_cloned_request+0x67/0x89

Mar  6 18:00:55 xena018 kernel: [  339.776917]  [<ffffffff8138df81>]
dm_dispatch_request+0x3b/0x61

Mar  6 18:00:55 xena018 kernel: [  339.777172]  [<ffffffff8138f76a>]
dm_request_fn+0x151/0x1f4

Mar  6 18:00:55 xena018 kernel: [  339.777429]  [<ffffffff8120731d>]
__blk_run_queue+0x1b/0x1d

Mar  6 18:00:55 xena018 kernel: [  339.777685]  [<ffffffff8120cc25>]
__make_request+0x276/0x2a9

Mar  6 18:00:55 xena018 kernel: [  339.777944]  [<ffffffff8138ea4b>]
dm_request+0x30/0x172

Mar  6 18:00:55 xena018 kernel: [  339.778201]  [<ffffffff8120b5a1>]
generic_make_request+0x27d/0x312

Mar  6 18:00:55 xena018 kernel: [  339.778464]  [<ffffffff810e0425>] ?
mempool_alloc_slab+0x15/0x17

Mar  6 18:00:55 xena018 kernel: [  339.778723]  [<ffffffff8120b714>]
submit_bio+0xde/0xfd

Mar  6 18:00:55 xena018 kernel: [  339.778981]  [<ffffffff81150dfb>] ?
bio_alloc_bioset+0x4c/0xc3

Mar  6 18:00:55 xena018 kernel: [  339.779240]  [<ffffffff8120dd33>]
blkdev_issue_flush+0x8f/0xcf

Mar  6 18:00:55 xena018 kernel: [  339.779501]  [<ffffffff811522f1>]
blkdev_fsync+0x35/0x42

Mar  6 18:00:55 xena018 kernel: [  339.779759]  [<ffffffff8114b3d7>]
vfs_fsync_range+0x23/0x25

Mar  6 18:00:55 xena018 kernel: [  339.780012]  [<ffffffff8114b3f5>]
vfs_fsync+0x1c/0x1e

Mar  6 18:00:55 xena018 kernel: [  339.780260]  [<ffffffff8114b6b4>]
sys_fsync+0x29/0x3c

Mar  6 18:00:55 xena018 kernel: [  339.780512]  [<ffffffff814bc482>]
system_call_fastpath+0x16/0x1b

Mar  6 18:00:55 xena018 kernel: [  339.780761] Code: 80 e4 f3 41 89 40 40
85 f6 75 11 31 c9 31 d2 4c 89 c7 e8 df e2 ff ff e9 87 00 00 00 49 8b 40 60
48 85 c0 74 06 49 3b 40 68 74 02 <0f> 0b 83 fe 02 75 19 48 8b 73 08 4c 89
c7 48 89 da e8 40 15 02

Mar  6 18:00:55 xena018 kernel: [  339.784140] RIP  [<ffffffff8120e16f>]
blk_insert_flush+0x84/0x101

Mar  6 18:00:55 xena018 kernel: [  339.784450]  RSP <ffff880629ab3c28>

Mar  6 18:00:55 xena018 kernel: [  339.784737] ---[ end trace
91d8c37eac182b74 ]---


-- 

*Roi *

Is it reproducible?

----- Original Message -----
>  From: "Roi Dayan" <roi.dayan(a)gmail.com&gt;
>  To: vdsm-devel(a)lists.fedorahosted.org
>  Cc: "Or Gerlitz" <ogerlitz(a)mellanox.com&gt;, "Itzik Brown"
> <ItzikB(a)mellanox.com&gt;
>  Sent: Tuesday, March 6, 2012 11:09:15 AM
>  Subject: [vdsm] Kernel crash on FC16
>  
>  
>  
>  Hi,
>  
>  
>  After discovery I select a LUN and give it a name, I click OK and I
>  get a kernel crash.
>  The kernel version is 3.1.0-7
>  I pasted the log below.
>  Any idea?
>  
>  
>  Thanks,
>  Roi
>  
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.762969] ------------[ cut here
>  ]------------
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.763233] kernel BUG at
>  block/blk-flush.c:323!
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.763496] invalid opcode: 0000
>  [#1] SMP
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.763839] CPU 6
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.763885] Modules linked in:
>  ebtable_nat ebtables 8021q garp bonding lockd bridge stp llc
>  be2iscsi iscsi_boot_sysfs bnx2i cnic uio cxgb4i cxgb4 cxgb3i
>  libcxgbi cxgb3 mdio iscsi_tcp libiscsi_tcp libiscsi
>  scsi_transport_iscsi ib_ipoib rdma_ucm xt_multiport ib_ucm ib_uverbs
>  ib_umad rdma_cm ib_cm ip6t_REJECT iw_cm nf_conntrack_ipv6
>  nf_defrag_ipv6 xt_state ib_addr nf_conntrack ip6table_filter ib_sa
>  ip6_tables dm_round_robin dm_multipath mlx4_ib ib_mad ib_core sunrpc
>  vhost_net igb i7core_edac edac_core i2c_i801 ioatdma macvtap macvlan
>  tun virtio_net iTCO_wdt i2c_core kvm_intel iTCO_vendor_support dca
>  kvm joydev mlx4_core serio_raw microcode uinput [last unloaded:
>  ib_iser]
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.769133]
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.769387] Pid: 3217, comm:
>  mkfs.ext2 Not tainted 3.1.0-7.fc16.x86_64 #1 Supermicro X8DTU/X8DTU
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.770000] RIP:
>  0010:[<ffffffff8120e16f>] [<ffffffff8120e16f>]
>  blk_insert_flush+0x84/0x101
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.770529] RSP:
>  0018:ffff880629ab3c28 EFLAGS: 00010046
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.770785] RAX: 0000000000000000
>  RBX: ffff880319410e30 RCX: 0000000008018215
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.771050] RDX: 0000000000000000
>  RSI: 0000000000000001 RDI: ffff8806291cd008
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.771314] RBP: ffff880629ab3c38
>  R08: ffff8806291cd008 R09: 0000000000000001
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.771571] R10: 0000000000000001
>  R11: ffff880622982378 R12: ffff880319410e30
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.771827] R13: 0000000000000046
>  R14: 0000000000000005 R15: ffff88061f0c4c00
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.772085] FS:
>  00007fedacb44780(0000) GS:ffff88063fc00000(0000)
>  knlGS:0000000000000000
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.772542] CS: 0010 DS: 0000 ES:
>  0000 CR0: 0000000080050033
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.772794] CR2: 00000000017f4e70
>  CR3: 0000000628c25000 CR4: 00000000000006e0
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.773056] DR0: 0000000000000000
>  DR1: 0000000000000000 DR2: 0000000000000000
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.773316] DR3: 0000000000000000
>  DR6: 00000000ffff0ff0 DR7: 0000000000000400
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.773573] Process mkfs.ext2 (pid:
>  3217, threadinfo ffff880629ab2000, task ffff88062569dcc0)
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.774033] Stack:
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.774284] ffff8806291cd008
>  ffff8806291cd008 ffff880629ab3c68 ffffffff812069f0
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.774909] ffff8806291cd008
>  ffff880319410e30 0000000000000046 0000000000000005
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.775530] ffff880629ab3c98
>  ffffffff8120b234 ffff8806291cd008 ffff880622982378
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.776153] Call Trace:
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.776405] [<ffffffff812069f0>]
>  __elv_add_request+0x1a5/0x1df
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.776659] [<ffffffff8120b234>]
>  blk_insert_cloned_request+0x67/0x89
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.776917] [<ffffffff8138df81>]
>  dm_dispatch_request+0x3b/0x61
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.777172] [<ffffffff8138f76a>]
>  dm_request_fn+0x151/0x1f4
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.777429] [<ffffffff8120731d>]
>  __blk_run_queue+0x1b/0x1d
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.777685] [<ffffffff8120cc25>]
>  __make_request+0x276/0x2a9
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.777944] [<ffffffff8138ea4b>]
>  dm_request+0x30/0x172
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.778201] [<ffffffff8120b5a1>]
>  generic_make_request+0x27d/0x312
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.778464] [<ffffffff810e0425>] ?
>  mempool_alloc_slab+0x15/0x17
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.778723] [<ffffffff8120b714>]
>  submit_bio+0xde/0xfd
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.778981] [<ffffffff81150dfb>] ?
>  bio_alloc_bioset+0x4c/0xc3
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.779240] [<ffffffff8120dd33>]
>  blkdev_issue_flush+0x8f/0xcf
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.779501] [<ffffffff811522f1>]
>  blkdev_fsync+0x35/0x42
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.779759] [<ffffffff8114b3d7>]
>  vfs_fsync_range+0x23/0x25
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.780012] [<ffffffff8114b3f5>]
>  vfs_fsync+0x1c/0x1e
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.780260] [<ffffffff8114b6b4>]
>  sys_fsync+0x29/0x3c
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.780512] [<ffffffff814bc482>]
>  system_call_fastpath+0x16/0x1b
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.780761] Code: 80 e4 f3 41 89 40
>  40 85 f6 75 11 31 c9 31 d2 4c 89 c7 e8 df e2 ff ff e9 87 00 00 00 49
>  8b 40 60 48 85 c0 74 06 49 3b 40 68 74 02 <0f> 0b 83 fe 02 75 19 48
>  8b 73 08 4c 89 c7 48 89 da e8 40 15 02
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.784140] RIP [<ffffffff8120e16f>]
>  blk_insert_flush+0x84/0x101
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.784450] RSP <ffff880629ab3c28>
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.784737] ---[ end trace
>  91d8c37eac182b74 ]---
>  
>  
>  
>  --
>  
>  
>  
>  
>  Roi
>  
>  _______________________________________________
>  vdsm-devel mailing list
>  vdsm-devel(a)lists.fedorahosted.org
>  https://fedorahosted.org/mailman/listinfo/vdsm-devel
>

[Roi Dayan]

Yes happens all the time.
It's a normal iscsi target over 1GbE

Roi

On 6 במרץ 2012, at 23:14, Saggi Mizrahi <smizrahi(a)redhat.com&gt; wrote:

Is it reproducible?

----- Original Message -----

From: "Roi Dayan" <roi.dayan(a)gmail.com
>  
To: vdsm-devel(a)lists.fedorahosted.org

Cc: "Or Gerlitz" <ogerlitz(a)mellanox.com&gt;, "Itzik Brown"
<ItzikB(a)mellanox.com
>  
Sent: Tuesday, March 6, 2012 11:09:15 AM

Subject: [vdsm] Kernel crash on FC16




Hi,



After discovery I select a LUN and give it a name, I click OK and I

get a kernel crash.

The kernel version is 3.1.0-7

I pasted the log below.

Any idea?



Thanks,

Roi







Mar 6 18:00:55 xena018 kernel: [ 339.762969] ------------[ cut here

]------------


Mar 6 18:00:55 xena018 kernel: [ 339.763233] kernel BUG at

block/blk-flush.c:323!


Mar 6 18:00:55 xena018 kernel: [ 339.763496] invalid opcode: 0000

[#1] SMP


Mar 6 18:00:55 xena018 kernel: [ 339.763839] CPU 6


Mar 6 18:00:55 xena018 kernel: [ 339.763885] Modules linked in:

ebtable_nat ebtables 8021q garp bonding lockd bridge stp llc

be2iscsi iscsi_boot_sysfs bnx2i cnic uio cxgb4i cxgb4 cxgb3i

libcxgbi cxgb3 mdio iscsi_tcp libiscsi_tcp libiscsi

scsi_transport_iscsi ib_ipoib rdma_ucm xt_multiport ib_ucm ib_uverbs

ib_umad rdma_cm ib_cm ip6t_REJECT iw_cm nf_conntrack_ipv6

nf_defrag_ipv6 xt_state ib_addr nf_conntrack ip6table_filter ib_sa

ip6_tables dm_round_robin dm_multipath mlx4_ib ib_mad ib_core sunrpc

vhost_net igb i7core_edac edac_core i2c_i801 ioatdma macvtap macvlan

tun virtio_net iTCO_wdt i2c_core kvm_intel iTCO_vendor_support dca

kvm joydev mlx4_core serio_raw microcode uinput [last unloaded:

ib_iser]


Mar 6 18:00:55 xena018 kernel: [ 339.769133]


Mar 6 18:00:55 xena018 kernel: [ 339.769387] Pid: 3217, comm:

mkfs.ext2 Not tainted 3.1.0-7.fc16.x86_64 #1 Supermicro X8DTU/X8DTU


Mar 6 18:00:55 xena018 kernel: [ 339.770000] RIP:

0010:[<ffffffff8120e16f>] [<ffffffff8120e16f>]

blk_insert_flush+0x84/0x101


Mar 6 18:00:55 xena018 kernel: [ 339.770529] RSP:

0018:ffff880629ab3c28 EFLAGS: 00010046


Mar 6 18:00:55 xena018 kernel: [ 339.770785] RAX: 0000000000000000

RBX: ffff880319410e30 RCX: 0000000008018215


Mar 6 18:00:55 xena018 kernel: [ 339.771050] RDX: 0000000000000000

RSI: 0000000000000001 RDI: ffff8806291cd008


Mar 6 18:00:55 xena018 kernel: [ 339.771314] RBP: ffff880629ab3c38

R08: ffff8806291cd008 R09: 0000000000000001


Mar 6 18:00:55 xena018 kernel: [ 339.771571] R10: 0000000000000001

R11: ffff880622982378 R12: ffff880319410e30


Mar 6 18:00:55 xena018 kernel: [ 339.771827] R13: 0000000000000046

R14: 0000000000000005 R15: ffff88061f0c4c00


Mar 6 18:00:55 xena018 kernel: [ 339.772085] FS:

00007fedacb44780(0000) GS:ffff88063fc00000(0000)

knlGS:0000000000000000


Mar 6 18:00:55 xena018 kernel: [ 339.772542] CS: 0010 DS: 0000 ES:

0000 CR0: 0000000080050033


Mar 6 18:00:55 xena018 kernel: [ 339.772794] CR2: 00000000017f4e70

CR3: 0000000628c25000 CR4: 00000000000006e0


Mar 6 18:00:55 xena018 kernel: [ 339.773056] DR0: 0000000000000000

DR1: 0000000000000000 DR2: 0000000000000000


Mar 6 18:00:55 xena018 kernel: [ 339.773316] DR3: 0000000000000000

DR6: 00000000ffff0ff0 DR7: 0000000000000400


Mar 6 18:00:55 xena018 kernel: [ 339.773573] Process mkfs.ext2 (pid:

3217, threadinfo ffff880629ab2000, task ffff88062569dcc0)


Mar 6 18:00:55 xena018 kernel: [ 339.774033] Stack:


Mar 6 18:00:55 xena018 kernel: [ 339.774284] ffff8806291cd008

ffff8806291cd008 ffff880629ab3c68 ffffffff812069f0


Mar 6 18:00:55 xena018 kernel: [ 339.774909] ffff8806291cd008

ffff880319410e30 0000000000000046 0000000000000005


Mar 6 18:00:55 xena018 kernel: [ 339.775530] ffff880629ab3c98

ffffffff8120b234 ffff8806291cd008 ffff880622982378


Mar 6 18:00:55 xena018 kernel: [ 339.776153] Call Trace:


Mar 6 18:00:55 xena018 kernel: [ 339.776405] [<ffffffff812069f0>]

__elv_add_request+0x1a5/0x1df


Mar 6 18:00:55 xena018 kernel: [ 339.776659] [<ffffffff8120b234>]

blk_insert_cloned_request+0x67/0x89


Mar 6 18:00:55 xena018 kernel: [ 339.776917] [<ffffffff8138df81>]

dm_dispatch_request+0x3b/0x61


Mar 6 18:00:55 xena018 kernel: [ 339.777172] [<ffffffff8138f76a>]

dm_request_fn+0x151/0x1f4


Mar 6 18:00:55 xena018 kernel: [ 339.777429] [<ffffffff8120731d>]

__blk_run_queue+0x1b/0x1d


Mar 6 18:00:55 xena018 kernel: [ 339.777685] [<ffffffff8120cc25>]

__make_request+0x276/0x2a9


Mar 6 18:00:55 xena018 kernel: [ 339.777944] [<ffffffff8138ea4b>]

dm_request+0x30/0x172


Mar 6 18:00:55 xena018 kernel: [ 339.778201] [<ffffffff8120b5a1>]

generic_make_request+0x27d/0x312


Mar 6 18:00:55 xena018 kernel: [ 339.778464] [<ffffffff810e0425>] ?

mempool_alloc_slab+0x15/0x17


Mar 6 18:00:55 xena018 kernel: [ 339.778723] [<ffffffff8120b714>]

submit_bio+0xde/0xfd


Mar 6 18:00:55 xena018 kernel: [ 339.778981] [<ffffffff81150dfb>] ?

bio_alloc_bioset+0x4c/0xc3


Mar 6 18:00:55 xena018 kernel: [ 339.779240] [<ffffffff8120dd33>]

blkdev_issue_flush+0x8f/0xcf


Mar 6 18:00:55 xena018 kernel: [ 339.779501] [<ffffffff811522f1>]

blkdev_fsync+0x35/0x42


Mar 6 18:00:55 xena018 kernel: [ 339.779759] [<ffffffff8114b3d7>]

vfs_fsync_range+0x23/0x25


Mar 6 18:00:55 xena018 kernel: [ 339.780012] [<ffffffff8114b3f5>]

vfs_fsync+0x1c/0x1e


Mar 6 18:00:55 xena018 kernel: [ 339.780260] [<ffffffff8114b6b4>]

sys_fsync+0x29/0x3c


Mar 6 18:00:55 xena018 kernel: [ 339.780512] [<ffffffff814bc482>]

system_call_fastpath+0x16/0x1b


Mar 6 18:00:55 xena018 kernel: [ 339.780761] Code: 80 e4 f3 41 89 40

40 85 f6 75 11 31 c9 31 d2 4c 89 c7 e8 df e2 ff ff e9 87 00 00 00 49

8b 40 60 48 85 c0 74 06 49 3b 40 68 74 02 <0f> 0b 83 fe 02 75 19 48

8b 73 08 4c 89 c7 48 89 da e8 40 15 02


Mar 6 18:00:55 xena018 kernel: [ 339.784140] RIP [<ffffffff8120e16f>]

blk_insert_flush+0x84/0x101


Mar 6 18:00:55 xena018 kernel: [ 339.784450] RSP <ffff880629ab3c28
>  

Mar 6 18:00:55 xena018 kernel: [ 339.784737] ---[ end trace

91d8c37eac182b74 ]---




--





Roi


_______________________________________________

vdsm-devel mailing list

vdsm-devel(a)lists.fedorahosted.org

https://fedorahosted.org/mailman/listinfo/vdsm-devel

Could you try and run:
`mkfs.ext2 -q -j -E nodiscard /dev/lun`
where lun is a lun on said target.
If nothing crashes.
Could you please create a VG and an LV on a lun and run the same command on the LV.

I assume one of these will reproduce the crash.

----- Original Message -----
>  From: "Roi Dayan" <roi.dayan(a)gmail.com&gt;
>  To: "Saggi Mizrahi" <smizrahi(a)redhat.com&gt;
>  Cc: "Or Gerlitz" <ogerlitz(a)mellanox.com&gt;, "Itzik Brown"
> <ItzikB(a)mellanox.com&gt;, vdsm-devel(a)lists.fedorahosted.org
>  Sent: Tuesday, March 6, 2012 4:17:45 PM
>  Subject: Re: [vdsm] Kernel crash on FC16
>  
>  
>  
>  Yes happens all the time.
>  It's a normal iscsi target over 1GbE
>  
>  Roi
>  
>  On 6 במרץ 2012, at 23:14, Saggi Mizrahi < smizrahi(a)redhat.com >
>  wrote:
>  
>  
>  
>  
>  
>  Is it reproducible?
>  
>  ----- Original Message -----
>  
>  
>  From: "Roi Dayan" < roi.dayan(a)gmail.com >
>  
>  
>  To: vdsm-devel(a)lists.fedorahosted.org
>  
>  
>  Cc: "Or Gerlitz" < ogerlitz(a)mellanox.com >, "Itzik Brown" <
>  ItzikB(a)mellanox.com >
>  
>  
>  Sent: Tuesday, March 6, 2012 11:09:15 AM
>  
>  
>  Subject: [vdsm] Kernel crash on FC16
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  Hi,
>  
>  
>  
>  
>  
>  
>  
>  
>  After discovery I select a LUN and give it a name, I click OK and I
>  
>  
>  get a kernel crash.
>  
>  
>  The kernel version is 3.1.0-7
>  
>  
>  I pasted the log below.
>  
>  
>  Any idea?
>  
>  
>  
>  
>  
>  
>  
>  
>  Thanks,
>  
>  
>  Roi
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.762969] ------------[ cut here
>  
>  
>  ]------------
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.763233] kernel BUG at
>  
>  
>  block/blk-flush.c:323!
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.763496] invalid opcode: 0000
>  
>  
>  [#1] SMP
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.763839] CPU 6
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.763885] Modules linked in:
>  
>  
>  ebtable_nat ebtables 8021q garp bonding lockd bridge stp llc
>  
>  
>  be2iscsi iscsi_boot_sysfs bnx2i cnic uio cxgb4i cxgb4 cxgb3i
>  
>  
>  libcxgbi cxgb3 mdio iscsi_tcp libiscsi_tcp libiscsi
>  
>  
>  scsi_transport_iscsi ib_ipoib rdma_ucm xt_multiport ib_ucm ib_uverbs
>  
>  
>  ib_umad rdma_cm ib_cm ip6t_REJECT iw_cm nf_conntrack_ipv6
>  
>  
>  nf_defrag_ipv6 xt_state ib_addr nf_conntrack ip6table_filter ib_sa
>  
>  
>  ip6_tables dm_round_robin dm_multipath mlx4_ib ib_mad ib_core sunrpc
>  
>  
>  vhost_net igb i7core_edac edac_core i2c_i801 ioatdma macvtap macvlan
>  
>  
>  tun virtio_net iTCO_wdt i2c_core kvm_intel iTCO_vendor_support dca
>  
>  
>  kvm joydev mlx4_core serio_raw microcode uinput [last unloaded:
>  
>  
>  ib_iser]
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.769133]
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.769387] Pid: 3217, comm:
>  
>  
>  mkfs.ext2 Not tainted 3.1.0-7.fc16.x86_64 #1 Supermicro X8DTU/X8DTU
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.770000] RIP:
>  
>  
>  0010:[<ffffffff8120e16f>] [<ffffffff8120e16f>]
>  
>  
>  blk_insert_flush+0x84/0x101
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.770529] RSP:
>  
>  
>  0018:ffff880629ab3c28 EFLAGS: 00010046
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.770785] RAX: 0000000000000000
>  
>  
>  RBX: ffff880319410e30 RCX: 0000000008018215
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.771050] RDX: 0000000000000000
>  
>  
>  RSI: 0000000000000001 RDI: ffff8806291cd008
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.771314] RBP: ffff880629ab3c38
>  
>  
>  R08: ffff8806291cd008 R09: 0000000000000001
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.771571] R10: 0000000000000001
>  
>  
>  R11: ffff880622982378 R12: ffff880319410e30
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.771827] R13: 0000000000000046
>  
>  
>  R14: 0000000000000005 R15: ffff88061f0c4c00
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.772085] FS:
>  
>  
>  00007fedacb44780(0000) GS:ffff88063fc00000(0000)
>  
>  
>  knlGS:0000000000000000
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.772542] CS: 0010 DS: 0000 ES:
>  
>  
>  0000 CR0: 0000000080050033
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.772794] CR2: 00000000017f4e70
>  
>  
>  CR3: 0000000628c25000 CR4: 00000000000006e0
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.773056] DR0: 0000000000000000
>  
>  
>  DR1: 0000000000000000 DR2: 0000000000000000
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.773316] DR3: 0000000000000000
>  
>  
>  DR6: 00000000ffff0ff0 DR7: 0000000000000400
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.773573] Process mkfs.ext2 (pid:
>  
>  
>  3217, threadinfo ffff880629ab2000, task ffff88062569dcc0)
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.774033] Stack:
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.774284] ffff8806291cd008
>  
>  
>  ffff8806291cd008 ffff880629ab3c68 ffffffff812069f0
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.774909] ffff8806291cd008
>  
>  
>  ffff880319410e30 0000000000000046 0000000000000005
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.775530] ffff880629ab3c98
>  
>  
>  ffffffff8120b234 ffff8806291cd008 ffff880622982378
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.776153] Call Trace:
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.776405] [<ffffffff812069f0>]
>  
>  
>  __elv_add_request+0x1a5/0x1df
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.776659] [<ffffffff8120b234>]
>  
>  
>  blk_insert_cloned_request+0x67/0x89
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.776917] [<ffffffff8138df81>]
>  
>  
>  dm_dispatch_request+0x3b/0x61
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.777172] [<ffffffff8138f76a>]
>  
>  
>  dm_request_fn+0x151/0x1f4
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.777429] [<ffffffff8120731d>]
>  
>  
>  __blk_run_queue+0x1b/0x1d
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.777685] [<ffffffff8120cc25>]
>  
>  
>  __make_request+0x276/0x2a9
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.777944] [<ffffffff8138ea4b>]
>  
>  
>  dm_request+0x30/0x172
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.778201] [<ffffffff8120b5a1>]
>  
>  
>  generic_make_request+0x27d/0x312
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.778464] [<ffffffff810e0425>] ?
>  
>  
>  mempool_alloc_slab+0x15/0x17
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.778723] [<ffffffff8120b714>]
>  
>  
>  submit_bio+0xde/0xfd
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.778981] [<ffffffff81150dfb>] ?
>  
>  
>  bio_alloc_bioset+0x4c/0xc3
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.779240] [<ffffffff8120dd33>]
>  
>  
>  blkdev_issue_flush+0x8f/0xcf
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.779501] [<ffffffff811522f1>]
>  
>  
>  blkdev_fsync+0x35/0x42
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.779759] [<ffffffff8114b3d7>]
>  
>  
>  vfs_fsync_range+0x23/0x25
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.780012] [<ffffffff8114b3f5>]
>  
>  
>  vfs_fsync+0x1c/0x1e
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.780260] [<ffffffff8114b6b4>]
>  
>  
>  sys_fsync+0x29/0x3c
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.780512] [<ffffffff814bc482>]
>  
>  
>  system_call_fastpath+0x16/0x1b
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.780761] Code: 80 e4 f3 41 89 40
>  
>  
>  40 85 f6 75 11 31 c9 31 d2 4c 89 c7 e8 df e2 ff ff e9 87 00 00 00 49
>  
>  
>  8b 40 60 48 85 c0 74 06 49 3b 40 68 74 02 <0f> 0b 83 fe 02 75 19 48
>  
>  
>  8b 73 08 4c 89 c7 48 89 da e8 40 15 02
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.784140] RIP [<ffffffff8120e16f>]
>  
>  
>  blk_insert_flush+0x84/0x101
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.784450] RSP <ffff880629ab3c28>
>  
>  
>  
>  
>  
>  Mar 6 18:00:55 xena018 kernel: [ 339.784737] ---[ end trace
>  
>  
>  91d8c37eac182b74 ]---
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  --
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  
>  Roi
>  
>  
>  
>  
>  
>  _______________________________________________
>  
>  
>  vdsm-devel mailing list
>  
>  
>  vdsm-devel(a)lists.fedorahosted.org
>  
>  
>  https://fedorahosted.org/mailman/listinfo/vdsm-devel
>  
>  
>  
>

[Roi Dayan]

tried it.
I don't have any problems.



On Wed, Mar 7, 2012 at 12:14 AM, Saggi Mizrahi <smizrahi(a)redhat.com&gt; wrote:

>  Could you try and run:
>  `mkfs.ext2 -q -j -E nodiscard /dev/lun`
>  where lun is a lun on said target.
>  If nothing crashes.
>  Could you please create a VG and an LV on a lun and run the same command
>  on the LV.
>
>  I assume one of these will reproduce the crash.
>
>  ----- Original Message -----
>  > From: "Roi Dayan" <roi.dayan(a)gmail.com&gt;
>  > To: "Saggi Mizrahi" <smizrahi(a)redhat.com&gt;
>  > Cc: "Or Gerlitz" <ogerlitz(a)mellanox.com&gt;, "Itzik Brown"
> <
>  ItzikB(a)mellanox.com&gt;, vdsm-devel(a)lists.fedorahosted.org
>  > Sent: Tuesday, March 6, 2012 4:17:45 PM
>  > Subject: Re: [vdsm] Kernel crash on FC16
>  >
>  >
>  >
>  > Yes happens all the time.
>  > It's a normal iscsi target over 1GbE
>  >
>  > Roi
>  >
>  > On 6 במרץ 2012, at 23:14, Saggi Mizrahi < smizrahi(a)redhat.com >
>  > wrote:
>  >
>  >
>  >
>  >
>  >
>  > Is it reproducible?
>  >
>  > ----- Original Message -----
>  >
>  >
>  > From: "Roi Dayan" < roi.dayan(a)gmail.com >
>  >
>  >
>  > To: vdsm-devel(a)lists.fedorahosted.org
>  >
>  >
>  > Cc: "Or Gerlitz" < ogerlitz(a)mellanox.com >, "Itzik Brown"
> <
>  > ItzikB(a)mellanox.com >
>  >
>  >
>  > Sent: Tuesday, March 6, 2012 11:09:15 AM
>  >
>  >
>  > Subject: [vdsm] Kernel crash on FC16
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  > Hi,
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  > After discovery I select a LUN and give it a name, I click OK and I
>  >
>  >
>  > get a kernel crash.
>  >
>  >
>  > The kernel version is 3.1.0-7
>  >
>  >
>  > I pasted the log below.
>  >
>  >
>  > Any idea?
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  > Thanks,
>  >
>  >
>  > Roi
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.762969] ------------[ cut here
>  >
>  >
>  > ]------------
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.763233] kernel BUG at
>  >
>  >
>  > block/blk-flush.c:323!
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.763496] invalid opcode: 0000
>  >
>  >
>  > [#1] SMP
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.763839] CPU 6
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.763885] Modules linked in:
>  >
>  >
>  > ebtable_nat ebtables 8021q garp bonding lockd bridge stp llc
>  >
>  >
>  > be2iscsi iscsi_boot_sysfs bnx2i cnic uio cxgb4i cxgb4 cxgb3i
>  >
>  >
>  > libcxgbi cxgb3 mdio iscsi_tcp libiscsi_tcp libiscsi
>  >
>  >
>  > scsi_transport_iscsi ib_ipoib rdma_ucm xt_multiport ib_ucm ib_uverbs
>  >
>  >
>  > ib_umad rdma_cm ib_cm ip6t_REJECT iw_cm nf_conntrack_ipv6
>  >
>  >
>  > nf_defrag_ipv6 xt_state ib_addr nf_conntrack ip6table_filter ib_sa
>  >
>  >
>  > ip6_tables dm_round_robin dm_multipath mlx4_ib ib_mad ib_core sunrpc
>  >
>  >
>  > vhost_net igb i7core_edac edac_core i2c_i801 ioatdma macvtap macvlan
>  >
>  >
>  > tun virtio_net iTCO_wdt i2c_core kvm_intel iTCO_vendor_support dca
>  >
>  >
>  > kvm joydev mlx4_core serio_raw microcode uinput [last unloaded:
>  >
>  >
>  > ib_iser]
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.769133]
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.769387] Pid: 3217, comm:
>  >
>  >
>  > mkfs.ext2 Not tainted 3.1.0-7.fc16.x86_64 #1 Supermicro X8DTU/X8DTU
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.770000] RIP:
>  >
>  >
>  > 0010:[<ffffffff8120e16f>] [<ffffffff8120e16f>]
>  >
>  >
>  > blk_insert_flush+0x84/0x101
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.770529] RSP:
>  >
>  >
>  > 0018:ffff880629ab3c28 EFLAGS: 00010046
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.770785] RAX: 0000000000000000
>  >
>  >
>  > RBX: ffff880319410e30 RCX: 0000000008018215
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.771050] RDX: 0000000000000000
>  >
>  >
>  > RSI: 0000000000000001 RDI: ffff8806291cd008
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.771314] RBP: ffff880629ab3c38
>  >
>  >
>  > R08: ffff8806291cd008 R09: 0000000000000001
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.771571] R10: 0000000000000001
>  >
>  >
>  > R11: ffff880622982378 R12: ffff880319410e30
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.771827] R13: 0000000000000046
>  >
>  >
>  > R14: 0000000000000005 R15: ffff88061f0c4c00
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.772085] FS:
>  >
>  >
>  > 00007fedacb44780(0000) GS:ffff88063fc00000(0000)
>  >
>  >
>  > knlGS:0000000000000000
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.772542] CS: 0010 DS: 0000 ES:
>  >
>  >
>  > 0000 CR0: 0000000080050033
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.772794] CR2: 00000000017f4e70
>  >
>  >
>  > CR3: 0000000628c25000 CR4: 00000000000006e0
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.773056] DR0: 0000000000000000
>  >
>  >
>  > DR1: 0000000000000000 DR2: 0000000000000000
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.773316] DR3: 0000000000000000
>  >
>  >
>  > DR6: 00000000ffff0ff0 DR7: 0000000000000400
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.773573] Process mkfs.ext2 (pid:
>  >
>  >
>  > 3217, threadinfo ffff880629ab2000, task ffff88062569dcc0)
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.774033] Stack:
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.774284] ffff8806291cd008
>  >
>  >
>  > ffff8806291cd008 ffff880629ab3c68 ffffffff812069f0
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.774909] ffff8806291cd008
>  >
>  >
>  > ffff880319410e30 0000000000000046 0000000000000005
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.775530] ffff880629ab3c98
>  >
>  >
>  > ffffffff8120b234 ffff8806291cd008 ffff880622982378
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.776153] Call Trace:
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.776405] [<ffffffff812069f0>]
>  >
>  >
>  > __elv_add_request+0x1a5/0x1df
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.776659] [<ffffffff8120b234>]
>  >
>  >
>  > blk_insert_cloned_request+0x67/0x89
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.776917] [<ffffffff8138df81>]
>  >
>  >
>  > dm_dispatch_request+0x3b/0x61
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.777172] [<ffffffff8138f76a>]
>  >
>  >
>  > dm_request_fn+0x151/0x1f4
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.777429] [<ffffffff8120731d>]
>  >
>  >
>  > __blk_run_queue+0x1b/0x1d
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.777685] [<ffffffff8120cc25>]
>  >
>  >
>  > __make_request+0x276/0x2a9
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.777944] [<ffffffff8138ea4b>]
>  >
>  >
>  > dm_request+0x30/0x172
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.778201] [<ffffffff8120b5a1>]
>  >
>  >
>  > generic_make_request+0x27d/0x312
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.778464] [<ffffffff810e0425>] ?
>  >
>  >
>  > mempool_alloc_slab+0x15/0x17
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.778723] [<ffffffff8120b714>]
>  >
>  >
>  > submit_bio+0xde/0xfd
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.778981] [<ffffffff81150dfb>] ?
>  >
>  >
>  > bio_alloc_bioset+0x4c/0xc3
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.779240] [<ffffffff8120dd33>]
>  >
>  >
>  > blkdev_issue_flush+0x8f/0xcf
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.779501] [<ffffffff811522f1>]
>  >
>  >
>  > blkdev_fsync+0x35/0x42
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.779759] [<ffffffff8114b3d7>]
>  >
>  >
>  > vfs_fsync_range+0x23/0x25
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.780012] [<ffffffff8114b3f5>]
>  >
>  >
>  > vfs_fsync+0x1c/0x1e
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.780260] [<ffffffff8114b6b4>]
>  >
>  >
>  > sys_fsync+0x29/0x3c
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.780512] [<ffffffff814bc482>]
>  >
>  >
>  > system_call_fastpath+0x16/0x1b
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.780761] Code: 80 e4 f3 41 89 40
>  >
>  >
>  > 40 85 f6 75 11 31 c9 31 d2 4c 89 c7 e8 df e2 ff ff e9 87 00 00 00 49
>  >
>  >
>  > 8b 40 60 48 85 c0 74 06 49 3b 40 68 74 02 <0f> 0b 83 fe 02 75 19 48
>  >
>  >
>  > 8b 73 08 4c 89 c7 48 89 da e8 40 15 02
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.784140] RIP [<ffffffff8120e16f>]
>  >
>  >
>  > blk_insert_flush+0x84/0x101
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.784450] RSP <ffff880629ab3c28>
>  >
>  >
>  >
>  >
>  >
>  > Mar 6 18:00:55 xena018 kernel: [ 339.784737] ---[ end trace
>  >
>  >
>  > 91d8c37eac182b74 ]---
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  > --
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  > Roi
>  >
>  >
>  >
>  >
>  >
>  > _______________________________________________
>  >
>  >
>  > vdsm-devel mailing list
>  >
>  >
>  > vdsm-devel(a)lists.fedorahosted.org
>  >
>  >
>  > https://fedorahosted.org/mailman/listinfo/vdsm-devel
>  >
>  >
>  >
>  >
>  


-- 

*Roi *

On 03/07/2012 01:35 PM, Roi Dayan wrote:
>  tried it.
>  I don't have any problems.
>  
Wondering if trying as user vdsm will reproduce ? Might be worth trying.
su - vdsm -s /bin/bash
<try in the new shell>

>  On Wed, Mar 7, 2012 at 12:14 AM, Saggi Mizrahi <smizrahi(a)redhat.com 
>  <mailto:[e-mail]>> wrote:
>
>      Could you try and run:
>      `mkfs.ext2 -q -j -E nodiscard /dev/lun`
>      where lun is a lun on said target.
>      If nothing crashes.
>      Could you please create a VG and an LV on a lun and run the same
>      command on the LV.
>
>      I assume one of these will reproduce the crash.
>
>      ----- Original Message -----
>      > From: "Roi Dayan" <roi.dayan(a)gmail.com
> <mailto:[e-mail]>>
>      > To: "Saggi Mizrahi" <smizrahi(a)redhat.com
>      <mailto:[e-mail]>>
>      > Cc: "Or Gerlitz" <ogerlitz(a)mellanox.com
>      <mailto:[e-mail]>>, "Itzik Brown"
>      <ItzikB(a)mellanox.com <mailto:[e-mail]>>,
>      vdsm-devel(a)lists.fedorahosted.org
>      <mailto:[e-mail]>
>      > Sent: Tuesday, March 6, 2012 4:17:45 PM
>      > Subject: Re: [vdsm] Kernel crash on FC16
>      >
>      >
>      >
>      > Yes happens all the time.
>      > It's a normal iscsi target over 1GbE
>      >
>      > Roi
>      >
>      > On 6 במרץ 2012, at 23:14, Saggi Mizrahi < smizrahi(a)redhat.com
>      <mailto:[e-mail]> >
>      > wrote:
>      >
>      >
>      >
>      >
>      >
>      > Is it reproducible?
>      >
>      > ----- Original Message -----
>      >
>      >
>      > From: "Roi Dayan" < roi.dayan(a)gmail.com
>      <mailto:[e-mail]> >
>      >
>      >
>      > To: vdsm-devel(a)lists.fedorahosted.org
>      <mailto:[e-mail]>
>      >
>      >
>      > Cc: "Or Gerlitz" < ogerlitz(a)mellanox.com
>      <mailto:[e-mail]> >, "Itzik Brown" <
>      > ItzikB(a)mellanox.com <mailto:[e-mail]> >
>      >
>      >
>      > Sent: Tuesday, March 6, 2012 11:09:15 AM
>      >
>      >
>      > Subject: [vdsm] Kernel crash on FC16
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      > Hi,
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      > After discovery I select a LUN and give it a name, I click OK and I
>      >
>      >
>      > get a kernel crash.
>      >
>      >
>      > The kernel version is 3.1.0-7
>      >
>      >
>      > I pasted the log below.
>      >
>      >
>      > Any idea?
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      > Thanks,
>      >
>      >
>      > Roi
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.762969] ------------[ cut here
>      >
>      >
>      > ]------------
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.763233] kernel BUG at
>      >
>      >
>      > block/blk-flush.c:323!
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.763496] invalid opcode: 0000
>      >
>      >
>      > [#1] SMP
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.763839] CPU 6
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.763885] Modules linked in:
>      >
>      >
>      > ebtable_nat ebtables 8021q garp bonding lockd bridge stp llc
>      >
>      >
>      > be2iscsi iscsi_boot_sysfs bnx2i cnic uio cxgb4i cxgb4 cxgb3i
>      >
>      >
>      > libcxgbi cxgb3 mdio iscsi_tcp libiscsi_tcp libiscsi
>      >
>      >
>      > scsi_transport_iscsi ib_ipoib rdma_ucm xt_multiport ib_ucm ib_uverbs
>      >
>      >
>      > ib_umad rdma_cm ib_cm ip6t_REJECT iw_cm nf_conntrack_ipv6
>      >
>      >
>      > nf_defrag_ipv6 xt_state ib_addr nf_conntrack ip6table_filter ib_sa
>      >
>      >
>      > ip6_tables dm_round_robin dm_multipath mlx4_ib ib_mad ib_core sunrpc
>      >
>      >
>      > vhost_net igb i7core_edac edac_core i2c_i801 ioatdma macvtap macvlan
>      >
>      >
>      > tun virtio_net iTCO_wdt i2c_core kvm_intel iTCO_vendor_support dca
>      >
>      >
>      > kvm joydev mlx4_core serio_raw microcode uinput [last unloaded:
>      >
>      >
>      > ib_iser]
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.769133]
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.769387] Pid: 3217, comm:
>      >
>      >
>      > mkfs.ext2 Not tainted 3.1.0-7.fc16.x86_64 #1 Supermicro X8DTU/X8DTU
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.770000] RIP:
>      >
>      >
>      > 0010:[<ffffffff8120e16f>] [<ffffffff8120e16f>]
>      >
>      >
>      > blk_insert_flush+0x84/0x101
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.770529] RSP:
>      >
>      >
>      > 0018:ffff880629ab3c28 EFLAGS: 00010046
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.770785] RAX: 0000000000000000
>      >
>      >
>      > RBX: ffff880319410e30 RCX: 0000000008018215
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.771050] RDX: 0000000000000000
>      >
>      >
>      > RSI: 0000000000000001 RDI: ffff8806291cd008
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.771314] RBP: ffff880629ab3c38
>      >
>      >
>      > R08: ffff8806291cd008 R09: 0000000000000001
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.771571] R10: 0000000000000001
>      >
>      >
>      > R11: ffff880622982378 R12: ffff880319410e30
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.771827] R13: 0000000000000046
>      >
>      >
>      > R14: 0000000000000005 R15: ffff88061f0c4c00
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.772085] FS:
>      >
>      >
>      > 00007fedacb44780(0000) GS:ffff88063fc00000(0000)
>      >
>      >
>      > knlGS:0000000000000000
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.772542] CS: 0010 DS: 0000 ES:
>      >
>      >
>      > 0000 CR0: 0000000080050033
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.772794] CR2: 00000000017f4e70
>      >
>      >
>      > CR3: 0000000628c25000 CR4: 00000000000006e0
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.773056] DR0: 0000000000000000
>      >
>      >
>      > DR1: 0000000000000000 DR2: 0000000000000000
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.773316] DR3: 0000000000000000
>      >
>      >
>      > DR6: 00000000ffff0ff0 DR7: 0000000000000400
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.773573] Process mkfs.ext2 (pid:
>      >
>      >
>      > 3217, threadinfo ffff880629ab2000, task ffff88062569dcc0)
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.774033] Stack:
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.774284] ffff8806291cd008
>      >
>      >
>      > ffff8806291cd008 ffff880629ab3c68 ffffffff812069f0
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.774909] ffff8806291cd008
>      >
>      >
>      > ffff880319410e30 0000000000000046 0000000000000005
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.775530] ffff880629ab3c98
>      >
>      >
>      > ffffffff8120b234 ffff8806291cd008 ffff880622982378
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.776153] Call Trace:
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.776405] [<ffffffff812069f0>]
>      >
>      >
>      > __elv_add_request+0x1a5/0x1df
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.776659] [<ffffffff8120b234>]
>      >
>      >
>      > blk_insert_cloned_request+0x67/0x89
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.776917] [<ffffffff8138df81>]
>      >
>      >
>      > dm_dispatch_request+0x3b/0x61
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.777172] [<ffffffff8138f76a>]
>      >
>      >
>      > dm_request_fn+0x151/0x1f4
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.777429] [<ffffffff8120731d>]
>      >
>      >
>      > __blk_run_queue+0x1b/0x1d
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.777685] [<ffffffff8120cc25>]
>      >
>      >
>      > __make_request+0x276/0x2a9
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.777944] [<ffffffff8138ea4b>]
>      >
>      >
>      > dm_request+0x30/0x172
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.778201] [<ffffffff8120b5a1>]
>      >
>      >
>      > generic_make_request+0x27d/0x312
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.778464] [<ffffffff810e0425>] ?
>      >
>      >
>      > mempool_alloc_slab+0x15/0x17
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.778723] [<ffffffff8120b714>]
>      >
>      >
>      > submit_bio+0xde/0xfd
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.778981] [<ffffffff81150dfb>] ?
>      >
>      >
>      > bio_alloc_bioset+0x4c/0xc3
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.779240] [<ffffffff8120dd33>]
>      >
>      >
>      > blkdev_issue_flush+0x8f/0xcf
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.779501] [<ffffffff811522f1>]
>      >
>      >
>      > blkdev_fsync+0x35/0x42
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.779759] [<ffffffff8114b3d7>]
>      >
>      >
>      > vfs_fsync_range+0x23/0x25
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.780012] [<ffffffff8114b3f5>]
>      >
>      >
>      > vfs_fsync+0x1c/0x1e
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.780260] [<ffffffff8114b6b4>]
>      >
>      >
>      > sys_fsync+0x29/0x3c
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.780512] [<ffffffff814bc482>]
>      >
>      >
>      > system_call_fastpath+0x16/0x1b
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.780761] Code: 80 e4 f3 41 89 40
>      >
>      >
>      > 40 85 f6 75 11 31 c9 31 d2 4c 89 c7 e8 df e2 ff ff e9 87 00 00 00 49
>      >
>      >
>      > 8b 40 60 48 85 c0 74 06 49 3b 40 68 74 02 <0f> 0b 83 fe 02 75 19 48
>      >
>      >
>      > 8b 73 08 4c 89 c7 48 89 da e8 40 15 02
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.784140] RIP
>      [<ffffffff8120e16f>]
>      >
>      >
>      > blk_insert_flush+0x84/0x101
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.784450] RSP <ffff880629ab3c28>
>      >
>      >
>      >
>      >
>      >
>      > Mar 6 18:00:55 xena018 kernel: [ 339.784737] ---[ end trace
>      >
>      >
>      > 91d8c37eac182b74 ]---
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      > --
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      >
>      > Roi
>      >
>      >
>      >
>      >
>      >
>      > _______________________________________________
>      >
>      >
>      > vdsm-devel mailing list
>      >
>      >
>      > vdsm-devel(a)lists.fedorahosted.org
>      <mailto:[e-mail]>
>      >
>      >
>      > https://fedorahosted.org/mailman/listinfo/vdsm-devel
>      >
>      >
>      >
>      >
>
>
>
>
>  -- 
>
>  *Roi *
>
>
>
>  _______________________________________________
>  vdsm-devel mailing list
>  vdsm-devel(a)lists.fedorahosted.org
>  https://fedorahosted.org/mailman/listinfo/vdsm-devel