Kernel: low stack detected by irq handler

Fri Mar 30 07:29:09 UTC 2012

On 03/30/2012 08:04 AM, radiatejava wrote:
> Hello experts,
> I have recently moved from kernel 2.6.18-128 to 2.6.18-194. I have my
> own kernel module also called click. This click is for trapping and
> processing all the network packets. All was fine till we were on
> kernel 2.6.18-128 but after we moved to 2.6.18-194 kernel, we are
> seeing the issue below (Low stack detected by IRQ handler) and the OS
> is rebooting.
>
> 1. This is coming once in 2-3 hrs during normal operation and it is
> not tolerable. This stack trace is printed in /var/log/messages and on
> the console. I am not a kernel expert.I am just looking for any
> pointer where someone experienced can tell me what is the reason of
> this or such error ?
>
> 2. Additionally, after upgrading to kernel 2.6.18-194 we had put in
> some code for logging as well. Logging functions in C were 'inline'
> functions. As part of debugging this issue, when we removed the
> 'inline' keyword from the logging methods, we did not observe this
> issue and our issue was resolved. Can anyone tell me why 'inline'
> functions in the kernel module would cause such issues ?
>
>   I asked this to vger.kernel.org kernel list and they have directed me
> ask here as the kernel is redhat kernel.

I am sorry, but this is the list for the Fedora Kernel. If you need 
support for your Red Hat Enterprise Linux kernel, you will need to open 
a support case at the Red Hat Customer Portal via https://access.redhat.com.

The support team will likely point out that the issue is with your 
'click' kernel module and that they can not help you with that. You will 
need to open a support case at the vendor who provides you with this 
'click' kernel module.

It seems that Google knows more about these stack traces, and someone 
even got a response from Alan Cox about it:
- https://lkml.org/lkml/2011/10/7/158

I suggest you take that response to the vendor of the click module so 
that they can correct this behaviour.

Kind regards,
Niels

>   Appreciate your response. Thanks in adv.
>
> Oct 31 10:47:53 KC-CAS-N1 kernel: low stack detected by irq handler
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c0405e9b>] do_IRQ+0x86/0xc3
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c04046e6>] common_interrupt+0x1a/0x20
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05b6b1e>] rt_garbage_collect+0x0/0x213
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05a44d7>] dst_alloc+0x1d/0x7e
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05b8195>]
> __ip_route_output_key+0x543/0x79e
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05b8403>] ip_route_output_flow+0x13/0x1d4
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05b85cd>] ip_route_output_key+0x9/0xb
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05bdd5d>] ip_send_reply+0xf8/0x209
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05eaf79>] __xfrm_policy_check+0x35c/0x671
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05ea74e>] xfrm_policy_lookup+0x0/0x313
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05b7c2f>] rt_intern_hash+0x45d/0x480
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05cfc56>] tcp_v4_send_reset+0x104/0x11c
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05d0879>] tcp_v4_do_rcv+0x240/0x269
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05d28cb>] tcp_v4_rcv+0x7f7/0x848
> Oct 31 10:47:53 KC-CAS-N1 kernel:  [<c05bb173>] ip_local_deliver+0x157/0x1d0
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<c05baff2>] ip_rcv+0x3cb/0x3f5
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<c05a141d>] __netif_receive_skb+0x3b3/0x3d5
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb32e21e>]
> _ZN6ToHost4pushEiP6Packet+0xee/0x210 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb34b85d>]
> _ZN12EnsureEther24pushEiP6Packet+0x1d/0x20 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb33d895>]
> _ZN11ARPQuerier44pushEiP6Packet+0x4c5/0x2370 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<c05bb173>] ip_local_deliver+0x157/0x1d0
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<c05baff2>] ip_rcv+0x3cb/0x3f5
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb31b42d>]
> _ZN4IPRw7Mapping9make_pairEiRK8IPFlowIDS3_iiPS0_S4_+0xad/0xd0 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb31ccfb>]
> _ZN4IPRw7Pattern14create_mappingEiRK8IPFlowIDiiPNS_7MappingES5_RK7HashMapIS1_S5_E+0x1cb/0x1f0
> [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb395ce3>]
> _ZN10IPRewriter13apply_patternEPN4IPRw7PatternEiRK8IPFlowIDii+0x153/0x160
> [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb395d9e>]
> _ZN10IPRewriter4pushEiP6Packet+0xae/0x260 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb367535>]
> _ZN11MacThrottle10l2PushProcEiP6Packet+0x55/0x3b0 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb33d895>]
> _ZN11ARPQuerier44pushEiP6Packet+0x4c5/0x2370 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb395ce3>]
> _ZN10IPRewriter13apply_patternEPN4IPRw7PatternEiRK8IPFlowIDii+0x153/0x160
> [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb395d9e>]
> _ZN10IPRewriter4pushEiP6Packet+0xae/0x260 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb367b96>]
> _ZN11MacThrottle4pushEiP6Packet+0x306/0x1890 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb36b075>]
> _ZN17NtlmLoginDetector4pushEiP6Packet+0x65/0x15d0 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb39c881>]
> _ZN15RecycledSkbPool7recycleEP7sk_buff+0x31/0xf0 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb378fdb>]
> _ZN14PerfigoDiscard4pushEiP6Packet+0x4b/0x1c0 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<c05bb173>] ip_local_deliver+0x157/0x1d0
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb355e86>]
> _ZN11HashIPTable4pushEiP6Packet+0xf6/0x2d0 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<c05a141d>] __netif_receive_skb+0x3b3/0x3d5
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<c04046e6>] common_interrupt+0x1a/0x20
> Oct 31 10:47:54 KC-CAS-N1 kernel:  [<fb30f904>]
> _ZN8IPFilter4pushEiP6Packet+0x64/0xf0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb361517>]
> _ZN12IPPortLookup4pushEiP6Packet+0x47/0x9e0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<c0405ecc>] do_IRQ+0xb7/0xc3
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<c04046e6>] common_interrupt+0x1a/0x20
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb34a5fc>]
> _ZN10DnsHandler17is_packet_allowedEPK6Packeti+0x8c/0x5e0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3455d7>]
> _ZN10DnsHandler12get_dns_nameEPKcS1_S1_R16perfigo_dns_nameR6String+0x177/0x200
> [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3456a3>]
> _ZN10DnsHandler10get_dns_rrEPKcS1_RS1_R14perfigo_dns_rrR6String+0x43/0xb0
> [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb34abb8>]
> _ZN10DnsHandler4pushEiP6Packet+0x68/0xb00 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb2cea6f>]
> _ZN6Packet19expensive_uniqueifyEiib+0x18f/0x1c0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb32edba>]
> _ZN11ARPQuerier29handle_ipEP6Packet+0x2aa/0x5f0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<c04046e6>] common_interrupt+0x1a/0x20
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3301bd>]
> _ZN11ARPQuerier24pushEiP6Packet+0xcd/0x110 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb34abb8>]
> _ZN10DnsHandler4pushEiP6Packet+0x68/0xb00 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb32edba>]
> _ZN11ARPQuerier29handle_ipEP6Packet+0x2aa/0x5f0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb35f34f>]
> _ZN13IPFilterGroup4pushEiP6Packet+0x19f/0xa80 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3301bd>]
> _ZN11ARPQuerier24pushEiP6Packet+0xcd/0x110 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb350492>]
> _ZN13HashIPLookup34pushEiP6Packet+0x112/0x1c0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3636cf>]
> _ZN15LinearIPFilter24pushEiP6Packet+0x4f/0x3f0 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb31e1d1>]
> _ZN14LinearIPLookup4pushEiP6Packet+0x71/0x100 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<f8c5b0fc>]
> crypto_cbc_decrypt_inplace+0xb2/0xd1 [cbc]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb35a344>]
> _ZN14HashMACLookup54pushEiP6Packet+0x304/0x890 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3515b7>]
> _ZN13HashIPLookup54pushEiP6Packet+0xc7/0x110 [click]
> Oct 31 10:47:55 KC-CAS-N1 kernel:  [<fb3636cf>]
> _ZN15LinearIPFilter24pushEiP6Packet+0x4f/0x3f0 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb31e1d1>]
> _ZN14LinearIPLookup4pushEiP6Packet+0x71/0x100 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb36b075>]
> _ZN17NtlmLoginDetector4pushEiP6Packet+0x65/0x15d0 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb359bc1>]
> _ZN14HashMACLookup514push_extern_ipEP6Packet+0x51/0x4d0 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb35462e>]
> _ZN12HashIPTable24pushEiP6Packet+0x18e/0x580 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c0418baf>] __wake_up+0x11/0x1a
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c059b077>] sock_def_readable+0x26/0x4b
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c059b454>] sock_queue_rcv_skb+0x102/0x10e
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c05d4cbb>] __udp_queue_rcv_skb+0x8/0x31
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c05d639d>] udp_rcv+0x35a/0x44a
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb39c881>]
> _ZN15RecycledSkbPool7recycleEP7sk_buff+0x31/0xf0 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb35a57a>]
> _ZN14HashMACLookup54pushEiP6Packet+0x53a/0x890 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb378fdb>]
> _ZN14PerfigoDiscard4pushEiP6Packet+0x4b/0x1c0 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb30f904>]
> _ZN8IPFilter4pushEiP6Packet+0x64/0xf0 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb33d895>]
> _ZN11ARPQuerier44pushEiP6Packet+0x4c5/0x2370 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb32e21e>]
> _ZN6ToHost4pushEiP6Packet+0xee/0x210 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb37879e>]
> _ZN6Passer4pushEiP6Packet+0x12e/0x860 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb35462e>]
> _ZN12HashIPTable24pushEiP6Packet+0x18e/0x580 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c043f334>] __do_IRQ+0x0/0x9f
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c0405ecc>] do_IRQ+0xb7/0xc3
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c0411f41>]
> smp_apic_timer_interrupt+0x32/0x45
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c0411f41>]
> smp_apic_timer_interrupt+0x32/0x45
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb37b516>]
> _ZN10Classifier4pushEiP6Packet+0x76/0xe0 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb3282a5>]
> _ZN10FromDevice8run_taskEP4Task+0xa5/0x120 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb2e9127>]
> _ZN12RouterThread6driverEv+0x177/0x290 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb399822>]
> _Z11click_schedPv+0x82/0x130 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<fb3997a0>]
> _Z11click_schedPv+0x0/0x130 [click]
> Oct 31 10:47:56 KC-CAS-N1 kernel:  [<c0404987>] kernel_thread_helper+0x7/0x10
> Oct 31 10:47:57 KC-CAS-N1 kernel:  =======================
> Oct 31 10:47:57 KC-CAS-N1 kernel: low stack detected by irq handler
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c0405e9b>] do_IRQ+0x86/0xc3
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c04046e6>] common_interrupt+0x1a/0x20
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05b6b1e>] rt_garbage_collect+0x0/0x213
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05a44d7>] dst_alloc+0x1d/0x7e
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05b8195>]
> __ip_route_output_key+0x543/0x79e
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05b8403>] ip_route_output_flow+0x13/0x1d4
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05b85cd>] ip_route_output_key+0x9/0xb
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05bdd5d>] ip_send_reply+0xf8/0x209
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05eaf79>] __xfrm_policy_check+0x35c/0x671
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05ea74e>] xfrm_policy_lookup+0x0/0x313
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05b7c2f>] rt_intern_hash+0x45d/0x480
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05cfc56>] tcp_v4_send_reset+0x104/0x11c
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05d0879>] tcp_v4_do_rcv+0x240/0x269
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05d28cb>] tcp_v4_rcv+0x7f7/0x848
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05bb173>] ip_local_deliver+0x157/0x1d0
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05baff2>] ip_rcv+0x3cb/0x3f5
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05a141d>] __netif_receive_skb+0x3b3/0x3d5
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<fb32e21e>]
> _ZN6ToHost4pushEiP6Packet+0xee/0x210 [click]
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<fb34b85d>]
> _ZN12EnsureEther24pushEiP6Packet+0x1d/0x20 [click]
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<fb33d895>]
> _ZN11ARPQuerier44pushEiP6Packet+0x4c5/0x2370 [click]
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05bb173>] ip_local_deliver+0x157/0x1d0
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<c05baff2>] ip_rcv+0x3cb/0x3f5
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<fb31b42d>]
> _ZN4IPRw7Mapping9make_pairEiRK8IPFlowIDS3_iiPS0_S4_+0xad/0xd0 [click]
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<fb31ccfb>]
> _ZN4IPRw7Pattern14create_mappingEiRK8IPFlowIDiiPNS_7MappingES5_RK7HashMapIS1_S5_E+0x1cb/0x1f0
> [click]
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<fb395ce3>]
> _ZN10IPRewriter13apply_patternEPN4IPRw7PatternEiRK8IPFlowIDii+0x153/0x160
> [click]
> Oct 31 10:47:57 KC-CAS-N1 kernel:  [<fb395d9e>]
> _ZN10IPRewriter4pushEiP6Packet+0xae/0x260 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb367535>]
> _ZN11MacThrottle10l2PushProcEiP6Packet+0x55/0x3b0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb33d895>]
> _ZN11ARPQuerier44pushEiP6Packet+0x4c5/0x2370 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb395ce3>]
> _ZN10IPRewriter13apply_patternEPN4IPRw7PatternEiRK8IPFlowIDii+0x153/0x160
> [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb395d9e>]
> _ZN10IPRewriter4pushEiP6Packet+0xae/0x260 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb367b96>]
> _ZN11MacThrottle4pushEiP6Packet+0x306/0x1890 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb36b075>]
> _ZN17NtlmLoginDetector4pushEiP6Packet+0x65/0x15d0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb39c881>]
> _ZN15RecycledSkbPool7recycleEP7sk_buff+0x31/0xf0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb378fdb>]
> _ZN14PerfigoDiscard4pushEiP6Packet+0x4b/0x1c0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<c05bb173>] ip_local_deliver+0x157/0x1d0
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb355e86>]
> _ZN11HashIPTable4pushEiP6Packet+0xf6/0x2d0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<c05a141d>] __netif_receive_skb+0x3b3/0x3d5
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<c04046e6>] common_interrupt+0x1a/0x20
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb30f904>]
> _ZN8IPFilter4pushEiP6Packet+0x64/0xf0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb361517>]
> _ZN12IPPortLookup4pushEiP6Packet+0x47/0x9e0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<c0405ecc>] do_IRQ+0xb7/0xc3
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<c04046e6>] common_interrupt+0x1a/0x20
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb34a5fc>]
> _ZN10DnsHandler17is_packet_allowedEPK6Packeti+0x8c/0x5e0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb3455d7>]
> _ZN10DnsHandler12get_dns_nameEPKcS1_S1_R16perfigo_dns_nameR6String+0x177/0x200
> [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb3456a3>]
> _ZN10DnsHandler10get_dns_rrEPKcS1_RS1_R14perfigo_dns_rrR6String+0x43/0xb0
> [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb34abb8>]
> _ZN10DnsHandler4pushEiP6Packet+0x68/0xb00 [click]
> Oct 31 10:47:58 KC-CAS-N1 kernel:  [<fb2cea6f>]
> _ZN6Packet19expensive_uniqueifyEiib+0x18f/0x1c0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb32edba>]
> _ZN11ARPQuerier29handle_ipEP6Packet+0x2aa/0x5f0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<c04046e6>] common_interrupt+0x1a/0x20
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb3301bd>]
> _ZN11ARPQuerier24pushEiP6Packet+0xcd/0x110 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb34abb8>]
> _ZN10DnsHandler4pushEiP6Packet+0x68/0xb00 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb32edba>]
> _ZN11ARPQuerier29handle_ipEP6Packet+0x2aa/0x5f0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb35f34f>]
> _ZN13IPFilterGroup4pushEiP6Packet+0x19f/0xa80 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb3301bd>]
> _ZN11ARPQuerier24pushEiP6Packet+0xcd/0x110 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb3439d8>]
> _ZN8BWShaper4pushEiP6Packet+0x58/0xe90 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb350492>]
> _ZN13HashIPLookup34pushEiP6Packet+0x112/0x1c0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb3636cf>]
> _ZN15LinearIPFilter24pushEiP6Packet+0x4f/0x3f0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb31e1d1>]
> _ZN14LinearIPLookup4pushEiP6Packet+0x71/0x100 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<f8c5b0fc>]
> crypto_cbc_decrypt_inplace+0xb2/0xd1 [cbc]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb35a344>]
> _ZN14HashMACLookup54pushEiP6Packet+0x304/0x890 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb3515b7>]
> _ZN13HashIPLookup54pushEiP6Packet+0xc7/0x110 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb3636cf>]
> _ZN15LinearIPFilter24pushEiP6Packet+0x4f/0x3f0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb31e1d1>]
> _ZN14LinearIPLookup4pushEiP6Packet+0x71/0x100 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb36b075>]
> _ZN17NtlmLoginDetector4pushEiP6Packet+0x65/0x15d0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb359bc1>]
> _ZN14HashMACLookup514push_extern_ipEP6Packet+0x51/0x4d0 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb35462e>]
> _ZN12HashIPTable24pushEiP6Packet+0x18e/0x580 [click]
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<c0418baf>] __wake_up+0x11/0x1a
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<c059b077>] sock_def_readable+0x26/0x4b
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<c059b454>] sock_queue_rcv_skb+0x102/0x10e
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<c05d4cbb>] __udp_queue_rcv_skb+0x8/0x31
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<c05d639d>] udp_rcv+0x35a/0x44a
> Oct 31 10:47:59 KC-CAS-N1 kernel:  [<fb39c881>]
> _ZN15RecycledSkbPool7recycleEP7sk_buff+0x31/0xf0 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb35a57a>]
> _ZN14HashMACLookup54pushEiP6Packet+0x53a/0x890 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb378fdb>]
> _ZN14PerfigoDiscard4pushEiP6Packet+0x4b/0x1c0 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb30f904>]
> _ZN8IPFilter4pushEiP6Packet+0x64/0xf0 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb33d895>]
> _ZN11ARPQuerier44pushEiP6Packet+0x4c5/0x2370 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb32e21e>]
> _ZN6ToHost4pushEiP6Packet+0xee/0x210 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb37879e>]
> _ZN6Passer4pushEiP6Packet+0x12e/0x860 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb35462e>]
> _ZN12HashIPTable24pushEiP6Packet+0x18e/0x580 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb384674>]
> _ZN11PaintSwitch4pushEiP6Packet+0x44/0xe0 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<c043f334>] __do_IRQ+0x0/0x9f
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<c0405ecc>] do_IRQ+0xb7/0xc3
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<c0411f41>]
> smp_apic_timer_interrupt+0x32/0x45
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<c0411f41>]
> smp_apic_timer_interrupt+0x32/0x45
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb37b516>]
> _ZN10Classifier4pushEiP6Packet+0x76/0xe0 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb2d2806>]
> _ZN7Element4pushEiP6Packet+0x26/0x40 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb3282a5>]
> _ZN10FromDevice8run_taskEP4Task+0xa5/0x120 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb2e9127>]
> _ZN12RouterThread6driverEv+0x177/0x290 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb399822>]
> _Z11click_schedPv+0x82/0x130 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<fb3997a0>]
> _Z11click_schedPv+0x0/0x130 [click]
> Oct 31 10:48:00 KC-CAS-N1 kernel:  [<c0404987>] kernel_thread_helper+0x7/0x10
> _______________________________________________
> kernel mailing list
> kernel at lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/kernel