Kernel panic / unwinder / oops / crash - Linux version 2.6.18-1.2849.fc6

Wed Nov 22 13:06:43 UTC 2006

On Wednesday 22 November 2006 07:14, Tomas Hood wrote:
>Hello.
>
>I need some help. I've just installed Fedora Core 6.  I was running
> Fedora 2 (yeah, it's been a while since I upgraded).
>
>At random times, the system now crashes.  Never crashed, before.
>
>Then, I applied all updates, including the latest Kernel update. The
>computer continues to crash at odd times. Sometimes, the computer will
> run for hours. Sometimes, it will crash quickly.
>
>I have tested memory for six hours (memtest86), no errors. I did several
>different tests using smartctl on the hard drive. No errors.
>
>Below are various logs/dmesg text, traces.
>
>If someone can help, I would greatly appreciate it. This is a server
> that must get back on-line soon. I just don't know where to start
> looking for a fix.
>
>Ok, a lot of stuff in this message. Here goes:
>
>dmesg:
>
>Linux version 2.6.18-1.2849.fc6
> (brewbuilder at hs20-bc1-5.build.redhat.com) (gcc version 4.1.1 20061011
> (Red Hat 4.1.1-30)) #1 SMP Fri Nov 10 12:36:14 EST 2006
>BIOS-provided physical RAM map:
>BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
>BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
>BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
>BIOS-e820: 0000000000100000 - 000000003dff0000 (usable)
>BIOS-e820: 000000003dff0000 - 000000003dff3000 (ACPI NVS)
>BIOS-e820: 000000003dff3000 - 000000003e000000 (ACPI data)
>BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
>95MB HIGHMEM available.
If you have the usual gig of ram in this box, some of it is missing, the 
above figure *should* be 127MB I'd think.
>896MB LOWMEM available.
>found SMP MP-table at 000f5520
>Using x86 segment limits to approximate NX protection
>On node 0 totalpages: 253936
>DMA zone: 4096 pages, LIFO batch:0
>Normal zone: 225280 pages, LIFO batch:31
>HighMem zone: 24560 pages, LIFO batch:3
I have this:
Using x86 segment limits to approximate NX protection
On node 0 totalpages: 262128
  DMA zone: 4096 pages, LIFO batch:0
  Normal zone: 225280 pages, LIFO batch:31
  HighMem zone: 32752 pages, LIFO batch:7

>DMI 2.3 present.
>Using APIC driver default
>IO/L-APIC allowed because system is MP or new enough
>ACPI: RSDP (v000 VIAP4X ) @ 0x000f6d50
>ACPI: RSDT (v001 VIAP4X AWRDACPI 0x42302e31 AWRD 0x00000000) @
> 0x3dff3000 ACPI: FADT (v001 VIAP4X AWRDACPI 0x42302e31 AWRD 0x00000000)
> @ 0x3dff3040 ACPI: MADT (v001 VIAP4X AWRDACPI 0x42302e31 AWRD
> 0x00000000) @ 0x3dff8580 ACPI: DSDT (v001 VIAP4X AWRDACPI 0x00001000
> MSFT 0x0100000d) @ 0x00000000 ACPI: PM-Timer IO Port: 0x408
>ACPI: Local APIC address 0xfee00000
>ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
>Processor #0 15:3 APIC version 20
>ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] disabled)
>ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
>IOAPIC[0]: apic_id 2, version 3, address 0xfec00000, GSI 0-23
>ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
>ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
>ACPI: IRQ0 used by override.
>ACPI: IRQ2 used by override.
>ACPI: IRQ9 used by override.
>Enabling APIC mode: Flat. Using 1 I/O APICs
>Using ACPI (MADT) for SMP configuration information
>Allocating PCI resources starting at 40000000 (gap: 3e000000:c0c00000)
>Detected 2405.783 MHz processor.
>Built 1 zonelists. Total pages: 253936
>Kernel command line: ro root=/dev/VolGroup00/LogVol00
>mapped APIC to ffffd000 (fee00000)
>mapped IOAPIC to ffffc000 (fec00000)
>Enabling fast FPU save and restore... done.
>Enabling unmasked SIMD FPU exception support... done.
>Initializing CPU#0
>CPU 0 irqstacks, hard=c079f000 soft=c077f000
>PID hash table entries: 4096 (order: 12, 16384 bytes)
>Console: colour VGA+ 80x25
>Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
>Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
>Memory: 999780k/1015744k available (2106k kernel code, 15224k reserved,
> 843k data, 240k init, 98240k highmem)
>Checking if this processor honours the WP bit even in supervisor mode...
> Ok. Calibrating delay using timer specific routine.. 4815.07 BogoMIPS
> (lpj=2407537)
>Security Framework v1.0.0 initialized
>SELinux: Initializing.
>SELinux: Starting in permissive mode
>selinux_register_security: Registering secondary module capability
>Capability LSM initialized as secondary
>Mount-cache hash table entries: 512
>CPU: After generic identify, caps: bfebfbff 00000000 00000000 00000000
>0000441d 00000000 00000000
>CPU: After vendor identify, caps: bfebfbff 00000000 00000000 00000000
>0000441d 00000000 00000000
>monitor/mwait feature present.
>using mwait in idle threads.
>CPU: Trace cache: 12K uops, L1 D cache: 16K
>CPU: L2 cache: 256K
>CPU: Hyper-Threading is disabled
>CPU: After all inits, caps: bfebf3ff 00000000 00000000 00000180 0000441d
>00000000 00000000
>Intel machine check architecture supported.
>Intel machine check reporting enabled on CPU#0.
>CPU0: Intel P4/Xeon Extended MCE MSRs (12) available
>Checking 'hlt' instruction... OK.
>SMP alternatives: switching to UP code
>Freeing SMP alternatives: 12k freed
>ACPI: Core revision 20060707
>CPU0: Intel(R) Celeron(R) CPU 2.40GHz stepping 04
>Total of 1 processors activated (4815.07 BogoMIPS).
>ENABLING IO-APIC IRQs
>..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
>Brought up 1 CPUs
>sizeof(vma)=84 bytes
>sizeof(page)=32 bytes
>sizeof(inode)=424 bytes
>sizeof(dentry)=148 bytes
>sizeof(ext3inode)=600 bytes
>sizeof(buffer_head)=52 bytes
>sizeof(skbuff)=172 bytes
>sizeof(task_struct)=1392 bytes
>checking if image is initramfs... it is
>Freeing initrd memory: 2119k freed
>NET: Registered protocol family 16
>ACPI: bus type pci registered
>PCI: PCI BIOS revision 2.10 entry at 0xfb3a0, last bus=1
>PCI: Using configuration type 1
>Setting up standard PCI resources
>ACPI: Interpreter enabled
>ACPI: Using IOAPIC for interrupt routing
>ACPI: PCI Root Bridge [PCI0] (0000:00)
>PCI: Probing PCI hardware (bus 00)
>PCI quirk: region 0400-047f claimed by vt8235 PM
>PCI quirk: region 0500-050f claimed by vt8235 SMB
>Boot video device is 0000:01:00.0
>ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
>ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 6 7 10 *11 12)
>ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 6 7 10 *11 12)
>ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 6 7 10 11 12) *5
>ACPI: PCI Interrupt Link [LNKD] (IRQs *3 4 6 7 10 11 12)
>ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 6 7 10 11 12) *0, disabled.
>ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 6 7 10 11 12) *0, disabled.
>ACPI: PCI Interrupt Link [LNK0] (IRQs 3 4 6 7 10 11 12) *0, disabled.
>ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 6 7 10 11 12) *0, disabled.
>ACPI: PCI Interrupt Link [ALKA] (IRQs *20), disabled.
>ACPI: PCI Interrupt Link [ALKB] (IRQs *21)
>ACPI: PCI Interrupt Link [ALKC] (IRQs *22)
>ACPI: PCI Interrupt Link [ALKD] (IRQs *23)
>Linux Plug and Play Support v0.97 (c) Adam Belay
>pnp: PnP ACPI init
>pnp: PnP ACPI: found 15 devices
>usbcore: registered new driver usbfs
>usbcore: registered new driver hub
>PCI: Using ACPI for IRQ routing
>PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a
>report
>NetLabel: Initializing
>NetLabel: domain hash size = 128
>NetLabel: protocols = UNLABELED CIPSOv4
>NetLabel: unlabeled traffic allowed by default
>pnp: 00:02: ioport range 0x400-0x47f could not be reserved
>pnp: 00:02: ioport range 0x500-0x50f has been reserved
>PCI: Bridge: 0000:00:01.0
>IO window: disabled.
>MEM window: ec000000-edffffff
>PREFETCH window: e0000000-e7ffffff
>PCI: Setting latency timer of device 0000:00:01.0 to 64
>NET: Registered protocol family 2
>IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
>TCP established hash table entries: 131072 (order: 9, 2621440 bytes)
>TCP bind hash table entries: 65536 (order: 8, 1310720 bytes)
>TCP: Hash tables configured (established 131072 bind 65536)
>TCP reno registered
>apm: BIOS version 1.2 Flags 0x07 (Driver version 1.16ac)
>apm: overridden by ACPI.
>audit: initializing netlink socket (disabled)
>audit(1164016986.793:1): initialized
>highmem bounce pool size: 64 pages
>Total HugeTLB memory allocated, 0
>VFS: Disk quotas dquot_6.5.1
>Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
>SELinux: Registering netfilter hooks
>Initializing Cryptographic API
>ksign: Installing public key data
>Loading keyring
>- Added public key 6E10EEA41F0341D3
>- User ID: Red Hat, Inc. (Kernel Module GPG key)
>io scheduler noop registered
>io scheduler anticipatory registered
>io scheduler deadline registered
>io scheduler cfq registered (default)
>ACPI: Fan [FAN] (on)
>ACPI Exception (acpi_processor-0681): AE_NOT_FOUND, Processor Device is
> not present [20060707]
>ACPI: Getting cpuindex for acpiid 0x1
>ACPI: Thermal Zone [THRM] (40 C)
>isapnp: Scanning for PnP cards...
>isapnp: No Plug & Play device found
>Real Time Clock Driver v1.12ac
>Non-volatile memory driver v1.2
>Linux agpgart interface v0.101 (c) Dave Jones
>agpgart: Detected VIA P4M266x/P4N266 chipset
>agpgart: AGP aperture is 64M @ 0xe8000000
>Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
>serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
>00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
>RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
>Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
>ide: Assuming 33MHz system bus speed for PIO modes; override with
> idebus=xx VP_IDE: IDE controller at PCI slot 0000:00:11.1
>ACPI: PCI Interrupt Link [ALKA] disabled and referenced, BIOS bug
>ACPI: PCI Interrupt Link [ALKA] enabled at IRQ 20
>ACPI: PCI Interrupt 0000:00:11.1[A] -> Link [ALKA] -> GSI 20 (level,
> low) -> IRQ 169
>PCI: VIA IRQ fixup for 0000:00:11.1, from 255 to 9
>VP_IDE: chipset revision 6
>VP_IDE: not 100% native mode: will probe irqs later
>VP_IDE: VIA vt8235 (rev 00) IDE UDMA133 controller on pci0000:00:11.1
>ide0: BM-DMA at 0xdc00-0xdc07, BIOS settings: hda:DMA, hdb:pio
>ide1: BM-DMA at 0xdc08-0xdc0f, BIOS settings: hdc:pio, hdd:pio
>Probing IDE interface ide0...
>hda: ST340014A, ATA DISK drive
>ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
>Probing IDE interface ide1...
>Probing IDE interface ide1...
>hda: max request size: 512KiB
>hda: 78165360 sectors (40020 MB) w/2048KiB Cache, CHS=16383/255/63,
>UDMA(100)
>hda: cache flushes supported
>hda: hda1 hda2
>ide-floppy driver 0.99.newide
>usbcore: registered new driver libusual
>usbcore: registered new driver hiddev
>usbcore: registered new driver usbhid
>drivers/usb/input/hid-core.c: v2.6:USB HID core driver
>PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
>serio: i8042 AUX port at 0x60,0x64 irq 12
>serio: i8042 KBD port at 0x60,0x64 irq 1
>mice: PS/2 mouse device common for all mice
>md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
>md: bitmap version 4.39
>TCP bic registered
>Initializing IPsec netlink socket
>NET: Registered protocol family 1
>NET: Registered protocol family 17
>Using IPI No-Shortcut mode
>Time: tsc clocksource has been installed.
>ACPI: (supports S0 S1 S4 S5)
>Freeing unused kernel memory: 240k freed
>Write protecting the kernel read-only data: 370k
>input: AT Translated Set 2 keyboard as /class/input/input0
>logips2pp: Detected unknown logitech mouse model 0
>USB Universal Host Controller Interface driver v3.0
>ACPI: PCI Interrupt Link [ALKB] enabled at IRQ 21
>ACPI: PCI Interrupt 0000:00:10.0[A] -> Link [ALKB] -> GSI 21 (level,
> low) -> IRQ 177
>PCI: VIA IRQ fixup for 0000:00:10.0, from 11 to 1
>uhci_hcd 0000:00:10.0: UHCI Host Controller
>uhci_hcd 0000:00:10.0: new USB bus registered, assigned bus number 1
>uhci_hcd 0000:00:10.0: irq 177, io base 0x0000d000
>usb usb1: configuration #1 chosen from 1 choice
>hub 1-0:1.0: USB hub found
>hub 1-0:1.0: 2 ports detected
>ACPI: PCI Interrupt 0000:00:10.1[B] -> Link [ALKB] -> GSI 21 (level,
> low) -> IRQ 177
>PCI: VIA IRQ fixup for 0000:00:10.1, from 11 to 1
>uhci_hcd 0000:00:10.1: UHCI Host Controller
>uhci_hcd 0000:00:10.1: new USB bus registered, assigned bus number 2
>uhci_hcd 0000:00:10.1: irq 177, io base 0x0000d400
>usb usb2: configuration #1 chosen from 1 choice
>hub 2-0:1.0: USB hub found
>hub 2-0:1.0: 2 ports detected
>ACPI: PCI Interrupt 0000:00:10.2[C] -> Link [ALKB] -> GSI 21 (level,
> low) -> IRQ 177
>PCI: VIA IRQ fixup for 0000:00:10.2, from 5 to 1
>uhci_hcd 0000:00:10.2: UHCI Host Controller
>uhci_hcd 0000:00:10.2: new USB bus registered, assigned bus number 3
>uhci_hcd 0000:00:10.2: irq 177, io base 0x0000d800
>usb usb3: configuration #1 chosen from 1 choice
>hub 3-0:1.0: USB hub found
>hub 3-0:1.0: 2 ports detected
>input: ImPS/2 Logitech Wheel Mouse as /class/input/input1
>ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver
> (PCI) ACPI: PCI Interrupt 0000:00:10.3[D] -> Link [ALKB] -> GSI 21
> (level, low) -> IRQ 177
>PCI: VIA IRQ fixup for 0000:00:10.3, from 3 to 1
>ehci_hcd 0000:00:10.3: EHCI Host Controller
>ehci_hcd 0000:00:10.3: new USB bus registered, assigned bus number 4
>ehci_hcd 0000:00:10.3: irq 177, io mem 0xee000000
>ehci_hcd 0000:00:10.3: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
>usb usb4: configuration #1 chosen from 1 choice
>hub 4-0:1.0: USB hub found
>hub 4-0:1.0: 6 ports detected
>device-mapper: ioctl: 4.7.0-ioctl (2006-06-24) initialised:
>dm-devel at redhat.com
>kjournald starting. Commit interval 5 seconds
>EXT3-fs: mounted filesystem with ordered data mode.
>SELinux: Disabled at runtime.
>SELinux: Unregistering netfilter hooks
>audit(1164016993.852:2): selinux=0 auid=4294967295
>input: PC Speaker as /class/input/input2
>via-rhine.c:v1.10-LK1.4.1 July-24-2006 Written by Donald Becker
>ACPI: PCI Interrupt Link [ALKD] enabled at IRQ 23
>ACPI: PCI Interrupt 0000:00:12.0[A] -> Link [ALKD] -> GSI 23 (level,
> low) -> IRQ 185
>eth0: VIA Rhine II at 0xee001000, 00:11:5b:34:95:14, IRQ 185.
>eth0: MII PHY found at address 1, status 0x786d advertising 05e1 Link
> 45e1. NET: Registered protocol family 23
>ACPI: PCI Interrupt Link [ALKC] enabled at IRQ 22
>ACPI: PCI Interrupt 0000:00:11.5[C] -> Link [ALKC] -> GSI 22 (level,
> low) -> IRQ 193
>PCI: Setting latency timer of device 0000:00:11.5 to 64
>FDC 0 is a post-1991 82077
>parport: PnPBIOS parport detected.
>parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
>lp0: using parport0 (interrupt-driven).
>lp0: console ready
>ACPI: Power Button (FF) [PWRF]
>ACPI: Power Button (CM) [PWRB]
>ACPI: Sleep Button (CM) [SLPB]
>md: Autodetecting RAID arrays.
>md: autorun ...
>md: ... autorun DONE.
>device-mapper: multipath: version 1.0.4 loaded
>EXT3 FS on dm-0, internal journal
>kjournald starting. Commit interval 5 seconds
>EXT3 FS on hda1, internal journal
>EXT3-fs: mounted filesystem with ordered data mode.
>kjournald starting. Commit interval 5 seconds
>EXT3 FS on dm-1, internal journal
>EXT3-fs: mounted filesystem with ordered data mode.
>kjournald starting. Commit interval 5 seconds
>EXT3 FS on dm-2, internal journal
>EXT3-fs: mounted filesystem with ordered data mode.
>kjournald starting. Commit interval 5 seconds
>EXT3 FS on dm-3, internal journal
>EXT3-fs: mounted filesystem with ordered data mode.
>kjournald starting. Commit interval 5 seconds
>EXT3 FS on dm-4, internal journal
>EXT3-fs: mounted filesystem with ordered data mode.
>Adding 2031608k swap on /dev/VolGroup00/LogVol01. Priority:-1 extents:1
>across:2031608k
>
>== end of dmesg

Humm, an SMP enabled kernel on a single cpu...

>Crash traces:
>
>Message from syslogd at helios at Sun Nov 19 22:45:13 2006 ...
>helios kernel: Oops: 0002 [#1]
>helios kernel: SMP
>helios kernel: CPU: 0
>helios kernel: EIP is at 0xf17dcfb0
>helios kernel: eax: 00000080 ebx: 00000000 ecx: f17dc000 edx: f17f16b0
>helios kernel: esi: 00200286 edi: f17dcc10 ebp: 009ee692 esp: f17dcbfc
>helios kernel: ds: 007b es: 007b ss: 0068
>helios kernel: Process pop3-login (pid: 2722, ti=f17dc000 task=f17f16b0
>task.ti=f17dc000)
>helios kernel: Stack: 00000000 c060aefd 00200246 f17dcc58 c05d4aa2
> 00000000 00200200 009ee692
>helios kernel: c04297b5 f17f16b0 c07ece00 00000000 00000000 c047bba0
>f17dcfb0 094335a0
>helios kernel: 094335c8 00000000 f17dce98 f17dce98 f17dce98 f17dcec8
>f17dcc58 c047c603
>helios kernel: Call Trace:
>helios kernel: Inexact backtrace:
>helios kernel: [] schedule_timeout+0x79/0x98
>helios kernel: [] tcp_poll+0x19/0x117
>helios kernel: [] process_timeout+0x0/0x5
>helios kernel: [] do_sys_poll+0x26a/0x33f
>helios kernel: [] __pollwait+0x0/0xb2
>helios kernel: [] default_wake_function+0x0/0xc
>helios last message repeated 4 times
>helios kernel: [] __activate_task+0x1c/0x29
>helios kernel: [] try_to_wake_up+0x3b5/0x3bf
>helios kernel: [] unix_stream_sendmsg+0x22f/0x2f9
>helios kernel: [] __wake_up_common+0x2f/0x53
>helios kernel: [] __wake_up+0x2a/0x3d
>helios kernel: [] unix_write_space+0x4a/0x74
>helios kernel: [] sock_wfree+0x21/0x36
>helios kernel: [] skb_dequeue+0x39/0x3f
>helios kernel: [] unix_stream_recvmsg+0x3a2/0x4c3
>helios kernel: [] do_sock_read+0xba/0xc2
>helios kernel: [] sock_aio_read+0x5e/0x6a
>helios kernel: [] do_IRQ+0xb0/0xbc
>helios kernel: [] do_IRQ+0xb0/0xbc
>helios kernel: [] common_interrupt+0x1a/0x20
>helios kernel: [] audit_syscall_entry+0x11c/0x144
>helios kernel: [] sys_poll+0x3b/0x3e
>helios kernel: [] syscall_call+0x7/0xb
>helios kernel: =======================
>helios kernel: Code: 4e 61 45 b2 77 99 31 e7 03 00 00 05 00 00 00 bc cf
> 7d f1 00 00 00 00 a0 35 43 09 46 4e ee bf f4 ef 24 4b 00 c0 7d f1 b0 bc
> 47 c0 00 00 00 00 00 00 00 27 40 40 c0 a0 35 43 09 05 00 00 00 e7
>helios kernel: EIP: [] 0xf17dcfb0 SS:ESP 0068:f17dcbfc
>
>Now, more details:
>
>Nov 19 22:39:58 helios kernel: klogd 1.4.1, log source = /proc/kmsg
> started. Nov 19 22:45:13 helios kernel: BUG: unable to handle kernel
> NULL pointer dereference at virtual address 00000080
>Nov 19 22:45:13 helios kernel: printing eip:
>Nov 19 22:45:13 helios kernel: f17dcfb0
>Nov 19 22:45:13 helios kernel: *pde = 31118067
>Nov 19 22:45:13 helios kernel: Oops: 0002 [#1]
>Nov 19 22:45:13 helios kernel: SMP
>Nov 19 22:45:13 helios kernel: last sysfs file:
>/devices/platform/i2c-9191/9191-0290/temp3_max
>Nov 19 22:45:13 helios kernel: Modules linked in: autofs4 it87 hwmon_vid
>hwmon eeprom i2c_isa tun sunrpc ipv6 freq_table dm_multipath v$
>Nov 19 22:45:13 helios kernel: CPU: 0
>Nov 19 22:45:13 helios kernel: EIP: 0060:[] Not tainted VLI
>Nov 19 22:45:13 helios kernel: EFLAGS: 00210246 (2.6.18-1.2849.fc6 #1)
>Nov 19 22:45:13 helios kernel: EIP is at 0xf17dcfb0
>Nov 19 22:45:13 helios kernel: eax: 00000080 ebx: 00000000 ecx: f17dc000
>edx: f17f16b0
>Nov 19 22:45:13 helios kernel: esi: 00200286 edi: f17dcc10 ebp: 009ee692
>esp: f17dcbfc
>Nov 19 22:45:13 helios kernel: ds: 007b es: 007b ss: 0068
>Nov 19 22:45:13 helios kernel: Process pop3-login (pid: 2722,
> ti=f17dc000 task=f17f16b0 task.ti=f17dc000)
>Nov 19 22:45:13 helios kernel: Stack: 00000000 c060aefd 00200246
> f17dcc58 c05d4aa2 00000000 00200200 009ee692
>Nov 19 22:45:13 helios kernel: c04297b5 f17f16b0 c07ece00 00000000
> 00000000 c047bba0 f17dcfb0 094335a0
>Nov 19 22:45:13 helios kernel: 094335c8 00000000 f17dce98 f17dce98
> f17dce98 f17dcec8 f17dcc58 c047c603
>Nov 19 22:45:13 helios kernel: Call Trace:
>Nov 19 22:45:13 helios kernel: Inexact backtrace:
>Nov 19 22:45:13 helios kernel: [] schedule_timeout+0x79/0x98
>Nov 19 22:45:13 helios kernel: [] tcp_poll+0x19/0x117
>Nov 19 22:45:13 helios kernel: [] process_timeout+0x0/0x5
>Nov 19 22:45:13 helios kernel: [] do_sys_poll+0x26a/0x33f
>Nov 19 22:45:13 helios kernel: [] __pollwait+0x0/0xb2
>Nov 19 22:45:13 helios kernel: [] default_wake_function+0x0/0xc
>Nov 19 22:45:13 helios last message repeated 4 times
>Nov 19 22:45:13 helios kernel: [] __activate_task+0x1c/0x29
>Nov 19 22:45:13 helios kernel: [] try_to_wake_up+0x3b5/0x3bf
>Nov 19 22:45:13 helios kernel: [] unix_stream_sendmsg+0x22f/0x2f9
>Nov 19 22:45:13 helios kernel: [] __wake_up_common+0x2f/0x53
>Nov 19 22:45:13 helios kernel: [] __wake_up+0x2a/0x3d
>Nov 19 22:45:13 helios kernel: [] unix_write_space+0x4a/0x74
>Nov 19 22:45:13 helios kernel: [] sock_wfree+0x21/0x36
>Nov 19 22:45:13 helios kernel: [] skb_dequeue+0x39/0x3f
>Nov 19 22:45:13 helios kernel: [] unix_stream_recvmsg+0x3a2/0x4c3
>Nov 19 22:45:13 helios kernel: [] skb_dequeue+0x39/0x3f
>Nov 19 22:45:13 helios kernel: [] unix_stream_recvmsg+0x3a2/0x4c3
>Nov 19 22:45:13 helios kernel: [] do_sock_read+0xba/0xc2
>Nov 19 22:45:13 helios kernel: [] sock_aio_read+0x5e/0x6a
>Nov 19 22:45:13 helios kernel: [] do_IRQ+0xb0/0xbc
>Nov 19 22:45:13 helios kernel: [] do_IRQ+0xb0/0xbc
>Nov 19 22:45:13 helios kernel: [] common_interrupt+0x1a/0x20
>Nov 19 22:45:13 helios kernel: [] audit_syscall_entry+0x11c/0x144
>Nov 19 22:45:13 helios kernel: [] sys_poll+0x3b/0x3e
>Nov 19 22:45:13 helios kernel: [] syscall_call+0x7/0xb
>Nov 19 22:45:13 helios kernel: =======================
>Nov 19 22:45:13 helios kernel: Code: 4e 61 45 b2 77 99 31 e7 03 00 00 05
> 00 00 00 bc cf 7d f1 00 00 00 00 a0 35 43 09 46 4e ee bf f4 ef$
>Nov 19 22:45:13 helios kernel: EIP: [] 0xf17dcfb0 SS:ESP 0068:f17dcbfc
>
>Then, these:
>
>First, no log traces, but the console has:
>
>Eflags: 00010287 (2.6.18-1.2849.fc6 #1)
>EIP is at 0xb13f4ec0
>...
>Code: Bad EIP value.
>EIP: [] 0xb13f4ec0 SS:ESP 0068:c077ffb1
>Kernel panic - not syncing: Fatal Exception in interrupt
>
>Second, just as I write this, it crashed again.
>
>Here is the trace:
>
>Message from syslogd at helios at Mon Nov 20 12:12:03 2006 ...
>helios kernel: Oops: 0002 [#1]
>helios kernel: SMP
>helios kernel: CPU: 0
>helios kernel: EIP is at 0xef138fb0
>helios kernel: eax: 00000080 ebx: 00000000 ecx: ef138000 edx: ef147630
>helios kernel: esi: 00200286 edi: ef138c10 ebp: 000122bf esp: ef138bfc
>helios kernel: ds: 007b es: 007b ss: 0068
>helios kernel: Process imap-login (pid: 2789, ti=ef138000 task=ef147630
>task.ti=ef138000)
>helios kernel: Stack: 00000000 c060aefd 00200246 ef138c58 c05d4aa2
> 00000000 00200200 000122bf
>helios kernel: c04297b5 ef147630 c07ece00 00000000 00000000 c047bba0
>ef138fb0 096ef5a0
>helios kernel: 096ef5c8 00000000 ef138e98 ef138e98 ef138e98 ef138ec8
>ef138c58 c047c603
>helios kernel: Call Trace:
>helios kernel: Inexact backtrace:
>helios kernel: [] schedule_timeout+0x79/0x98
>helios kernel: [] tcp_poll+0x19/0x117
>helios kernel: [] process_timeout+0x0/0x5
>helios kernel: [] do_sys_poll+0x26a/0x33f
>helios kernel: [] __pollwait+0x0/0xb2
>helios kernel: [] default_wake_function+0x0/0xc
>helios last message repeated 4 times
>helios kernel: [] __activate_task+0x1c/0x29
>helios kernel: [] try_to_wake_up+0x3b5/0x3bf
>helios kernel: [] unix_stream_sendmsg+0x22f/0x2f9
>helios kernel: [] __wake_up_common+0x2f/0x53
>helios kernel: [] __wake_up+0x2a/0x3d
>helios kernel: [] unix_write_space+0x4a/0x74
>helios kernel: [] sock_wfree+0x21/0x36
>helios kernel: [] skb_dequeue+0x39/0x3f
>helios kernel: [] unix_stream_recvmsg+0x3a2/0x4c3
>helios kernel: [] do_sock_read+0xba/0xc2
>helios kernel: [] sock_aio_read+0x5e/0x6a
>helios kernel: [] _spin_unlock_irq+0x5/0x7
>helios kernel: [] mark_page_accessed+0x1c/0x30
>helios kernel: [] _spin_unlock_irq+0x5/0x7
>helios kernel: [] schedule+0x95f/0x9dc
>helios kernel: [] audit_syscall_entry+0x11c/0x144
>helios kernel: [] sys_poll+0x3b/0x3e
>helios kernel: [] syscall_call+0x7/0xb
>helios kernel: =======================
>helios kernel: Code: 0c 62 45 4e f3 ae 02 e7 03 00 00 05 00 00 00 bc 8f
> 13 ef 00 00 00 00 a0 f5 6e 09 33 de bd bf f4 ef 24 4b 00 80 13 ef b0 bc
> 47 c0 00 00 00 00 00 00 00 27 40 40 c0 a0 f5 6e 09 05 00 00 00 e7
>helios kernel: EIP: [] 0xef138fb0 SS:ESP 0068:ef138bfc
>
>Ideas? I sure hope that this is enough to begin figuring out what I
> should do to fix this.
>
>Thanks,

I'm not smart enough to go any farther so my reply is probably noise, but 
the missing memory was a big red flag to me.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2006 by Maurice Eugene Heskett, all rights reserved.