I've been seeing a kernel panic on shutdown/reboot with Fedora 23. While it occurs after disks are finalized, it may prevent restarts from occurring on reboot. Any ideas how to address this?
Hardware is Beagleboard XM rev B. Fedora 23 has been quite stable otherwise.
Kernel: 4.2.6-301.fc23.armv7hl
Partial root console reboot log:
[ OK ] Reached target Shutdown. [ 541.573730] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 541.612640] systemd-journald[548]: Received SIGTERM from PID 1 (systemd-shutdow). [ 541.962524] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 541.999023] systemd-shutdown[1]: Hardware watchdog 'TWL4030 Watchdog', version 0 [ 542.009063] systemd-shutdown[1]: Unmounting file systems. [ 542.081481] EXT4-fs (mmcblk0p4): re-mounted. Opts: (null) [ 542.118041] EXT4-fs (mmcblk0p4): re-mounted. Opts: (null) [ 542.124084] systemd-shutdown[1]: All filesystems unmounted. [ 542.130157] systemd-shutdown[1]: Deactivating swaps. [ 542.136535] systemd-shutdown[1]: All swaps deactivated. [ 542.142272] systemd-shutdown[1]: Detaching loop devices. [ 542.153656] systemd-shutdown[1]: All loop devices detached. [ 542.159790] systemd-shutdown[1]: Detaching DM devices. [ 542.166412] systemd-shutdown[1]: All DM devices detached. [ 542.312774] systemd-shutdown[1]: Rebooting. [ 542.317779] Unable to handle kernel paging request at virtual address e52de004 [ 542.325347] pgd = d4298000 [ 542.328186] [e52de004] *pgd=00000000 [ 542.331939] Internal error: Oops: 5 [#1] SMP ARM [ 542.336791] Modules linked in: ccm tun bridge stp llc bnep arc4 rt2800usb rt2x00usb rt2800lib rt2x00lib mac80211 cfg80211 smsc95xx crc_ccitt usbnet mii btusb btrtl btbcm btintel bluetooth rfkill snd_soc_omap_twl4030 vfat fat leds_pwm leds_gpio cpufreq_dt snd_soc_omap_mcbsp snd_soc_twl4030 snd_soc_omap omap_wdt snd_soc_core snd_compress snd_pcm_dmaengine ac97_bus omap_hdq snd_seq omap_aes omap_sham snd_seq_device phy_twl4030_usb wire spi_omap2_mcspi omap2430 snd_pcm omap_mailbox twl4030_wdt musb_hdrc gpio_twl4030 udc_core phy_omap_control snd_timer snd soundcore twl4030_pwrbutton twl4030_madc industrialio twl4030_charger 8250_omap nfsd mmc_block omapdrm fb_sys_fops drm_kms_helper syscopyarea sysfillrect sysimgblt drm phy_generic gpio_keys encoder_tfp410 connector_analog_tv connector_dvi ti_abb_regulator omap_hsmmc mmc_core pwm_twl_led pwm_twl twl4030_keypad ohci_omap3 omapdss ehci_omap omap_dma pbias_regulator [last unloaded: iptable_raw] [ 542.424377] CPU: 0 PID: 1 Comm: systemd-shutdow Not tainted 4.2.6-301.fc23.armv7hl #1 [ 542.432586] Hardware name: Generic OMAP36xx (Flattened Device Tree) [ 542.439147] task: d6118000 ti: d60d2000 task.ti: d60d2000 [ 542.444824] PC is at strnlen+0x10/0x2c [ 542.448760] LR is at string+0x30/0xd8 [ 542.452575] pc : [<c0527628>] lr : [<c0528484>] psr: 200b0013 [ 542.452575] sp : d60d3cc0 ip : 0000003d fp : 00000080 [ 542.464599] r10: d60d3d38 r9 : c0b45730 r8 : d60d3cf0 [ 542.470092] r7 : d60d3dc0 r6 : e52de004 r5 : 0000ffff r4 : d60d3d4a [ 542.476928] r3 : e52de004 r2 : e52de004 r1 : e52de003 r0 : e52de004 [ 542.483764] Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user [ 542.491241] Control: 10c5387d Table: 9c298019 DAC: 00000015 [ 542.497253] Process systemd-shutdow (pid: 1, stack limit = 0xd60d2220) [ 542.504089] Stack: (0xd60d3cc0 to 0xd60d4000) [ 542.508666] 3cc0: d60d3d34 d60d3d4a d60d3dc0 d60d3d40 d60d3cf0 c0529f0c d60d3dc0 ff0a0004 [ 542.517242] 3ce0: ffffffff d7b3fcd4 00000000 0000000a ff0a0004 ffffffff 00000035 d3f40000 [ 542.525817] 3d00: d3f40000 00000006 c0b46ca2 d60d3dfc e52de004 d41be444 00000000 c052a5cc [ 542.534393] 3d20: d60d3d40 d60d3d34 c0b45724 c061a80c c0b45724 e52de004 0000bcd0 00000000 [ 542.542968] 3d40: 53425553 45545359 c0d43d4d 00000000 00000000 c0d4b648 00000035 d601fc00 [ 542.551544] 3d60: c0e6baf0 c0297b6c 00000000 00000000 c0d4b648 c0297b6c 00000025 c0f1507c [ 542.560119] 3d80: c0f1507c d60d3da8 c0dd6ae0 c02095c0 c0296534 600b0013 d7b46178 d7b461b0 [ 542.568695] 3da0: d7b461b0 00000001 200b0013 c02bcb64 d60d3dc0 00000001 00000000 c02bccfc [ 542.577270] 3dc0: 00000000 d3f40000 00000006 d60d3e20 d6231210 c0e5ac60 c0f1cd24 d41be444 [ 542.585815] 3de0: 00000000 c061a968 00000006 d60d3dfc c0b46ca2 c061a9c8 c0b46ca2 e52de004 [ 542.594390] 3e00: 00200200 d60d3e20 d3f40200 d3f402e0 c0f1cd24 c061ac84 d3f40000 d60d3e30 [ 542.602966] 3e20: c0b8982e d60d3e1c c06a4984 c0b8982e 00000000 02eaebb3 d3f40200 02eaebb3 [ 542.611541] 3e40: d3f6a018 d41be410 c0f1cd24 bf26b37c d41be410 d41be410 c0f1cd24 c061ff68 [ 542.620117] 3e60: d41be41c c061c2d0 00000000 4321fedc c0d7f1e8 9c5fbc00 00000000 d60d2000 [ 542.628692] 3e80: 00000000 c0268c4c 01234567 c0268fa0 00000000 c02782cc d611a748 d611a700 [ 542.637268] 3ea0: d611a748 d7b43180 00000000 d611a748 d611a750 c02782f4 00000000 00000000 [ 542.645843] 3ec0: d632a028 00000002 d3d70c00 0000b7af d611a748 d7b43140 d611a700 d611a748 [ 542.654418] 3ee0: d7b43180 00000000 d61183dc d3d70c00 d7b43180 c027e1c8 d3db39c0 00000000 [ 542.662994] 3f00: 00000000 c08d89d4 00000000 c0267704 ffffffff 00000000 00000002 00000001 [ 542.671569] 3f20: d6134018 d6118000 d7b43140 d611a700 d3f54e00 00000000 0000007e 00000000 [ 542.680145] 3f40: d60d3f8c c08d89d4 fffffffe d6492000 ffffff9c c020fb24 d3db39c0 c0d528a0 [ 542.688720] 3f60: c08d8cd4 16df6000 c020fb24 d60d2000 d60d2000 d60d3fb0 00000092 c020fb24 [ 542.697296] 3f80: d60d2000 00000000 d60d3f9c c08d8cd4 00000000 81267188 00000000 00000058 [ 542.705871] 3fa0: c020fb24 c020f9a0 00000000 81267188 fee1dead 28121969 01234567 9c5fbc00 [ 542.714447] 3fc0: 00000000 81267188 00000000 00000058 00000000 00000000 81267040 00000000 [ 542.723022] 3fe0: 7f5e9e58 be98996c 7f5cf554 b6df0910 600b0010 fee1dead 10002000 80800000 [ 542.731597] [<c0527628>] (strnlen) from [<c0528484>] (string+0x30/0xd8) [ 542.738555] [<c0528484>] (string) from [<c0529f0c>] (vsnprintf+0x1ac/0x308) [ 542.745849] [<c0529f0c>] (vsnprintf) from [<c052a5cc>] (snprintf+0x18/0x28) [ 542.753173] [<c052a5cc>] (snprintf) from [<c061a80c>] (dev_vprintk_emit+0x54/0x190) [ 542.761199] [<c061a80c>] (dev_vprintk_emit) from [<c061a968>] (dev_printk_emit+0x20/0x30) [ 542.769775] [<c061a968>] (dev_printk_emit) from [<c061a9c8>] (__dev_printk+0x50/0x74) [ 542.777984] [<c061a9c8>] (__dev_printk) from [<c061ac84>] (_dev_info+0x38/0x4c) [ 542.785675] [<c061ac84>] (_dev_info) from [<c06a4984>] (usb_remove_hcd+0x2c/0x20c) [ 542.793670] [<c06a4984>] (usb_remove_hcd) from [<bf26b37c>] (musb_shutdown+0x24/0xa8 [musb_hdrc]) [ 542.803039] [<bf26b37c>] (musb_shutdown [musb_hdrc]) from [<c061ff68>] (platform_drv_shutdown+0x20/0x30) [ 542.812988] [<c061ff68>] (platform_drv_shutdown) from [<c061c2d0>] (device_shutdown+0x138/0x198) [ 542.822204] [<c061c2d0>] (device_shutdown) from [<c0268c4c>] (kernel_restart+0x14/0x58) [ 542.830596] [<c0268c4c>] (kernel_restart) from [<c0268fa0>] (SyS_reboot+0x1a0/0x20c) [ 542.838745] [<c0268fa0>] (SyS_reboot) from [<c020f9a0>] (ret_fast_syscall+0x0/0x3c) [ 542.846771] Code: e0801001 e1a03000 e1530001 0a000004 (e5d32000) [ 542.853149] ---[ end trace 2571f12eb4a86403 ]--- [ 542.862670] Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b [ 542.862670] [ 542.872222] drm_kms_helper: panic occurred, switching back to text console [ 542.879455] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b [ 542.879455]
Hi Scott,
----- Original Message -----
I've been seeing a kernel panic on shutdown/reboot with Fedora 23. While it occurs after disks are finalized, it may prevent restarts from occurring on reboot. Any ideas how to address this?
Hardware is Beagleboard XM rev B. Fedora 23 has been quite stable otherwise.
Seems to affect the Panda and Beagle* on 4.2, but appears to be resolved in 4.3 (and 4.4) which should make its way to F23 soon.
If you'd like to try it out, you can download from koji[1], let us know how it goes.
Paul
[1] - http://koji.fedoraproject.org/koji/buildinfo?buildID=695636
Kernel: 4.2.6-301.fc23.armv7hl
Partial root console reboot log:
[ OK ] Reached target Shutdown. [ 541.573730] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 541.612640] systemd-journald[548]: Received SIGTERM from PID 1 (systemd-shutdow). [ 541.962524] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 541.999023] systemd-shutdown[1]: Hardware watchdog 'TWL4030 Watchdog', version 0 [ 542.009063] systemd-shutdown[1]: Unmounting file systems. [ 542.081481] EXT4-fs (mmcblk0p4): re-mounted. Opts: (null) [ 542.118041] EXT4-fs (mmcblk0p4): re-mounted. Opts: (null) [ 542.124084] systemd-shutdown[1]: All filesystems unmounted. [ 542.130157] systemd-shutdown[1]: Deactivating swaps. [ 542.136535] systemd-shutdown[1]: All swaps deactivated. [ 542.142272] systemd-shutdown[1]: Detaching loop devices. [ 542.153656] systemd-shutdown[1]: All loop devices detached. [ 542.159790] systemd-shutdown[1]: Detaching DM devices. [ 542.166412] systemd-shutdown[1]: All DM devices detached. [ 542.312774] systemd-shutdown[1]: Rebooting. [ 542.317779] Unable to handle kernel paging request at virtual address e52de004 [ 542.325347] pgd = d4298000 [ 542.328186] [e52de004] *pgd=00000000 [ 542.331939] Internal error: Oops: 5 [#1] SMP ARM [ 542.336791] Modules linked in: ccm tun bridge stp llc bnep arc4 rt2800usb rt2x00usb rt2800lib rt2x00lib mac80211 cfg80211 smsc95xx crc_ccitt usbnet mii btusb btrtl btbcm btintel bluetooth rfkill snd_soc_omap_twl4030 vfat fat leds_pwm leds_gpio cpufreq_dt snd_soc_omap_mcbsp snd_soc_twl4030 snd_soc_omap omap_wdt snd_soc_core snd_compress snd_pcm_dmaengine ac97_bus omap_hdq snd_seq omap_aes omap_sham snd_seq_device phy_twl4030_usb wire spi_omap2_mcspi omap2430 snd_pcm omap_mailbox twl4030_wdt musb_hdrc gpio_twl4030 udc_core phy_omap_control snd_timer snd soundcore twl4030_pwrbutton twl4030_madc industrialio twl4030_charger 8250_omap nfsd mmc_block omapdrm fb_sys_fops drm_kms_helper syscopyarea sysfillrect sysimgblt drm phy_generic gpio_keys encoder_tfp410 connector_analog_tv connector_dvi ti_abb_regulator omap_hsmmc mmc_core pwm_twl_led pwm_twl twl4030_keypad ohci_omap3 omapdss ehci_omap omap_dma pbias_regulator [last unloaded: iptable_raw] [ 542.424377] CPU: 0 PID: 1 Comm: systemd-shutdow Not tainted 4.2.6-301.fc23.armv7hl #1 [ 542.432586] Hardware name: Generic OMAP36xx (Flattened Device Tree) [ 542.439147] task: d6118000 ti: d60d2000 task.ti: d60d2000 [ 542.444824] PC is at strnlen+0x10/0x2c [ 542.448760] LR is at string+0x30/0xd8 [ 542.452575] pc : [<c0527628>] lr : [<c0528484>] psr: 200b0013 [ 542.452575] sp : d60d3cc0 ip : 0000003d fp : 00000080 [ 542.464599] r10: d60d3d38 r9 : c0b45730 r8 : d60d3cf0 [ 542.470092] r7 : d60d3dc0 r6 : e52de004 r5 : 0000ffff r4 : d60d3d4a [ 542.476928] r3 : e52de004 r2 : e52de004 r1 : e52de003 r0 : e52de004 [ 542.483764] Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user [ 542.491241] Control: 10c5387d Table: 9c298019 DAC: 00000015 [ 542.497253] Process systemd-shutdow (pid: 1, stack limit = 0xd60d2220) [ 542.504089] Stack: (0xd60d3cc0 to 0xd60d4000) [ 542.508666] 3cc0: d60d3d34 d60d3d4a d60d3dc0 d60d3d40 d60d3cf0 c0529f0c d60d3dc0 ff0a0004 [ 542.517242] 3ce0: ffffffff d7b3fcd4 00000000 0000000a ff0a0004 ffffffff 00000035 d3f40000 [ 542.525817] 3d00: d3f40000 00000006 c0b46ca2 d60d3dfc e52de004 d41be444 00000000 c052a5cc [ 542.534393] 3d20: d60d3d40 d60d3d34 c0b45724 c061a80c c0b45724 e52de004 0000bcd0 00000000 [ 542.542968] 3d40: 53425553 45545359 c0d43d4d 00000000 00000000 c0d4b648 00000035 d601fc00 [ 542.551544] 3d60: c0e6baf0 c0297b6c 00000000 00000000 c0d4b648 c0297b6c 00000025 c0f1507c [ 542.560119] 3d80: c0f1507c d60d3da8 c0dd6ae0 c02095c0 c0296534 600b0013 d7b46178 d7b461b0 [ 542.568695] 3da0: d7b461b0 00000001 200b0013 c02bcb64 d60d3dc0 00000001 00000000 c02bccfc [ 542.577270] 3dc0: 00000000 d3f40000 00000006 d60d3e20 d6231210 c0e5ac60 c0f1cd24 d41be444 [ 542.585815] 3de0: 00000000 c061a968 00000006 d60d3dfc c0b46ca2 c061a9c8 c0b46ca2 e52de004 [ 542.594390] 3e00: 00200200 d60d3e20 d3f40200 d3f402e0 c0f1cd24 c061ac84 d3f40000 d60d3e30 [ 542.602966] 3e20: c0b8982e d60d3e1c c06a4984 c0b8982e 00000000 02eaebb3 d3f40200 02eaebb3 [ 542.611541] 3e40: d3f6a018 d41be410 c0f1cd24 bf26b37c d41be410 d41be410 c0f1cd24 c061ff68 [ 542.620117] 3e60: d41be41c c061c2d0 00000000 4321fedc c0d7f1e8 9c5fbc00 00000000 d60d2000 [ 542.628692] 3e80: 00000000 c0268c4c 01234567 c0268fa0 00000000 c02782cc d611a748 d611a700 [ 542.637268] 3ea0: d611a748 d7b43180 00000000 d611a748 d611a750 c02782f4 00000000 00000000 [ 542.645843] 3ec0: d632a028 00000002 d3d70c00 0000b7af d611a748 d7b43140 d611a700 d611a748 [ 542.654418] 3ee0: d7b43180 00000000 d61183dc d3d70c00 d7b43180 c027e1c8 d3db39c0 00000000 [ 542.662994] 3f00: 00000000 c08d89d4 00000000 c0267704 ffffffff 00000000 00000002 00000001 [ 542.671569] 3f20: d6134018 d6118000 d7b43140 d611a700 d3f54e00 00000000 0000007e 00000000 [ 542.680145] 3f40: d60d3f8c c08d89d4 fffffffe d6492000 ffffff9c c020fb24 d3db39c0 c0d528a0 [ 542.688720] 3f60: c08d8cd4 16df6000 c020fb24 d60d2000 d60d2000 d60d3fb0 00000092 c020fb24 [ 542.697296] 3f80: d60d2000 00000000 d60d3f9c c08d8cd4 00000000 81267188 00000000 00000058 [ 542.705871] 3fa0: c020fb24 c020f9a0 00000000 81267188 fee1dead 28121969 01234567 9c5fbc00 [ 542.714447] 3fc0: 00000000 81267188 00000000 00000058 00000000 00000000 81267040 00000000 [ 542.723022] 3fe0: 7f5e9e58 be98996c 7f5cf554 b6df0910 600b0010 fee1dead 10002000 80800000 [ 542.731597] [<c0527628>] (strnlen) from [<c0528484>] (string+0x30/0xd8) [ 542.738555] [<c0528484>] (string) from [<c0529f0c>] (vsnprintf+0x1ac/0x308) [ 542.745849] [<c0529f0c>] (vsnprintf) from [<c052a5cc>] (snprintf+0x18/0x28) [ 542.753173] [<c052a5cc>] (snprintf) from [<c061a80c>] (dev_vprintk_emit+0x54/0x190) [ 542.761199] [<c061a80c>] (dev_vprintk_emit) from [<c061a968>] (dev_printk_emit+0x20/0x30) [ 542.769775] [<c061a968>] (dev_printk_emit) from [<c061a9c8>] (__dev_printk+0x50/0x74) [ 542.777984] [<c061a9c8>] (__dev_printk) from [<c061ac84>] (_dev_info+0x38/0x4c) [ 542.785675] [<c061ac84>] (_dev_info) from [<c06a4984>] (usb_remove_hcd+0x2c/0x20c) [ 542.793670] [<c06a4984>] (usb_remove_hcd) from [<bf26b37c>] (musb_shutdown+0x24/0xa8 [musb_hdrc]) [ 542.803039] [<bf26b37c>] (musb_shutdown [musb_hdrc]) from [<c061ff68>] (platform_drv_shutdown+0x20/0x30) [ 542.812988] [<c061ff68>] (platform_drv_shutdown) from [<c061c2d0>] (device_shutdown+0x138/0x198) [ 542.822204] [<c061c2d0>] (device_shutdown) from [<c0268c4c>] (kernel_restart+0x14/0x58) [ 542.830596] [<c0268c4c>] (kernel_restart) from [<c0268fa0>] (SyS_reboot+0x1a0/0x20c) [ 542.838745] [<c0268fa0>] (SyS_reboot) from [<c020f9a0>] (ret_fast_syscall+0x0/0x3c) [ 542.846771] Code: e0801001 e1a03000 e1530001 0a000004 (e5d32000) [ 542.853149] ---[ end trace 2571f12eb4a86403 ]--- [ 542.862670] Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b [ 542.862670] [ 542.872222] drm_kms_helper: panic occurred, switching back to text console [ 542.879455] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b [ 542.879455] _______________________________________________ arm mailing list arm@lists.fedoraproject.org http://lists.fedoraproject.org/admin/lists/arm@lists.fedoraproject.org
On Mon, Dec 7, 2015 at 4:23 PM, Scott M. Jones scott@aprr.org wrote:
I've been seeing a kernel panic on shutdown/reboot with Fedora 23. While it occurs after disks are finalized, it may prevent restarts from occurring on reboot. Any ideas how to address this?
[ 542.793670] [<c06a4984>] (usb_remove_hcd) from [<bf26b37c>] (musb_shutdown+0x24/0xa8 [musb_hdrc]) [ 542.803039] [<bf26b37c>] (musb_shutdown [musb_hdrc]) from [<c061ff68>] (platform_drv_shutdown+0x20/0x30)
Looks like a crash in the musb_hdrc module. We should get 4.3.x shortly (once a new one is released upstream). You could try removing the module before shutdown/reboot.
Peter
On Wed, Dec 9, 2015 at 7:09 AM, Peter Robinson pbrobinson@gmail.com wrote:
On Mon, Dec 7, 2015 at 4:23 PM, Scott M. Jones scott@aprr.org wrote:
I've been seeing a kernel panic on shutdown/reboot with Fedora 23. While it occurs after disks are finalized, it may prevent restarts from occurring on reboot. Any ideas how to address this?
[ 542.793670] [<c06a4984>] (usb_remove_hcd) from [<bf26b37c>] (musb_shutdown+0x24/0xa8 [musb_hdrc]) [ 542.803039] [<bf26b37c>] (musb_shutdown [musb_hdrc]) from [<c061ff68>] (platform_drv_shutdown+0x20/0x30)
Looks like a crash in the musb_hdrc module. We should get 4.3.x shortly (once a new one is released upstream). You could try removing the module before shutdown/reboot.
This might be the fix
-
Paul Whalen -
Peter Robinson -
Scott M. Jones