RAID1 /dev/md4 lost one disk partion /dev/sdb4 after reboot, WHY??

[L]

On Mon, Mar 30, 2009 at 3:52 AM, Bruno Wolff III <bruno at wolff.to> wrote:
> On Sun, Mar 29, 2009 at 20:15:53 +1100,
>  L <yuanlux at gmail.com> wrote:
>>
>> this partition is about 455GB, there is no IO error from log.
>
> I would suggest looking through /var/log/messages to see if you see any
> references to the array or partition and check if any of them shed some
> light on what is going on.
>
> It's possible there could be a bug of some sort as well.
>
> For example mdadm has got some issues in rawhide right now. Though I am
> not aware of any problems in F9 or F10.
>

Bruno,
below is the output from dmesg. as you see, when generation /dev/md4,
partition /dev/sdb4 as undetected at all. I did  curious tests (--fail
--remove; reboot; then --add; reboot) on

/dev/sdb3 on /dev/md3
/dev/sdb2 on /dev/md2
/dev/sdb1 on /dev/md1

They were all detected and bind to RAID1.
Of the 4 partitions, I re-formatted partition /dev/sdb4 on Fedora 10
to ext3. The disk is on small NAS system. Hope this can stimulate some
hints from you, for me.

thanks
Y

<5>Linux version 2.6.17.14 (clarke at mccoy.oxsemi.com.asic.oxsemi.com)
(gcc version 4.1.1) #1 PREEMPT Fri Jan 18 10:40:25 GMT 2008
<4>CPU: ARM926EJ-Sid(wb) [41069265] revision 5 (ARMv5TEJ)
<4>Machine: Oxsemi NAS
<4>Ignoring unrecognised tag 0x00000000
<4>Memory policy: ECC disabled, Data cache writeback
<7>On node 0 totalpages: 8192
<7>  DMA zone: 8192 pages, LIFO batch:1
<4>CPU0: D VIVT write-back cache
<4>CPU0: I cache: 32768 bytes, associativity 4, 32 byte lines, 256 sets
<4>CPU0: D cache: 32768 bytes, associativity 4, 32 byte lines, 256 sets
<4>Built 1 zonelists
<5>Kernel command line: mem=32M console=ttyS0,115200 root=/dev/md1
netdev=0,0,0x0090A945,0x62BB,eth0
<4>PID hash table entries: 256 (order: 8, 1024 bytes)
<4>Console: colour dummy device 80x30
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<4>Dentry cache hash table entries: 4096 (order: 2, 16384 bytes)
<4>Inode-cache hash table entries: 2048 (order: 1, 8192 bytes)
<6>Memory: 32MB = 32MB total
<5>Memory: 29916KB available (2016K code, 349K data, 96K init)
<7>Calibrating delay loop... 99.73 BogoMIPS (lpj=498688)
<4>Mount-cache hash table entries: 512
<6>CPU: Testing write buffer coherency: ok
<6>NET: Registered protocol family 16
<6>Number of DMA channels = 5, version = 4
<4>Allocating 224 SRAM generic DMA descriptors
<4>PCI: Scanning bus 0000:00
<4>PCI: Found 0000:00:07.0 [1106/3119] 000200 00
<4>PCI: Fixups for bus 0000:00
<6>PCI: bus0: Fast back to back transfers disabled
<4>PCI: Bus scan for 0000:00 returning with max=00
<5>SCSI subsystem initialized
<6>NET: Registered protocol family 2
<4>IP route cache hash table entries: 256 (order: -2, 1024 bytes)
<4>TCP established hash table entries: 1024 (order: 0, 4096 bytes)
<4>TCP bind hash table entries: 512 (order: -1, 2048 bytes)
<6>TCP: Hash tables configured (established 1024 bind 512)
<6>TCP reno registered
<1>Hello, LED trigger
<4>NetWinder Floating Point Emulator V0.97 (double precision)
<6>Initializing Cryptographic API
<6>io scheduler noop registered
<6>io scheduler anticipatory registered (default)
<6>io scheduler deadline registered
<6>io scheduler cfq registered
<6>Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing disabled
<6>serial8250: ttyS0 at MMIO 0x44300000 (irq = 24) is a 16550A
<4>RAMDISK driver initialized: 16 RAM disks of 10240K size 1024 blocksize
<6>loop: loaded (max 8 devices)
<6>VIA Networking Velocity Family Gigabit Ethernet Adapter Driver Ver. 1.13
<6>Copyright (c) 2002, 2003 VIA Networking Technologies, Inc.
<6>Copyright (c) 2004 Red Hat Inc.
<4>PCI: enabling device 0000:00:07.0 (0140 -> 0143)
<6>eth0: VIA Networking Velocity Family Gigabit Ethernet Adapter
<6>eth0: Ethernet Address: 00:90:A9:45:62:BB
<7>libata version 1.20 loaded.
<6>ox800sata init
<6>ox800sata: 924 based sata core.
<6>ata1: SATA max UDMA/133 cmd 0x0 ctl 0x0 bmdma 0x0 irq 18
<6>ata1: SATA link up 1.5 Gbps (SStatus 113)
<7>ata1: dev 0 cfg 49:2f00 82:746b 83:7f61 84:4123 85:7469 86:bc41
87:4123 88:407f
<6>ata1: dev 0 ATA-7, max UDMA/133, 976773168 sectors: LBA48
<6>ata1: dev 0 configured for UDMA/133
<6>scsi0 : ox800sata
<5>  Vendor: ATA       Model: WDC WD5000AAKS-0  Rev: 12.0
<5>  Type:   Direct-Access                      ANSI SCSI revision: 05
<6>ox800sata: 924 based sata core.
<6>ata2: SATA max UDMA/133 cmd 0x0 ctl 0x0 bmdma 0x0 irq 19
<6>ata2: SATA link up 1.5 Gbps (SStatus 113)
<7>ata2: dev 0 cfg 49:2f00 82:746b 83:7f61 84:4123 85:7469 86:bc41
87:4123 88:407f
<6>ata2: dev 0 ATA-7, max UDMA/133, 976773168 sectors: LBA48
<6>ata2: dev 0 configured for UDMA/133
<6>scsi1 : ox800sata
<5>  Vendor: ATA       Model: WDC WD5000AAKS-0  Rev: 12.0
<5>  Type:   Direct-Access                      ANSI SCSI revision: 05
<5>SCSI device sda: 976773168 512-byte hdwr sectors (500108 MB)
<5>sda: Write Protect is off
<7>sda: Mode Sense: 00 3a 00 00
<5>SCSI device sda: drive cache: write back
<5>SCSI device sda: 976773168 512-byte hdwr sectors (500108 MB)
<5>sda: Write Protect is off
<7>sda: Mode Sense: 00 3a 00 00
<5>SCSI device sda: drive cache: write back
<6> sda: sda1 sda2 sda3 sda4
<5>sd 0:0:0:0: Attached scsi disk sda
<5>SCSI device sdb: 976773168 512-byte hdwr sectors (500108 MB)
<5>sdb: Write Protect is off
<7>sdb: Mode Sense: 00 3a 00 00
<5>SCSI device sdb: drive cache: write back
<5>SCSI device sdb: 976773168 512-byte hdwr sectors (500108 MB)
<5>sdb: Write Protect is off
<7>sdb: Mode Sense: 00 3a 00 00
<5>SCSI device sdb: drive cache: write back
<6> sdb: sdb1 sdb2 sdb3 sdb4
<5>sd 1:0:0:0: Attached scsi disk sdb
<6>mice: PS/2 mouse device common for all mice
<6>md: linear personality registered for level -1
<6>md: raid1 personality registered for level 1
<6>md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
<6>md: bitmap version 4.39
<6>device-mapper: 4.6.0-ioctl (2006-02-17) initialised: dm-devel at redhat.com
<6>TCP bic registered
<6>NET: Registered protocol family 1
<6>NET: Registered protocol family 17
<6>md: Autodetecting RAID arrays.
<6>md: autorun ...
<6>md: considering sdb3 ...
<6>md:  adding sdb3 ...
<4>md: sdb2 has different UUID to sdb3
<4>md: sdb1 has different UUID to sdb3
<4>md: sda4 has different UUID to sdb3
<6>md:  adding sda3 ...
<4>md: sda2 has different UUID to sdb3
<4>md: sda1 has different UUID to sdb3
<6>md: created md3
<6>md: bind<sda3>
<6>md: bind<sdb3>
<6>md: running: <sdb3><sda3>
<4>raid1 run
<6>raid1: raid set md3 active with 2 out of 2 mirrors
<6>md: considering sdb2 ...
<6>md:  adding sdb2 ...
<4>md: sdb1 has different UUID to sdb2
<4>md: sda4 has different UUID to sdb2
<6>md:  adding sda2 ...
<4>md: sda1 has different UUID to sdb2
<6>md: created md2
<6>md: bind<sda2>
<6>md: bind<sdb2>
<6>md: running: <sdb2><sda2>
<4>raid1 run
<6>raid1: raid set md2 active with 2 out of 2 mirrors
<6>md: considering sdb1 ...
<6>md:  adding sdb1 ...
<4>md: sda4 has different UUID to sdb1
<6>md:  adding sda1 ...
<6>md: created md1
<6>md: bind<sda1>
<6>md: bind<sdb1>
<6>md: running: <sdb1><sda1>
<4>raid1 run
<6>raid1: raid set md1 active with 2 out of 2 mirrors
<6>md: considering sda4 ...
<6>md:  adding sda4 ...
<6>md: created md4
<6>md: bind<sda4>
<6>md: running: <sda4>
<4>raid1 run
<6>raid1: raid set md4 active with 1 out of 2 mirrors
<6>md: ... autorun DONE.
<6>kjournald starting.  Commit interval 5 seconds
<4>EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
<6>EXT3 FS on md1, internal journal
<6>EXT3-fs: recovery complete.
<6>EXT3-fs: mounted filesystem with ordered data mode.
<4>VFS: Mounted root (ext3 filesystem).
<6>Freeing init memory: 96K
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>kjournald starting.  Commit interval 5 seconds
<4>EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
<6>EXT3 FS on md3, internal journal
<6>EXT3-fs: recovery complete.
<6>EXT3-fs: mounted filesystem with ordered data mode.
<6>kjournald starting.  Commit interval 5 seconds
<4>EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
<6>EXT3 FS on md4, internal journal
<6>EXT3-fs: mounted filesystem with ordered data mode.
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Adding 104312k swap on /dev/md2.  Priority:-1 extents:1 across:104312k
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>wdc-leds:  FAST_TPS=960, SLOW_TPS=32
<6>Registered led device: wdc-leds:power
<6>Registered led device: wdc-leds:activity
<6>Registered led device: wdc-leds:ignore-act
<6>Registered led device: wdc-leds:transition
<6>Registered led device: wdc-leds:fuel-gauge
<6>Registered led device: wdc-leds:fg-bitmap
<6>Registered led device: wdc-leds:rebuilding
<6>Registered led device: wdc-leds:degraded
<6>Registered led device: wdc-leds:over-temp
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<7>Fan probe
<6>WDC_Fan initialized
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>i2c_oxnas_bitbash_init: i2c OX800 driver init
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>usbcore: registered new driver usbfs
<6>usbcore: registered new driver hub
<4>12 May 2005 USB 2.0 'Enhanced' Host Controller (EHCI) Driver for
OXNAS at e7000000 Device ID register 42fa05
<6>oxnas-ehci oxnas-ehci: OXNAS EHCI Host Controller
<6>oxnas-ehci oxnas-ehci: new USB bus registered, assigned bus number 1
<6>oxnas-ehci oxnas-ehci: irq 7, io mem 0x00000000
<6>oxnas-ehci oxnas-ehci: USB 0.0 started, EHCI 1.00, driver 12 May 2005
<6>usb usb1: configuration #1 chosen from 1 choice
<6>hub 1-0:1.0: USB hub found
<6>hub 1-0:1.0: 3 ports detected
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Initializing USB Mass Storage driver...
<6>usbcore: registered new driver usb-storage
<6>USB Mass Storage support registered.
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40
<6>Using fractional divider baud 115200, clock 100000000 dlf 40