Bug 714218

Summary: mkinitrd reports "No fsck for your rootfs and boot fails"
Product: [openSUSE] openSUSE 12.1 Reporter: Sid Boyce <sboyce>
Component: BasesystemAssignee: Michal Marek <mmarek>
Status: RESOLVED DUPLICATE QA Contact: E-mail List <qa-bugs>
Severity: Major    
Priority: P2 - High CC: bruno, sboyce
Version: Factory   
Target Milestone: Milestone 3   
Hardware: x86-64   
OS: Other   
Whiteboard:
Found By: --- Services Priority:
Business Priority: Blocker: ---
Marketing QA Status: --- IT Deployment: ---

Description Sid Boyce 2011-08-25 14:56:48 UTC
User-Agent:       Mozilla/5.0 (X11; Linux x86_64; rv:6.0) Gecko/20100101 Firefox/6.0

After the latest zypper dup, any kernel built gets the report and boot fails with no init. kernels built before the update are OK.
Kernel image:   /boot/3.1.0-rc3-git3-smp
Initrd image:   /boot/initrd3.1.0-rc3-git3-smp
/usr device:    /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part2 (/dev/sda2) (mounted on /usr as ext4)
Resume device:  /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part3 (/dev/sda3)
Kernel Modules: scsi_mod libata pata_atiixp ata_generic thermal_sys thermal processor fan crc16 jbd2 ext4 pata_sl82c105 sata_mv pata_ns87415 pata_rdc sata_sil24 sata_via libahci acard-ahci sata_sx4 pata_acpi pata_cs5530 pata_mpiix pata_piccolo sata_sil pata_atp867x pata_triflex sata_nv pata_pdc2027x pata_netcell pata_sis sata_sis pata_artop sata_uli pata_marvell sata_qstor pata_hpt3x2n pata_ninja32 ata_piix pata_sc1200 pata_serverworks pata_hpt3x3 pata_it821x sata_inic162x ahci pata_oldpiix pata_cmd640 pata_it8213 pata_amd sata_promise pata_ns87410 pdc_adma pata_cypress pata_pdc202xx_old sata_svw pata_sil680 pata_efar pata_cs5520 pata_via pata_hpt366 pata_optidma pata_jmicron pata_hpt37x pata_radisys pata_cmd64x pata_opti pata_ali pata_rz1000 sata_vsc pata_sch sd_mod mmc_core ssb ohci-hcd ehci-hcd uhci-hcd usbhid 
****************************
*        WARNING           
* No fsck for your rootfs  
* could be found.          
* This might be bad!       
* Please install: /sbin/fsck.proc
****************************
Features:       block usb resume.userspace resume.kernel
Bootsplash:     openSUSE (1024x768)
slipstream:/usr/src/linux-3.1-rc3-git3 #  # l /sbin/init
-rwxr-xr-x 1 root root 40768 Aug  8 20:10 /sbin/init*

# l /sbin/fsck.*
-rwxr-xr-x 1 root root  14760 Aug 17 13:03 /sbin/fsck.cramfs*
-rwxr-xr-x 4 root root 190440 Aug  8 20:21 /sbin/fsck.ext2*
-rwxr-xr-x 4 root root 190440 Aug  8 20:21 /sbin/fsck.ext3*
-rwxr-xr-x 4 root root 190440 Aug  8 20:21 /sbin/fsck.ext4*
-rwxr-xr-x 1 root root  31320 Aug 17 13:03 /sbin/fsck.minix*
lrwxrwxrwx 1 root root      7 Aug 13 04:24 /sbin/fsck.msdos -> dosfsck*
lrwxrwxrwx 1 root root      7 Aug 13 04:24 /sbin/fsck.vfat -> dosfsck*
-rwxr-xr-x 1 root root    450 Aug  8 20:29 /sbin/fsck.xfs*

 # rpm -q systemd sysvinit
package systemd is not installed
sysvinit-2.88+-59.2.x86_64

To get the error, INITRD script as below in "Steps to Reproduce", $1 is 3.1.0-rc3-git3.

Reproducible: Always

Steps to Reproduce:
1. cd /boot; mkinitrd -k $1 -i initrd$1 -M /boot/System.map -d /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part2 -s 1024x768
2.
3.
Actual Results:  
See Details

Expected Results:  
See Details
Comment 1 Sid Boyce 2011-08-26 20:39:06 UTC
Changed /etc/fstab from
proc                 /proc                proc       defaults              0 0

To
proc                 /proc                proc       rw,nodev,auto              0 0

The /sbin/fsck.proc error has gone it just complains about fusectl
 # INITRD 3.1.0-rc3-git4-smp

Kernel image:   /boot/3.1.0-rc3-git4-smp
Initrd image:   /boot/initrd3.1.0-rc3-git4-smp
/usr device:    /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part2 (/dev/sda2) (mounted on /usr as ext4)
Resume device:  /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part3 (/dev/sda3)
modprobe: Module fusectl not found.
WARNING: no dependencies for kernel module 'fusectl' found.
Kernel Modules: scsi_mod libata pata_atiixp ata_generic thermal_sys thermal processor fan crc16 jbd2 ext4 pata_sl82c105 sata_mv pata_ns87415 pata_rdc sata_sil24 sata_via libahci acard-ahci sata_sx4 pata_acpi pata_cs5530 pata_mpiix pata_piccolo sata_sil pata_atp867x pata_triflex sata_nv pata_pdc2027x pata_netcell pata_sis sata_sis pata_artop sata_uli pata_marvell sata_qstor pata_hpt3x2n pata_ninja32 ata_piix pata_sc1200 pata_serverworks pata_hpt3x3 pata_it821x sata_inic162x ahci pata_oldpiix pata_cmd640 pata_it8213 pata_amd sata_promise pata_ns87410 pdc_adma pata_cypress pata_pdc202xx_old sata_svw pata_sil680 pata_efar pata_cs5520 pata_via pata_hpt366 pata_optidma pata_jmicron pata_hpt37x pata_radisys pata_cmd64x pata_opti pata_ali pata_rz1000 sata_vsc pata_sch sd_mod mmc_core ssb ohci-hcd ehci-hcd uhci-hcd usbhid 
****************************
*        WARNING           
* No fsck for your rootfs  
* could be found.          
* This might be bad!       
* Please install: /sbin/fsck.fusectl
****************************
Features:       block usb resume.userspace resume.kernel
Bootsplash:     openSUSE (1024x768)
slipstream:/usr/src/linux-3.1-rc3-git4 # !v
vi /etc/fstab
slipstream:/usr/src/linux-3.1-rc3-git4 # INITRD 3.1.0-rc3-git4-smp

Kernel image:   /boot/3.1.0-rc3-git4-smp
Initrd image:   /boot/initrd3.1.0-rc3-git4-smp
/usr device:    /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part2 (/dev/sda2) (mounted on /usr as ext4)
Resume device:  /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part3 (/dev/sda3)
modprobe: Module fusectl not found.
WARNING: no dependencies for kernel module 'fusectl' found.
Kernel Modules: scsi_mod libata pata_atiixp ata_generic thermal_sys thermal processor fan crc16 jbd2 ext4 pata_sl82c105 sata_mv pata_ns87415 pata_rdc sata_sil24 sata_via libahci acard-ahci sata_sx4 pata_acpi pata_cs5530 pata_mpiix pata_piccolo sata_sil pata_atp867x pata_triflex sata_nv pata_pdc2027x pata_netcell pata_sis sata_sis pata_artop sata_uli pata_marvell sata_qstor pata_hpt3x2n pata_ninja32 ata_piix pata_sc1200 pata_serverworks pata_hpt3x3 pata_it821x sata_inic162x ahci pata_oldpiix pata_cmd640 pata_it8213 pata_amd sata_promise pata_ns87410 pdc_adma pata_cypress pata_pdc202xx_old sata_svw pata_sil680 pata_efar pata_cs5520 pata_via pata_hpt366 pata_optidma pata_jmicron pata_hpt37x pata_radisys pata_cmd64x pata_opti pata_ali pata_rz1000 sata_vsc pata_sch sd_mod mmc_core ssb ohci-hcd ehci-hcd uhci-hcd usbhid 
****************************
*        WARNING           
* No fsck for your rootfs  
* could be found.          
* This might be bad!       
* Please install: /sbin/fsck.fusectl
****************************
Features:       block usb resume.userspace resume.kernel
Bootsplash:     openSUSE (1024x768)
slipstream:/usr/src/linux-3.1-rc3-git4 #

 # mount
devtmpfs on /dev type devtmpfs (rw,relatime,size=4047372k,nr_inodes=1011843,mode=755)
tmpfs on /dev/shm type tmpfs (rw,relatime)
tmpfs on /run type tmpfs (rw,nosuid,nodev,relatime,mode=755)
devpts on /dev/pts type devpts (rw,relatime,gid=5,mode=620,ptmxmode=000)
/dev/sda2 on / type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
proc on /proc type proc (rw,relatime)
sysfs on /sys type sysfs (rw,relatime)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
securityfs on /sys/kernel/security type securityfs (rw,relatime)
/dev/sda1 on /boot type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
/dev/sdc1 on /home/lancelot/ftp type reiserfs (rw,relatime,acl,user_xattr)
/dev/sdb2 on /2 type xfs (rw,relatime,attr2,delaylog,noquota)
tmpfs on /var/lock type tmpfs (rw,nosuid,nodev,relatime,mode=755)
tmpfs on /var/run type tmpfs (rw,nosuid,nodev,relatime,mode=755)
proc on /var/lib/ntp/proc type proc (ro,nosuid,nodev,relatime)
gvfs-fuse-daemon on /root/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,relatime,user_id=0,group_id=0)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)

umounted fusectl and gvfs-fuse-daemon.
It's somehow ignored the changed /etc/fstab and mounted proc and back comes the /sbin/fsck.proc error.
Comment 2 Sid Boyce 2011-08-26 20:58:36 UTC
# cat /proc/filesystems
nodev   sysfs
nodev   rootfs
nodev   bdev
nodev   proc
nodev   cgroup
nodev   cpuset
nodev   tmpfs
nodev   devtmpfs
nodev   debugfs
nodev   securityfs
nodev   sockfs
nodev   pipefs
nodev   anon_inodefs
nodev   devpts
        ext3
        ext2
nodev   ramfs
nodev   hugetlbfs
        iso9660
nodev   pstore
nodev   mqueue
        ext4
        reiserfs
        xfs
nodev   fuse
        fuseblk
nodev   fusectl
Comment 3 Sid Boyce 2011-08-27 15:29:50 UTC
On booting these kernels.
-------------------------
[2.584549] ramoops: The memory size and the read size must be non-zero
doing fast boot
boot/03-storage.sh: line 24: /config/mount.sh: no such file or directory
Creating device nodes wit udev
Trying manual resume from /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part3
Invoking userspace resume from /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part3
resume: libcrypt version 1.4.6
Trying manual resume from /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part3
Invoking in-kernel resume from /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part3
Waiting for device /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part2 to appear: OK
Mounting root /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part2
mount -o rw -t proc /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part2 /root
No init found. Try passing init= option to the kernel
umount /dev: device is busy
<Kernel panic and oops follows>

On a successful boot of a kernel built before the zypper dup,
init version 2.89
Comment 4 Sid Boyce 2011-08-27 20:46:29 UTC
In /lib/mkinitrd/setup/91-mount.sh I commented out the second line below and added the first line calling /sbin/ext4
rootfsck="/sbin/fsck.ext4"                                                                                                                                                                                                                   
# rootfsck="/sbin/fsck.${rootfstype}"

slipstream:/usr/src/linux-3.1-rc3-git6 # INITRD 3.1.0-rc3-git6-smp
Scanning scripts ...
Resolve dependencies ...
Install symlinks in /lib/mkinitrd/setup ...
Install symlinks in /lib/mkinitrd/boot ...

Kernel image:   /boot/3.1.0-rc3-git6-smp
Initrd image:   /boot/initrd3.1.0-rc3-git6-smp
/usr device:    /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part2 (/dev/sda2) (mounted on /usr as ext4)
Resume device:  /dev/disk/by-id/ata-WDC_WD20EARS-07MVWB0_WD-WCAZA4270277-part3 (/dev/sda3)
Kernel Modules: scsi_mod libata pata_atiixp ata_generic thermal_sys thermal processor fan crc16 jbd2 ext4 pata_sl82c105 sata_mv pata_ns87415 pata_rdc sata_sil24 sata_via libahci acard-ahci sata_sx4 pata_acpi pata_cs5530 pata_mpiix pata_piccolo sata_sil pata_atp867x pata_triflex sata_nv pata_pdc2027x pata_netcell pata_sis sata_sis pata_artop sata_uli pata_marvell sata_qstor pata_hpt3x2n pata_ninja32 ata_piix pata_sc1200 pata_serverworks pata_hpt3x3 pata_it821x sata_inic162x ahci pata_oldpiix pata_cmd640 pata_it8213 pata_amd sata_promise pata_ns87410 pdc_adma pata_cypress pata_pdc202xx_old sata_svw pata_sil680 pata_efar pata_cs5520 pata_via pata_hpt366 pata_optidma pata_jmicron pata_hpt37x pata_radisys pata_cmd64x pata_opti pata_ali pata_rz1000 sata_vsc pata_sch sd_mod mmc_core ssb ohci-hcd ehci-hcd uhci-hcd usbhid 
Features:       block usb resume.userspace resume.kernel
Bootsplash:     openSUSE (1024x768)
slipstream:/usr/src/linux-3.1-rc3-git6 #
Comment 5 Sid Boyce 2011-08-27 21:16:58 UTC
Boot still fails with "fsck.proc not found", "No init found".
Comment 6 Bruno Friedmann 2011-08-28 16:12:46 UTC
Same kind of trouble here (trying to rebuild the initrd for osc build client)

"env" "rootfstype=ext4" "mkinitrd" "-d" "/dev/vgsys/lvobsbuild" "-m" "ext3 ext4 btrfs reiserfs binfmt_misc virtio_pci virtio_blk" "-k" "/boot/vmlinuz" "-i" "/boot/initrd-3.0.0-4-desktop-virtio" 
The first time I will to build the mkinird after upgrading to kernel 3.0.0-4 under factory I get this

"env" "rootfstype=ext3" "mkinitrd" "-d" "/dev/null" "-m" "ext3 ext4 btrfs reiserfs binfmt_misc virtio_pci virtio_blk" "-k" "/boot/vmlinuz" "-i" "/boot/initrd-3.0.0-4-desktop-virtio"

Kernel image:   /boot/vmlinuz
Initrd image:   /boot/initrd-3.0.0-4-desktop-virtio
KMS drivers:     nvidia
/usr device:    /dev/mapper/vgsys-lvsuse (mounted on /usr as ext4)
Resume device:  /dev/vgsys/lvswap
enabling LUKS support for /dev/md1 (cr_md1)
modprobe: Module rpc_pipefs not found.
WARNING: no dependencies for kernel module 'rpc_pipefs' found.
modprobe: Module kernel not found.
WARNING: no dependencies for kernel module 'kernel' found.
Kernel Modules: zlib_deflate btrfs reiserfs binfmt_misc virtio virtio_pci virtio_ring virtio_blk dm-mod dm-crypt dm-snapshot nvidia raid0 raid1 raid10 async_tx async_memcpy xor async_xor raid6_pq async_pq async_raid6_recov raid456 linear arc4 sha256_generic cbc 
****************************
*        WARNING           
* No fsck for your rootfs  
* could be found.          
* This might be bad!       
* Please install: /sbin/fsck.rpc_pipefs
****************************
Features:       dm kms block usb md lvm2 luks
Bootsplash:     hardDrive (1920x1080), hardDrive (800x600)

Then I mount an nfs share, then the initrd can be created but not usable, as it try to use and nfs / in osc build --local-package

I unmount the nfs, then the same command issue that :

Kernel image:   /boot/vmlinuz
Initrd image:   /boot/initrd-3.0.0-4-desktop-virtio
/usr device:    /dev/mapper/vgsys-lvsuse (mounted on /usr as ext4)
Resume device:  /dev/vgsys/lvswap
enabling LUKS support for /dev/md1 (cr_md1)
modprobe: Module debugfs not found.
WARNING: no dependencies for kernel module 'debugfs' found.
modprobe: Module kernel not found.
WARNING: no dependencies for kernel module 'kernel' found.
Kernel Modules: zlib_deflate btrfs reiserfs binfmt_misc virtio virtio_pci virtio_ring virtio_blk dm-mod dm-crypt dm-snapshot raid0 raid1 raid10 async_tx async_memcpy xor async_xor raid6_pq async_pq async_raid6_recov raid456 linear arc4 sha256_generic cbc 
****************************
*        WARNING           
* No fsck for your rootfs  
* could be found.          
* This might be bad!       
* Please install: /sbin/fsck.debugfs
****************************
Features:       dm block usb md lvm2 luks
Bootsplash:     hardDrive (1920x1080), hardDrive (800x600)


I'm running systemd + factory
Comment 7 Bruno Friedmann 2011-08-30 15:00:47 UTC
Just to give more informations today, after a cold reboot

if I try to get my new initrd for osc build 

!634
"env" "rootfstype=ext4" "mkinitrd" "-d" "/dev/null" "-m" "ext3 ext4 btrfs reiserfs binfmt_misc virtio_pci virtio_blk" "-k" "/boot/vmlinuz" "-i" "/boot/initrd-3.0.0-4-desktop-virtio"

Kernel image:   /boot/vmlinuz
Initrd image:   /boot/initrd-3.0.0-4-desktop-virtio
/usr device:    /dev/mapper/vgsys-lvsuse (mounted on /usr as ext4)
Resume device:  /dev/vgsys/lvswap
enabling LUKS support for /dev/md1 (cr_md1)
modprobe: Module rpc_pipefs not found.
WARNING: no dependencies for kernel module 'rpc_pipefs' found.
modprobe: Module kernel not found.
WARNING: no dependencies for kernel module 'kernel' found.
Kernel Modules: zlib_deflate btrfs reiserfs binfmt_misc virtio virtio_pci virtio_ring virtio_blk dm-mod dm-crypt dm-snapshot raid0 raid1 raid10 async_tx async_memcpy xor async_xor raid6_pq async_pq async_raid6_recov raid456 linear arc4 sha256_generic cbc 
****************************
*        WARNING           
* No fsck for your rootfs  
* could be found.          
* This might be bad!       
* Please install: /sbin/fsck.rpc_pipefs
****************************
Features:       dm block usb md lvm2 luks
Bootsplash:     hardDrive (1920x1080), hardDrive (800x600)

Then I restart nfs related service 
c-3po:~ # rcnfs restart
c-3po:~ # rcnfsserver restart
and get a new result

c-3po:~ # "env" "rootfstype=ext4" "mkinitrd" "-d" "/dev/null" "-m" "ext3 ext4 btrfs reiserfs binfmt_misc virtio_pci virtio_blk" "-k" "/boot/vmlinuz" "-i" "/boot/initrd-3.0.0-4-desktop-virtio"

Kernel image:   /boot/vmlinuz
Initrd image:   /boot/initrd-3.0.0-4-desktop-virtio
/usr device:    /dev/mapper/vgsys-lvsuse (mounted on /usr as ext4)
Resume device:  /dev/vgsys/lvswap
enabling LUKS support for /dev/md1 (cr_md1)
modprobe: Module kernel not found.
WARNING: no dependencies for kernel module 'kernel' found.
Kernel Modules: zlib_deflate btrfs reiserfs binfmt_misc virtio virtio_pci virtio_ring virtio_blk dm-mod dm-crypt dm-snapshot sunrpc auth_rpcgss nfs_acl lockd nfsd raid0 raid1 raid10 async_tx async_memcpy xor async_xor raid6_pq async_pq async_raid6_recov raid456 linear arc4 sha256_generic cbc 
****************************
*        WARNING           
* No fsck for your rootfs  
* could be found.          
* This might be bad!       
* Please install: /sbin/fsck.nfsd
****************************
Features:       dm block usb md lvm2 luks
Bootsplash:     hardDrive (1920x1080), hardDrive (800x600)

This seems to be related to the new feature added to get /usr mounted in initrd.
my /usr is on the / root partition (a lvm on top of a raid0 encrypted)
Comment 8 Michal Marek 2011-08-30 15:05:17 UTC
Coolo fixed it in the meanting.

*** This bug has been marked as a duplicate of bug 714650 ***