Re: boot from raidz

From: Paul Wootton <paul_at_fletchermoorland.co.uk>
Date: Tue, 08 Sep 2009 15:59:39 +0000
Oliver Fakler wrote:
> On Mon 07/09/09 20:22 , Paul Wootton  wrote:Oliver Fakler wrote:
>  > On Mon 07/09/09 13:40 , Bernhard Schmidt  wrote:
>  >  Am 07.09.2009 um 11:13 schrieb Oliver Fakler:
>  >  >
>  >  > BODY { font-family:Arial, Helvetica, sans-serif;font-size:12px;
> }
>  >  >
>  >  > On Mon 07/09/09 10:07 , Bernhard Schmidt   
>  >  > wrote:
>  >  >
>  >  >
>  >  > Am 06.09.2009 um 21:45 schrieb Oliver Fakler:
>  >  >
>  >  > >
>  >  > >
>  >  > > Hi all,
>  >  > >
>  >  > > i installed a 8.0 beta 3 amd64 based testsystem.
>  >  > >
>  >  > > i tried with a root on a raidz, but i have a problem after
> the
>  > first
>  >  > > reboot, there is a error message:
>  >  > >
>  >  > > can't load kernel
>  >  > > I found something that boot root from raidz is not supported,
>  > but
>  >  > > maybe there is a solution??
>  >  > > Hope some can help me
>  >  >
>  >  >
>  >  > There are patches from Doug Rabson which add support for
> booting
>  > from
>  >  > raidz/raidz2.
>  >  >
>  >  >
>  >
> http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html
> [1]"
> target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html
>  > [2]"
>  >
> target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html
> [2]"
> target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html
>  >
>  >  > "
>  >
> target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html
> [3]"
> target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html
>  > [3]"
>  >
> target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html
> [4]"
> target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html
>  >  Seems that patch made it already into the tree (r192194).
>  >  >
>  >  >
>  >  > I tried it, but after a make obj && make depend the make failed
>  > with  
>  >  > different errors like undeclared and has no member named.
>  >  >
>  >  > I used patch raidzboot-14052009.diff started patching from
>  > /usr/src/ 
>  >  > sys/ , i'm not sure if this was the right way.
>  >  >
>  >  > I'm also not sure if the way of installation was the right one,
>  
>  >  > here's the way i go:
>  >  >
>  >  >
>  >  > gpart create -s GPT da0
>  >  > gpart add -b 34 -s 128 -t freebsd-boot da0
>  >  > gpart add -b 162 -s 5242880 -t freebsd-swap da0
>  >  > gpart add -b 5243042 -s 11534141 -t freebsd-zfs da0
>  >  > gpart bootcode -b /mnt2/boot/pmbr -p /mnt2/boot/gptzfsboot -i 1
>  > da0
>  >  > gpart bootcode -b /mnt2/boot/pmbr -p /mnt2/boot/gptzfsboot -i 1
>  > da1
>  >  > gpart bootcode -b /mnt2/boot/pmbr -p /mnt2/boot/gptzfsboot -i 1
>  > da2
>  >  >
>  >  Can you try zfsboot instead of gptzfsboot?
>  >
>  >
> http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2009-05/msg00689.html
> [5]"
> target="_blank">http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2009-05/msg00689.html
>  > [4]"
>  >
> target="_blank">http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2009-05/msg00689.html
> [6]"
> target="_blank">http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2009-05/msg00689.html
>  >
>  >    at the end of the mail.
>  >  >
>  >  >
>  >  > kldload /mnt2/boot/kernel/opensolaris.ko
>  >  > kldload /mnt2/boot/kernel/zfs.ko
>  >  >
>  >  > zpool create tank raidz da0p3 da1p1 d2p1
>  >  >
>  >  > zfs create tank/tmp
>  >  > zfs create tank/usr
>  >  > zfs create tank/var
>  >  >
>  >  > cd /dist/8.0-BETA3/base
>  >  > export DESTDIR=/tank
>  >  > ./install.sh
>  >  > You are about to extract the base distribution into /tank - are
>  > you  
>  >  > SURE
>  >  > you want to do this over your installed system (y/n)? y
>  >  > cd ../kernels
>  >  > ./install.sh generic
>  >  > cd /tank/boot
>  >  > cp -Rp GENERIC/* kernel/
>  >  >
>  >  > cd /dist/8.0-BETA3/src
>  >  > ./install.sh all
>  >  > Extracting sources into /usr/src...
>  >  >   Extracting source component: base
>  >  >   Extracting source component: bin
>  >  >   Extracting source component: cddl
>  >  >   Extracting source component: contrib
>  >  >   Extracting source component: crypto
>  >  >   Extracting source component: etc
>  >  >   Extracting source component: games
>  >  >   Extracting source component: gnu
>  >  >   Extracting source component: include
>  >  >   Extracting source component: krb5
>  >  >   Extracting source component: lib
>  >  >   Extracting source component: libexec
>  >  >   Extracting source component: release
>  >  >   Extracting source component: rescue
>  >  >   Extracting source component: sbin
>  >  >   Extracting source component: secure
>  >  >   Extracting source component: share
>  >  >   Extracting source component: sys
>  >  >   Extracting source component: tools
>  >  >   Extracting source component: ubin
>  >  >   Extracting source component: usbin
>  >  > Done extracting sources.
>  >  > Done extracting sources.
>  >  > cd ../manpages
>  >  > ./install.sh
>  >  >
>  >  > echo 'zfs_enable="YES"' > /tank/etc/rc.conf
>  >  > echo 'LOADER_ZFS_SUPPORT="YES"' > /tank/etc/src.conf
>  >  > echo 'zfs_load="YES"' > /tank/boot/loader.conf
>  >  > echo 'vfs.root.mountfrom="zfs:tank"' >> /tank/boot/loader.conf
>  >  > echo &acute;/dev/da0p2 none swap sw 0 0&acute;>>
> /tank/etc/fstab
>  >  >
>  >  > mkdir /boot/zfs
>  >  > zpool export tank && zpool import tank
>  >  > cp /boot/zfs/zpool.cache /tank/boot/zfs/
>  >  >
>  >  > chroot /tank
>  >  > mount -t devfs devfs /dev
>  >  > unset DESTDIR
>  >  > cd /usr/src/sys/boot/
>  >  > make obj
>  >  > make depend
>  >  > make
>  >  > cd i386/loader
>  >  > make install
>  >  > umount /dev
>  >  > touch /etc/fstab
>  >  > exit
>  >  >
>  >  > export LD_LIBRARY_PATH=/mnt2/lib
>  >  > zfs set mountpoint=legacy tank
>  >  > zfs set mountpoint=/tmp tank/tmp
>  >  > zfs set mountpoint=/var tank/var
>  >  > zfs set mountpoint=/usr tank/usr
>  >  > zpool set bootfs=tank tank
>  >  >
>  >  Seems correct at first glance.
>  >  --
>  >  Bernhard
>  > testet with zfsboot instead of gptzfsboot but it was not
> successfull
>  > :-(
>  >
>  > Links:
>  > ------
>  > [2] http://mail.kuehlbox.de/parse.php%3Fredirect%3D%26lt%3Ba [7]"
> target="_blank">http://mail.kuehlbox.de/parse.php?redirect= [3]
> http://mail.kuehlbox.de/parse.php%3Fredirect%3D%26lt%3Ba [8]"
> target="_blank">http://mail.kuehlbox.de/parse.php?redirect= [4]
> http://mail.kuehlbox.de/parse.php%3Fredirect%3D%26lt%3Ba [9]"
> target="_blank">http://mail.kuehlbox.de/parse.php?redirect=
> _______________________________________________
>  >  mailing list
>  > http://lists.freebsd.org/mailman/listinfo/freebsd-current [11]"
> target="_blank">http://lists.freebsd.org/mailman/listinfo/freebsd-current
>  > To unsubscribe, send any mail to "
>  I have a fully running GPT ZFS RaidZ setup using what was at the
> time 8-HEAD
>  I cant remember the exact steps I took, but one thing I have
> different 
>  is I have a root filesystem within my zpool
>  [ /usr/home/paul]$ gpart show
>  =>       34  976773101  ada1  GPT  (466G)
>           34        256     1  freebsd-boot  (128K)
>          290    8388608     2  freebsd-swap  (4.0G)
>      8388898  147912557     3  freebsd-zfs  (71G)
>    156301455  820471680        - free -  (391G)
>  =>       34  488394988  ada2  GPT  (233G)
>           34        256     1  freebsd-boot  (128K)
>          290    8388608     2  freebsd-swap  (4.0G)
>      8388898  147912557     3  freebsd-zfs  (71G)
>    156301455  332093567        - free -  (158G)
>  =>       34  156301421  ada3  GPT  (75G)
>           34        256     1  freebsd-boot  (128K)
>          290    8388608     2  freebsd-swap  (4.0G)
>      8388898  147912557     3  freebsd-zfs  (71G)
>  [ /usr/home/paul]$ zpool status
>    pool: zboot
>   state: ONLINE
>   scrub: none requested
>  config:
>          NAME        STATE     READ WRITE CKSUM
>          zboot       ONLINE       0     0     0
>            ada1p3    ONLINE       0     0     0
>            ada2p3    ONLINE       0     0     0
>            ada3p3    ONLINE       0     0     0
>  errors: No known data errors
>  [ /usr/home/paul]$ zfs list
>  NAME           USED  AVAIL  REFER  MOUNTPOINT
>  zboot         33.5G   175G    18K  none
>  zboot/root    12.4G   175G  12.2G  none
>  zboot/tmp     82.9M   175G  82.6M  none
>  zboot/usr     20.8G   175G  16.5G  none
>  zboot/var      216M   175G   123M  none
>  Im also using fstabs to mount my ZFS filesystems
>  [ /usr/home/paul]$ more /etc/fstab
>  # Device        Mountpoint      FStype          Options         Dump
>    
>  Pass#
>  zboot/root      /               zfs             rw              0   
>    0
>  zboot/usr       /usr            zfs             rw              0   
>    0
>  zboot/var       /var            zfs             rw              0   
>    0
>  zboot/tmp       /tmp            zfs             rw,noatime      0   
>    0
>  proc            /proc           procfs          rw              0   
>    0
>  I remember speak to someone a while back, and I *think* we came to
> the 
>  conclusion that using the zpool as your root will not work correctly
> and 
>  you should really create a root filesystem inside the zpool
>  Lets me know how this works out for you
>  Paul
>
> -----------------------------------------------------------------------------------
>  Fletcher Moorland Limited is a company registered in England and
> Wales. 
>  Registration number: 2984467. 
>  Registered office: Elenora Street, Stoke on Trent, Staffordshire,
> ST4 1QG. 
>  VAT Registration number: 478730606 
>  Telephone: 01782 411021 | Fax: 01782 744470 |
> http://www.fletchermoorland.co.uk [17]"
> target="_blank">http://www.fletchermoorland.co.uk 
>  _______________________________________________
>   mailing list
>  http://lists.freebsd.org/mailman/listinfo/freebsd-current [19]"
> target="_blank">http://lists.freebsd.org/mailman/listinfo/freebsd-current
>  To unsubscribe, send any mail to ""
> 	your pool is just a stripe, no raidz
>
> 	i testet it with striping, and it was successfull, but i need a
> raidz
>
> 	there are some new errors on Beta4
>
> 	can'tfind root filesystem
>
> 	maybe you're right with your idea of an extra root folder, but i
> think if he can't find root filesystem, he also can't read fstab.
> 	maybe more ideas? :-)
> 	cheers 
> 	Oliver
>
> Links:
> ------
> [1] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [2] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [3] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [4] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [5] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [6] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [7] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [8] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [9] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [11] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [17] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> [19] http://mail.kuehlbox.de/parse.php?redirect=<a href=
> _______________________________________________
> freebsd-current_at_freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-current
> To unsubscribe, send any mail to "freebsd-current-unsubscribe_at_freebsd.org"
>   

Ok, so now I feel like a fool...
You're right... It's not a raidz, but it *should* have been one. I had 
tried MANY things and it was getting late (or early depending onm how 
you look at it) that night when I finally got the system up...

So, i'll take my system off line in the next few days and try rebuilding 
with a raidz...

I thought it was too good to be true

Paul


-----------------------------------------------------------------------------------
Fletcher Moorland Limited is a company registered in England and Wales. 
Registration number: 2984467. 
Registered office: Elenora Street, Stoke on Trent, Staffordshire, ST4 1QG. 
VAT Registration number: 478730606 
Telephone: 01782 411021 | Fax: 01782 744470 | http://www.fletchermoorland.co.uk 
Received on Tue Sep 08 2009 - 13:00:39 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:55 UTC