changeset 85:2444e4533089

add the RAID setup article
author Dirk Olmes <dirk@xanthippe.ping.de>
date Wed, 12 Jul 2017 04:14:55 +0200
parents 8b5501bb7973
children 5691417eabd5
files content/Linux/software-raid-setup.md
diffstat 1 files changed, 54 insertions(+), 0 deletions(-) [+]
line wrap: on
line diff
--- /dev/null	Thu Jan 01 00:00:00 1970 +0000
+++ b/content/Linux/software-raid-setup.md	Wed Jul 12 04:14:55 2017 +0200
@@ -0,0 +1,54 @@
+Title: Setting up a software RAID1 
+Date: 2017-07-12
+Lang: en
+Tags: Gentoo
+
+I'm helping a friend to set up a machine with [Gentoo](http://www.gentoo.org). This will be a machine to host production applications and it is equipped with 2 identical hard drives. I will set up a [software RAID 1](https://raid.wiki.kernel.org). This has been a life saver on a similar machine before where one of the drives failed and we had no data loss and only minimal downtime during which the drive was replaced.
+
+One goal of the new setup is to remain bootable even if one of the drives fails. I had trouble accomplishing this in earlier setups so this time I tested the process locally on a virtual machine before setting up the real iron.
+
+The first step of the setup is partitioning the drives. The [handbook](https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Disks) suggests adding a small partition at the beginning of the drive to enabl booting from a gpt partitioned drive. The `/boot` partition will be formatted using [ext4](https://en.wikipedia.org/wiki/Ext4) because the filesystem will remain bootable even if one of the drives is missing. The rest of the disk will be formatted using [xfs](https://en.wikipedia.org/wiki/XFS). To recap the layout:
+
+    Number  Start    End      Size     File system  Name    Flags
+     1      1.00MiB  3.00MiB  2.00MiB               grub    bios_grub
+     2      3.00MiB  95.0MiB  92.0MiB               boot
+     3      95.0MiB  8191MiB  8096MiB               rootfs  raid
+
+The second drive is partitioned exactly the same.
+
+Now let's create a RAID 1 for the boot partition:
+
+    mdadm --create /dev/md0 --level=1 --raid-devices=2 /dev/sdb2 /dev/sdc2
+
+and for the rootfs:
+
+    mdadm --create /dev/md1 --level=1 --raid-devices=2 /dev/sdb3 /dev/sdc3
+
+To maintain the RAID device numbering even after reboot, the RAID config has to be saved. This will be done by
+
+    mdadm --detail --scan >> /etc/mdadm.conf
+
+Then create an ext4 filesystem on `/dev/md0` and an xfs filesystem on `/dev/md1`. Nothing noteworthy here.
+
+The observant reader will have noticed from the device names above that I'm testing my installation from a running system on `/dev/sda`. To save the hassle of going through the entire stage3 setup process I'm simply copying the running system to the newly created RAID filesystems.
+
+After chrooting into the new system some changes have to be made to the [genkernel](https://wiki.gentoo.org/wiki/Genkernel) config in order to produce a RAID enabled initramfs. In `/etc/genkernel.conf` set
+
+    MDADM="yes"
+    MDADM_CONFIG="/etc/mdadm.conf"
+
+Now we're set to build the kernel.
+
+While it's compiling, edit `/etc/default/grub` (I'm of course using [grub2](https://www.gnu.org/software/grub/manual/grub.html) for booting)  and add
+
+    GRUB_CMDLINE_LINUX="domdadm"
+
+Setup grub on both devices individually using `grub-install /dev/sdb` and `grub-install /dev/sdc`.
+
+After the kernel has finished compiling, generate the proper grub config using `grub-mkconfig -o /boot/grub/grub.cfg`.
+
+Before rebooting the `fstab` has to be set up correctly. I prefer to use UUIDs for filesystems instead of device names - this is a bit more fault tolerant in case device numbering is mixed up. It was a main challenge to find an unambiguous UUID for the both RAID filesystems. There are a number of places to get a UUID from: `mdadm --detail`, `blkid`, `tune2fs -l`, `xfs_admin -u` and I'm sure I forgot more. The helpful guys at the [gentoo IRC channel](https://www.gentoo.org/get-involved/irc-channels/) pointed me in the right direction. Use `lsblk -f /dev/md0` to find a UUID that uniquely identifies the RAID and check using `findfs UUID=<uuid>`.
+
+After updating the `fstab` the system is ready for a first boot into the RAID setup.
+
+I tested failing drives by simply removing the first (or the second) drive from the virtual machine. The whole setup still boots off either drive.