场景

 

spacer.gif

 

POC环境

CentOS 7 MDADM Raid1

查看版本

#uname -a

Linuxzzsrv1.bigcloud.local 3.10.0-123.el7.x86_64 #1 SMP Mon Jun 30 12:09:22 UTC 2014x86_64 x86_64 x86_64 GNU/Linux

#cat /etc/redhat-release

CentOSLinux release 7.0.1406 (Core)

挂载硬盘

 

yum 安装mdadm的支持包

#yum -y install mdadm

Warning:RPMDB altered outside of yum.

  Installing :libreport-filesystem-2.1.11-10.el7.centos.x86_64             1/2

  Installing : mdadm-3.2.6-31.el7.x86_64                                    2/2

  Verifying : libreport-filesystem-2.1.11-10.el7.centos.x86_64             1/2

  Verifying : mdadm-3.2.6-31.el7.x86_64                                    2/2

 

Installed:

  mdadm.x86_64 0:3.2.6-31.el7

 

DependencyInstalled:

  libreport-filesystem.x86_640:2.1.11-10.el7.centos

 

Complete!

创建分区

#fdisk/dec/sdb  //分区

#fdisk/dec/sdc

     [sdb] Cache data unavailable

     [sdb] Assuming drive cache: write through

   

     [sdc] Cache data unavailable

     [sdc] Assuming drive cache: write through

创建RAID1

   # mdadm -C /dev/md0 -l 1 -n 2 /dev/sdb1  /dev/sdc1

mdadm:Note: this array has metadata at the start and

    may not be suitable as a boot device.  If you plan to

    store '/boot' on this device please ensurethat

    your boot-loader understands md/v1.xmetadata, or use

    --metadata=0.90

Continuecreating array? yes

mdadm:Defaulting to version 1.2 metadata

mdadm:array /dev/md0 started.

dmesg中查看内容

 md: bind<sdb1>

 md: bind<sdc1>

 md: raid1 personality registered for level 1

 md/raid1:md0: not clean -- starting backgroundreconstruction

 md/raid1:md0: active with 2 out of 2 mirrors

 md0: detected capacity change from 0 to10728898560

  md0: unknown partition table

 md: resync of RAID array md0

 md: minimum _guaranteed_  speed: 1000 KB/sec/disk.

 md: using maximum available idle IO bandwidth(but not more than 200000 KB/sec) for resync.

 md: using 128k window, over a total of10477440k.

 md: md0: resync done.

 RAID1 conf printout:

  --- wd:2 rd:2

  disk 0, wo:0, o:1, dev:sdb1

  disk 1, wo:0, o:1, dev:sdc1

 

查看日志

 kernel: md: bind<sdb1>

 kernel: md: bind<sdc1>

 kernel: md: raid1 personality registered forlevel 1

 kernel: md/raid1:md0: not clean -- startingbackground reconstruction

 kernel: md/raid1:md0: active with 2 out of 2mirrors

 kernel: md0: detected capacity change from 0to 10728898560

 kernel: md0: unknown partition table

 kernel: md: resync of RAID array md0

 kernel: md: minimum _guaranteed_  speed: 1000 KB/sec/disk.

 kernel: md: using maximum available idle IObandwidth (but not more than 200000 KB/sec) for resync.

 kernel: md: using 128k window, over a total of10477440k.

 kernel: md: md0: resync done.

创建文件系统

格式化:

#mkfs.ext4 /dev/md0

Aug 1503:51:49 zzsrv1 kernel: EXT4-fs (md0): mounted filesystem with ordered datamode. Opts: (null)

创建目录:

#mkdir /data

挂载光驱到目录下

#mount /dev/md0 /data

# ll /data/      //查看目录下内容

total 16

drwx------.2 root root 16384 Aug 15 03:51 lost+found

编译文件添加挂载目录和RAID1

#vi /etc/fstab       //在最后添加

/dev/md0               /data                   ext4     defaults     0  0

查看最终状态

# mdadm -Ds

ARRAY/dev/md0 metadata=1.2 name=zzsrv1.bigcloud.local:0UUID=bb9031b3:c25b3254:8f306614:f33741b8

 

写入到配置文件

# mdadm -Ds >>/etc/mdadm.conf

创建测试文件

#mkdir /data/mdadm

#touch/data/a.txt

新启动验证

# Reboot

查看挂载信息

# cat/proc/mdstat

Personalities: [raid1]

md0 :active raid1 sdb1[0] sdc1[1]

      10477440 blocks super 1.2 [2/2] [UU]

 

unuseddevices: <none>

 

模拟故障

/dev/sdc1坏掉

#reboot

#  cat /proc/mdstat

Personalities: [raid1]

md0 :active raid1 sdb1[1]

      10477440 blocks super 1.2 [2/1] [_U]

 

unused devices: <none>

 

RAID1重建

模拟恢复,在创建30GB的硬盘

重新分区

#fdisk  /dev/sdb

 

Disk/dev/sdc: 32.2 GB, 32212254720 bytes, 62914560 sectors

Units =sectors of 1 * 512 = 512 bytes

Sectorsize (logical/physical): 512 bytes / 512 bytes

I/O size(minimum/optimal): 512 bytes / 512 bytes

Disklabel type: dos

Diskidentifier: 0x46134903

 

   Device Boot      Start         End      Blocks  Id  System

/dev/sdc1            2048    20973567   10485760   83 Linux

 

# fdisk /dev/sdb

Welcometo fdisk (util-linux 2.23.2).

 

Changeswill remain in memory only, until you decide to write them.

Becareful before using the write command.

 

Devicedoes not contain a recognized partition table

Buildinga new DOS disklabel with disk identifier 0xedffc7e6.

 

Command(m for help): p    //查看分区

 

Disk/dev/sdb: 21.5 GB, 21474836480 bytes, 41943040 sectors

Units =sectors of 1 * 512 = 512 bytes

Sectorsize (logical/physical): 512 bytes / 512 bytes

I/O size(minimum/optimal): 512 bytes / 512 bytes

Disklabel type: dos

Diskidentifier: 0xedffc7e6

 

   Device Boot      Start         End      Blocks  Id  System

 

Command(m for help): n     //新建分区

Partitiontype:

   p  primary (0 primary, 0 extended, 4 free)

   e  extended

Select(default p): p

Partitionnumber (1-4, default 1): 1

Firstsector (2048-41943039, default 2048):  //从当前柱面开始

Usingdefault value 2048

Lastsector, +sectors or +size{K,M,G} (2048-41943039, default 41943039): +10G          //分区为10G 

Partition1 of type Linux and of size 10 GiB is set

 

Command(m for help): w      //保存分区

Thepartition table has been altered!

 

Callingioctl() to re-read partition table.

Syncingdisks.

# mkfs.ext4 /dev/sdb1      //格式化分区

mke2fs1.42.9 (28-Dec-2013)

Filesystemlabel=

OS type:Linux

Blocksize=4096 (log=2)

Fragmentsize=4096 (log=2)

Stride=0blocks, Stripe width=0 blocks

655360inodes, 2621440 blocks

131072blocks (5.00%) reserved for the super user

Firstdata block=0

Maximumfilesystem blocks=2151677952

80 blockgroups

32768 blocksper group, 32768 fragments per group

8192inodes per group

Superblockbackups stored on blocks:

        32768, 98304, 163840, 229376, 294912,819200, 884736, 1605632

 

Allocatinggroup tables: done

Writinginode tables: done

Creatingjournal (32768 blocks): done

Writingsuperblocks and filesystem accounting information: done //格式化完成

 

#  mdadm /dev/md0 -a /dev/sdb1   //在线添加磁盘到/Dev/md0

mdadm:added /dev/sdb1

# cat /proc/mdstat

Personalities: [raid1]

md0 :active raid1 sdb1[2] sdc1[1]

      10477440 blocks super 1.2 [2/1] [_U]

      [===========>.........]  recovery = 55.2% (5792896/10477440)finish=0.3min speed=206889K/sec

 

unuseddevices: <none>

查看日志重建过程

#tail -f /var/log/messages

 kernel: sdb: sdb1

 kernel: md:bind<sdb1>

 kernel: md:recovery of RAID array md0

 kernel: md:minimum _guaranteed_  speed: 1000KB/sec/disk.

 kernel: md:using maximum available idle IO bandwidth (but not more than 200000 KB/sec) forrecovery.

 kernel: md:using 128k window, over a total of 10477440k.

 kernel: md:md0: recovery done.

 

 

mdadm使用文档

mdadm中文man(引用)

基本语法: mdadm [mode][options]

[mode] 7种:

Assemble:将以前定义的某个阵列加入当前在用阵列。

BuildBuild a legacy array ,每个device 没有 superblocks

Create:创建一个新的阵列,每个device 具有 superblocks

Manage:管理阵列,比如 add remove

Misc:允许单独对阵列中的某个 device 做操作,比如抹去superblocks或终止在用的阵列。

Follow or Monitor:监控 raid 1,4,5,6 multipath 的状态

Grow:改变raid 容量或阵列中的 device 数目

可用的[options]:

-A, --assemble:加入一个以前定义的阵列

-B, --buildBuild a legacy array without superblocks.

-C, --create:创建一个新的阵列

-Q, --query:查看一个device,判断它为一个 mddevice 或是一个 md 阵列的一部分

-D, --detail:打印一个或多个 md device 的详细信息

-E, --examine:打印 device 上的 md superblock 的内容

-F, --follow, --monitor:选择 Monitor 模式

-G, --grow:改变在用阵列的大小或形态

-h, --help:帮助信息,用在以上选项后,则显示该选项信息

--help-options

-V, --version

-v, --verbose:显示细节

-b, --brief:较少的细节。用于 --detail --examine 选项

-f, --force

-c, --config= :指定配置文件,缺省为/etc/mdadm/mdadm.conf

-s, --scan:扫描配置文件或 /proc/mdstat以搜寻丢失的信息。配置文件/etc/mdadm/mdadm.conf

create build 使用的选项:

-c, --chunk=:Specify chunk size of kibibytes. 缺省为 64.

--rounding=: Specify rounding factor for lineararray (==chunk size)

-l, --level=:设定 raid level.

--create可用:linear, raid0, 0, stripe, raid1,1, mirror,raid4, 4, raid5, 5, raid6, 6, multipath, mp.

--build可用:linear, raid0, 0,stripe.

-p, --parity=:设定 raid5 的奇偶校验规则:eft-asymmetric,left-symmetric, right-asymmetric, right-symmetric, la, ra, ls, rs.缺省为left-symmetric

--layout=:类似于--parity

-n, --raid-devices=:指定阵列中可用 device 数目,这个数目只能由 --grow 修改

-x, --spare-devices=:指定初始阵列的富余device 数目

-z, --size=:组建RAID1/4/5/6后从每个device获取的空间总数

--assume-clean:目前仅用于 --build 选项

-R, --run:阵列中的某一部分出现在其他阵列或文件系统中时,mdadm会确认该阵列。此选项将不作确认。

-f, --force:通常mdadm不允许只用一个device 创建阵列,而且创建raid5时会使用一个device作为missing drive。此选项正相反。

-a, --auto{=no,yes,md,mdp,part,p}{NN}

总结:体会用mdadm创建RAID1的过程