ceph 安装

部署架构

环境要求

操作系统：centos7.4
配置：4核8G
ceph-deploy：2.0.1
ceph：ceph version 12.2.11 (26dc3775efc7bb286a1d6d66faee0ba30ea23eee) luminous (stable)

安装 CEPH-DEPLOY

1. 设置源：

所有节点

curl -o /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo
curl -o /etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-7.repo
[root@admin-node ~]# cat /etc/yum.repos.d/ceph.repo 
[ceph-noarch]
name=Ceph noarch packages
baseurl=http://mirrors.aliyun.com/ceph//rpm-luminous/el7/noarch
enabled=1
gpgcheck=1
type=rpm-md
gpgkey=http://mirrors.aliyun.com/ceph/keys/release.asc

2、update系统

所有节点

[root@node1 ~]# yum update

3、安装ceph-deploy

所有节点

yum install ceph-deploy

安装完后请验证版本是否正确(2.0.1)

配置hosts

所有节点

[trceph@node1 ~]$ cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
10.200.137.63 admin-node
10.200.137.60 node1
10.200.137.61 node2
10.200.137.62 node3

CEPH NODE 安装

1、安装ntp

所有节点：

[root@node1 ~]# yum install ntp ntpdate ntp-doc -y
[root@node1 ~]# systemctl enable ntpd
[root@node1 ~]# systemctl start ntpd

2、安装ssh server

所有节点：

[root@node3 ~]# yum install openssh-server -y

3、CREATE A CEPH DEPLOY USER

所有节点：

[root@node3 ~]# useradd -d /home/trceph -m trceph
[root@node3 ~]# passwd trceph

设置sudo权限

[root@node3 ~]# echo "trceph ALL = (root) NOPASSWD:ALL" | sudo tee /etc/sudoers.d/trceph          
trceph ALL = (root) NOPASSWD:ALL
[root@node3 ~]# chmod 0440 /etc/sudoers.d/trceph

4、ENABLE PASSWORD-LESS SSH

admin-node节点，trceph用户：

[trceph@host-10-200-137-63 ~]$ ssh-keygen
Generating public/private rsa key pair.
Enter file in which to save the key (/home/trceph/.ssh/id_rsa): 
Created directory '/home/trceph/.ssh'.
Enter passphrase (empty for no passphrase): 
Enter same passphrase again: 
Your identification has been saved in /home/trceph/.ssh/id_rsa.
Your public key has been saved in /home/trceph/.ssh/id_rsa.pub.
The key fingerprint is:
33:73:2a:84:18:8e:0b:6f:83:ff:f3:b4:1e:c6:33:ca trceph@host-10-200-137-63
The key's randomart image is:

ssh-copy-id {username}@node1
ssh-copy-id {username}@node2
ssh-copy-id {username}@node3

5、设置~/.ssh/config

admin-node节点，trceph用户：

Host node1
   HostName node1
   User trceph
Host node2
   HostName node2
   User trceph
Host node3
   HostName node3
   User trceph

[root@admin-node ~]# chmod 600 /home/trceph/.ssh/config

6、其他

所有节点：

[root@node1 yum.repos.d]# yum install python-setuptools -y
[root@admin-node ~]# yum install yum-plugin-priorities

7、关闭防火墙、selinux

所有节点：

[trceph@node1 ~]$ sudo systemctl stop firewalld
[trceph@node1 ~]$ sudo systemctl disable firewalld
[trceph@node1 ~]$ sudo setenforce 0

搭建集群

admin-node节点，trceph用户：

mkdir my-cluster
cd my-cluster
ceph-deploy new node1 node2 node3
ceph-deploy install  node1 node2 node3 --repo-url=http://mirrors.aliyun.com/ceph/rpm-luminous/el7/ --gpg-url=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-7 
ceph-deploy mon create-initial
ceph-deploy admin node1 node2 node3
ceph-deploy mgr create node1  *Required only for luminous+ builds, i.e >= 12.x builds*
#centos/sdb为lvm创建，vg:centos，lv：sdb
ceph-deploy osd create --data centos/sdb node1
ceph-deploy osd create --data centos/sdb node2
ceph-deploy osd create --data centos/sdb node3
ssh node1 sudo ceph -s


ceph-deploy mds create node1
ceph-deploy rgw create node1