ceph部署

一.环境准备

1.节点分布

节点	网卡1	网卡2	硬盘1	硬盘2	安装	组件
ceph01	172.30.100.3	10.100.100.210	sda	sdb	ceph-deploy	mgr，mon，osd
ceph02	172.30.100.4	10.100.100.211	sda	sdb	ceph	mgr，mon，osd
ceph03	172.30.100.5	10.100.100.212	sda	sdb	ceph	mgr，mon，osd

2.设置主机名（ceph01、ceph02、ceph03）

hostnamectl set-hostname ceph01

hostnamectl set-hostname ceph02

hostnamectl set-hostname ceph03

3.设置免密登录（ceph01、ceph02、ceph03）

在ceph01上执行：

ssh-keygen -t rsa    #一直回车

ssh-copy-id -i ~/.ssh/id_rsa.pub   ceph02

ssh-copy-id -i ~/.ssh/id_rsa.pub   ceph03

在ceph02上执行：

ssh-keygen -t rsa    #一直回车

ssh-copy-id -i ~/.ssh/id_rsa.pub   ceph01

ssh-copy-id -i ~/.ssh/id_rsa.pub   ceph03

在ceph03上执行：

ssh-keygen -t rsa    #一直回车

ssh-copy-id -i ~/.ssh/id_rsa.pub   ceph01

ssh-copy-id -i ~/.ssh/id_rsa.pub   ceph02

4.防火墙、selinux （ceph01、ceph02、ceph03）

systemctl stop firewalld.service

systemctl disable firewalld.service

sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config

setenforce 0

getenforce

5.时间同步（ceph01、ceph02、ceph03）

设置上海时区

ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

yum install chrony

vim /etc/chrony.conf

添加：

server ceph01 iburst

allow 192.168.0.0/16    #打开注释

systemctl enable chronyd.service && systemctl start chronyd.service

systemctl status chronyd.service

6. 关闭NetworkManager

systemctl stop NetworkManager.service

systemctl disable NetworkManager.service

systemctl status NetworkManager.service

重启网络

systemctl restart network

 二.安装

1.设置yum源（ceph01,ceph02,ceph03）

cd /etc/yum.repos.d/

yum install wget -y

mkdir bak

备份yum源

mv ./* bak/

下载ceph相关的yum源

wget -O /etc/yum.repos.d/CentOS-Base.repo https://mirrors.huaweicloud.com/repository/conf/CentOS-7-anon.repo
wget http://mirrors.aliyun.com/repo/epel-7.repo -P /etc/yum.repos.d/

vi /etc/yum.repos.d/ceph.repo

[ceph]
name=Ceph packages for $basearch
baseurl=http://mirrors.aliyun.com/ceph/rpm-nautilus/el7/x86_64
enabled=1
gpgcheck=0
[ceph-noarch]
name=Ceph noarch packages
baseurl=http://mirrors.aliyun.com/ceph/rpm-nautilus/el7/noarch
enabled=1
gpgcheck=0
[ceph-source]
name=Ceph source packages
baseurl=http://mirrors.aliyun.com/ceph/rpm-nautilus/el7/SRPMS
enabled=1
gpgcheck=0

yum clean all && yum makecache

2.安装ceph管理工具（ceph01）

[root@ceph01 ~]#  mkdir /etc/ceph/

[root@ceph01 ~]#  cd  /etc/ceph/

[root@ceph01 ceph]#  yum install -y ceph-deploy

3.安装ceph（ceph01,ceph02,ceph03）

所有节点安装ceph ：yum install -y ceph

4.安装

[root@ceph01 ceph]#  ceph-deploy new ceph01 ceph02 ceph03//创建一个新的集群 并把相应节点加入到集群中

[root@ceph01 ceph]#  ceph-deploy mon create-initial     //初始化认证文件

创建创建osd
[root@ceph01 ceph]#  ceph-deploy osd create --data /dev/sdb ceph01
[root@ceph01 ceph]#  ceph-deploy osd create --data /dev/sdb ceph02
[root@ceph01 ceph]#  ceph-deploy osd create --data /dev/sdb ceph03
[root@ceph01 ceph]#  ceph-deploy admin   ceph01  ceph03 ceph03 下载认证文件

在ceph02和ceph03执行如下命令
[root@ceph02 ~]# cd /etc/ceph/
[root@ceph02 ceph]#  chmod a+x ceph.client.admin.keyring 

将节点加入到mgr 里面
[root@ceph01ceph]# ceph-deploy mgr create ceph01 ceph02 ceph03

5.安装pip3

yum install python36-devel

pip3 install pecan werkzeug

接下来我们要用openstack对接ceph： https://blog.csdn.net/qq_41786090/article/details/131574739