一、安装环境
IP | hostname | IOS | |
10.2.151.230 | centos-2683 | centos 7.4 | master |
10.2.151.131 | x86-131 | centos 7.4 | node |
二、ceph搭建准备
(1)关闭selinux和防火墙(Master && node)
(1)关闭防火墙
启动: systemctl start firewalld
关闭: systemctl stop firewalld
查看状态: systemctl status firewalld
开机禁用: systemctl disable firewalld
开机启用: systemctl enable firewalld
(2)关闭Selinux
查看
$: getenforce
Disabled表示关闭;Enforcing表示开启
$:/usr/sbin/sestatus -v
SELinux status: disabled
临时关闭
setenforce 1 //设置SELinux 成为enforcing模式 (开)
setenforce 0 //设置SELinux 成为permissive模式(关)
永久关闭
$:vi /etc/selinux/config
将SELINUX=enforcing改为SELINUX=disabled
设置后需要重启才能生效
(2)实现节点间的ssh无密码登录
$: ssh-keygen -t rsa //一路回车即可
$:ssh-copy-id root@10.2.151.130 //传递master上的秘钥到node上
$:ssh 10.2.151.130 //验证ssh是否成功
(3)NTP时间同步
(4)在hosts文件添加主机名 (mater & node)
$:vim /etc/hosts
10.2.151.131 x86-131.centos74
10.2.152.230 centos-2683
三、配置ceph的yum源
$:cd /etc/yum.repos.d/
$:vim ceph.repo
[Ceph]
name=Ceph packages for $basearch
baseurl=http://mirrors.163.com/ceph/rpm-kraken/el7/$basearch
enabled=1
priority=1
gpgcheck=1
gpgkey=https://download.ceph.com/keys/release.asc
[Ceph-noarch]
name=Ceph noarch packages
baseurl=http://mirrors.163.com/ceph/rpm-kraken/el7/noarch
enabled=1
priority=1
gpgcheck=1
gpgkey=https://download.ceph.com/keys/release.asc
[ceph-source]
name=Ceph source packages
baseurl=http://mirrors.163.com/ceph/rpm-kraken/el7/SRPMS
enabled=0
priority=1
gpgcheck=1
gpgkey=https://download.ceph.com/keys/release.asc
$:yum -y install ceph-deploy //master & node
$:mkdir -p /etc/ceph //master & node
四、master上创建ceph集群
$:cd /etc/ceph
$:ceph-deploy new x86-131
配置ceph.conf文件
$: vim ceph.conf
[global]
fsid = 1c085c01-9838-420c-a792-5b4d66f2cbba
mon_initial_members = node-02
mon_host = 10.2.151.130
auth_cluster_required = cephx
auth_service_required = cephx
auth_client_required = cephx
public network = 10.2.151.0/24
五、初始化ceph集群
Master:
$: ceph-deploy install centos-2683 x86-131
六、初始化mon 并收集所有秘钥
master
$:ceph-deploy mon create-initial
$: ceph auth list
七、创建osd
master
$:ceph-deploy osd create x86-131:/dev/nvme0n1
八、使用ceph-deploy 把配置文件和master秘钥到管理节点node节点
master
$:ceph-deploy admin centos-2683 x86-131
九、给每个节点的keyring增加 r 权限
[root@centos-2683 ceph]# chmod +r ceph.client.admin.keyring
[root@centos-2683 ceph]# pwd
/etc/ceph
[root@x86-131 ceph]# chmod +r ceph.client.admin.keyring
[root@x86-131 ceph]# pwd
/etc/ceph
十、检查ceph集群状态
$: ceph health
$: ceph osd tree
$: ceph -s
十一、ceph图形监控(grafana + prometheus)
(1)获取grafana + prometheus(get)
(2)上传grafana.tar并解压
$:tar -xvf grafana.tar
$:cd grafana
(3)安装ceph_exporter
$:yum -y install net-tools //安装net-tools包
$:rpm -ivh ceph_exporter-2.0.0-1.x86_64.rpm //安装ceph_exporter
$:systemctl start ceph_exporter //启动ceph_exporter
$:systemctl enable ceph_exporter //加入开机自启动
$:netstat -antlp |grep 9128 //查看开放的端口号
(4)安装prometheus
$: rpm -ivh prometheus-2.3.2-1.x86_64.rpm 安装prometheus
$:systemctl start prometheus
$:systemctl enable prometheus
$:netstat -antlp |grep 9090
浏览器访问:http://10.2.151.230:9090
(5)安装grafanna
$: rpm -ivh grafana-5.2.1-1.x86_64.rpm //安装grafanna
$:systemctl start grafana-server
$::systemctl enable grafana-server
$:netstat -antlp |grep 3000
浏览器登录:http://10.2.151.230:3000
初始密码为:admin;admin
登录后会让你修改一次密码。
添加数据源
点击add data source
点击save保存
点击+号,导入模板,输入973直接下载
在Grafana.com Dashboad输入973下载模板
查看状态: