参考:https://kubernetes.io/docs/concepts/storage/storage-classes/#local
Local volumes do not currently support dynamic provisioning, however a StorageClass should still be created to delay volume binding until Pod scheduling. This is specified by the WaitForFirstConsumer volume binding mode.
我们在裸机上安装kubernetes(私有开发环境),通常要自行设置默认storage class,常用的本地存储方式provisioner: kubernetes.io/no-provisioner
不支持dynamic provisioning。
比如使用helm安装redis-cluster,就有问题,因为它使用的是动态绑定storage class
helm show values bitnami/redis-cluster
我们可以自行创建一个provisioner,如:nfs-server-provisioner。
使用helm安装nfs-server-provisioner
查看说明,注意storageClass
的选择
helm show all apphub/nfs-server-provisioner
helm install nfs-server-provisioner apphub/nfs-server-provisioner -f nfs-config.yaml
nfs-config.yaml文件如下:
persistence:
##开启持久存储
enabled: true
##注意这个选择:standard
storageClass: "standard"
## 存储大小30g
size: 30Gi
storageClass:
##设置成默认storageclass
defaultClass: true
nodeSelector:
##安装到哪个node上,不要装在master上
kubernetes.io/hostname: node1
如果装在master上会报错:
1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 2 node(s) didn't match node selector.
创建pv
文件:nfs-server-pv.yaml
apiVersion: v1
kind: PersistentVolume
metadata:
name: data-nfs-server-provisioner-0
spec:
capacity:
## 与上面pvc size一致
storage: 30Gi
accessModes:
- ReadWriteOnce
hostPath:
## 绑定在node上的位置,先mkdir好
path: /data/k8s/volumes/data-nfs-server-provisioner-0
claimRef:
namespace: default
## 自动生成的pvc名字
name: data-nfs-server-provisioner-0
创建
k create -f nfs-server-pv.yaml
三、每台机器上都要装nfs
yum -y install nfs-utils
systemctl restart rpcbind && systemctl enable rpcbind
systemctl restart nfs && systemctl enable nfs
安装nfs会有df -f 卡住问题:
strace df
进行查看卡住的信息
pvc 常见问题排查与处理
#删除pvc,pv
kubectl patch pvc data-nfs-server-provisioner-0 -p '{"metadata":{"finalizers": [null]}}' --type merge
kubectl patch pv data-nfs-server-provisioner-0 -p '{"metadata":{"finalizers":null}}'
参考:
helm安装
https://blog.csdn.net/evane1890/article/details/112673261