k8s文件服务器,fastdfs文件服务器k8s简单搭建

本次部署参考以下文章

github克隆项目

git clone --branch V6.06 --depth 1 https://github.com/happyfish100/fastdfs.git

镜像构建

进入docker 目录构建镜像，经过多次尝试，其中dockerfile_local本地构建的Dockerfile有问题，运行的命令不太对，文件都没有解压，使用网络版本目录(dockerfile_network)成功构建

docker build -t aaaa:1.0 .

image

编写tracker.yaml

apiVersion: apps/v1

kind: Deployment

metadata:

name: tracker-deploy

namespace: fastdfs

labels:

name: tracker-deploy

spec:

selector:

matchLabels:

app: tracker

replicas: 1

template:

metadata:

labels:

app: tracker

spec:

nodeSelector:

fastdfs-tracker: "tracker"

terminationGracePeriodSeconds: 0

containers:

- name: tracker

image: aaaa:1.0

imagePullPolicy: IfNotPresent

env:

- name: FASTDFS_IPADDR

value: 192.168.1.222 # 这是我的宿主机地址 ，资源有限 都跑在了master节点上

ports:

- containerPort: 22122

- containerPort: 23000

- containerPort: 8080

- containerPort: 8888

volumeMounts:

- name: tracker-volume

mountPath: /home/dfs # 地址在/home/dfs

command: ["/home/fastdfs.sh","tracker"]

volumes:

- name: tracker-volume

nfs: #这是我的nfs路径 可以用其他挂载卷代替

path: /data/nfs/sre/fastdfs-tracker

server: 192.168.1.222

---

apiVersion: v1

kind: Service

metadata:

name: tracker

labels:

app: tracker

namespace: fastdfs

spec:

selector:

app: tracker

type: NodePort

ports:

- name: "22122"

port: 22122

targetPort: 22122

nodePort: 22122

- name: nginx

port: 8888

targetPort: 8888

nodePort: 28888

编写storage.yaml

apiVersion: apps/v1

kind: Deployment

metadata:

name: storage0-deploy

namespace: fastdfs

labels:

name: storage0-deploy

spec:

selector:

matchLabels:

app: storage0

replicas: 1

template:

metadata:

labels:

app: storage0

spec:

nodeSelector:

fastdfs: "storage0"

terminationGracePeriodSeconds: 0

containers:

- name: storage0

image: aaaa:1.0

imagePullPolicy: IfNotPresent

ports:

- containerPort: 22122

- containerPort: 23000

- containerPort: 8080

- containerPort: 8888

volumeMounts:

- name: storage0-volume

mountPath: /home/dfs

env:

- name: TRACKER_SERVER

value: 192.168.1.122:22122

- name: FASTDFS_IPADDR

value: 192.168.1.222

command: ["/home/fastdfs.sh","storage"]

volumes:

- name: storage0-volume

nfs:

path: /data/nfs/sre/fastdfs-storage0

server: 192.168.1.222

---

apiVersion: v1

kind: Service

metadata:

name: storage0

labels:

app: storage0

namespace: fastdfs

spec:

selector:

app: storage0

type: NodePort

ports:

- name: "23000"

port: 23000

targetPort: 23000

nodePort: 23000

- name: nginx1

port: 8888

targetPort: 8888

nodePort: 38888

注： 环境变量TRACKER_SERVER 应该是无效 我是配置了FASTDFS_IPADDR 之后才识别到tracker地址(/etc/fdfs/storage.conf ),没有FASTDFS_IPADDR 时 tracker_server只有一个端口，应该是我与参考文章构建镜像的方式不同

# tracker_server can ocur more than once, and tracker_server format is

# "host:port", host can be hostname or ip address

tracker_server=192.168.1.222:22122

java端连通测试

java客户端依赖如下jar包

com.github.tobato

fastdfs-client

application.yaml配置

fdfs:

so-timeout: 1501 # 超时时间

connect-timeout: 601 # 连接超时时间

thumb-image: # 缩略图

width: 60

height: 60

tracker-list: # tracker地址

- 192.168.1.222:22122

配置

@Configuration

@Import(FdfsClientConfig.class)

@EnableMBeanExport(registration = RegistrationPolicy.IGNORE_EXISTING)

public class FastClientImporter {

}

测试代码

@SpringBootTest

@RunWith(SpringRunner.class)

public class TestUpload {

@Autowired

private FastFileStorageClient storageClient;

@Test

public void testUpload() throws FileNotFoundException {

File file = new File("D:\\add.svg");

StorePath storePath = this.storageClient.uploadFile(

new FileInputStream(file), file.length(), "svg", null);

System.out.println(storePath.getFullPath());

}

}

下载

通过tracker service的nodeProt暴漏的的nginx端口 28888 无法访问，但是通过storage service暴漏的38888 可以直接获取到资源(url的path地址为storePath.getFullPath获取到的地址),不确定这里是否有问题，查阅资料是客户端通过tracker获取到可用的storage，然后客户端与storage通讯完成下载

image.png