[flink]#10_Flink Job @ Standalone、YARN、Mesos、K8S

Standalone

./bin/start-cluster.sh

# jps
65425 Jps 
51572 TaskManagerRunner 
51142 StandaloneSessionClusterEntrypoint

StandaloneSessionClusterEntrypoint 代表的是 Job Manager 进程
TaskManagerRunner 代表的是 Task Manager 进程

可在flink-conf.yaml配置集群:

masters 
slaves

增加一个 Task Manager：
bin/taskmanager.sh start|start-foreground|stop|stop-all

增加一个 Job Manager：(Standalone 下最多只能运行一个 Job Manager)
bin/jobmanager.sh ((start|start-foreground) [host] [webui-port])|stop|stop-all

Yarn

Mesos

• jobmanager-service.yaml

apiVersion: v1 
kind: Service 
metadata:
	name: flink-jobmanager 
spec:
	ports:
		- name: rpc 
			port: 6123
		- name: blob 
			port: 6124
		- name: query 
			port: 6125
		- name: ui 
			port: 8081
		selector:
			app: flink 
			component: jobmanager

• jobmanager-deployment.yaml

apiVersion: extensions/v1beta1 
kind: Deployment 
metadata:
  name: flink-jobmanager 
spec:
  replicas: 1 
    template:
      metadata:
        labels:
          app: flink 
          component: jobmanager 
      spec:
        containers:
        - name: jobmanager 
          image: flink:latest 
          args:
          - jobmanager 
          ports:
          - containerPort: 6123 
            name: rpc
          - containerPort: 6124 
            name: blob
          - containerPort: 6125 
            name: query
          - containerPort: 8081 
            name: ui 
          env:
          - name: JOB_MANAGER_RPC_ADDRESS 
            value: flink-jobmanager

• taskmanager-deployment.yaml

apiVersion: extensions/v1beta1 
kind: Deployment 
metadata:
  name: flink-taskmanager 
spec:
  replicas: 2
  template:
    metadata:
      labels:
        app: flink 
        component: taskmanager 
    spec:
      containers:
        - name: taskmanager
          image: flink:latest 
          args:
          - taskmanager 
          ports:
            - containerPort: 6121 
              name: data
            - containerPort: 6122 
              name: rpc
            - containerPort: 6125 
              name: query 
            env:
            - name: JOB_MANAGER_RPC_ADDRESS 
              value: flink-jobmanager

kubectl create -f jobmanager-service.yaml

kubectl create -f jobmanager-deployment.yaml

kubectl create -f taskmanager-deployment.yaml

看 Flink 自带的 UI:kubectl port-forward service/flink-jobmanager 8081:8081
提交Job./bin/flink run -d -m localhost:8081 ~/word-count.jar