常用环境部署(五)——Docker部署airflow和Centos安装Python3.5

一、CentOS 7下安装Python3.5

1、安装python3.5可能使用的依赖

yum install openssl-devel bzip2-devel expat-devel gdbm-devel readline-devel sqlite-devel

2、下载Python

cd /data

wget https://www.python.org/ftp/python/3.5.0/Python-3.5.0.tgz

 3、解压下载的安装包

tar -zxvf Python-3.5.0.tgz

4、配置编译

 sudo mkdir /data/python3

 cd /data/Python-3.5.0

 ./configure --prefix=/data/python3

 make

 make install

5、备份旧版本python，链接新版本python

在/usr/bin中有python、python2、python2.7三个文件依次指向后者

 sudo mv python python.bak

 sudo ln -s /usr/local/python3/bin/python3 /usr/bin/python

6、修改yum配置文件 

sudo vi /usr/bin/yum

将第一行指定的python版本改为python2.7(#!/usr/bin/python 改为 #!/usr/bin/python2.7)

7、执行命令python可以看到python版本为3.5.0

退出命令：exit()

 二、Docker-compose部署airflow

 1、在服务器上新建目录/data/airflow

mkdir -p /data/airflow

  

2、在/data/airflow/目录下新建一个文件docker-compose.yml，打开文件，输入下面内容，然后保存。

# 下载地址
curl -LfO 'https://airflow.apache.org/docs/apache-airflow/2.2.5/docker-compose.yaml'

vim docker-compose.yml

# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.  See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.  The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License.  You may obtain a copy of the License at
#
#   http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied.  See the License for the
# specific language governing permissions and limitations
# under the License.
#

# Basic Airflow cluster configuration for CeleryExecutor with Redis and PostgreSQL.
#
# WARNING: This configurati