airflow 安装

当前配置情况：
Python 2.7.5
Mysql 5.7.31
pip 20.1.1
airflow 1.10.11

1、默认自带python2环境，自行安装pip

sudo yum -y install epel-release
sudo yum -y install python-pip1

2、进行pip的更新，否则很多安装会报错

sudo pip install --upgrade pip
sudo pip install --upgrade setuptools

3、安装开发库

sudo yum install python-devel
sudo yum install libevent-devel
sudo yum install mysql-devel

4、安装centos7下的mysql

执行yum源更新命令

sudo yum clean all

sudo yum makecache

sudo yum -y update （需要比较长的时间）

5、初始化配置mysql，可以设定允许root远程登录

关闭防火墙

sudo firewall-cmd --zone=public --add-port=3306/tcp --permanent
sudo firewall-cmd --reload

6、配置Mysql默认编码为UTF-8
修改/etc/my.cnf配置文件，在[mysqld]下添加编码配置

 character_set_server=utf8
init_connect='SET NAMES utf8'

编辑保存完 重启mysql服务: service mysqld restart

7、安装AirFlow
给airflow设置环境变量

sudo vim /etc/profile

#airflow
export AIRFLOW_HOME=/opt/modules/airflow
export SLUGIFY_USES_TEXT_UNIDECODE=yes

刷新环境变量

安装airflow

 sudo pip install apache-airflow

遇到问题：

 ERROR: Cannot uninstall 'enum34',It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial install

A:

  sudo pip install six --user -U
  sudo pip install ipython --user -U
  sudo pip install --ignore-installed dnspython
  sudo yum install python-devel

  sudo yum install openldap-devel

  sudo pip install --ignore-installed python-ldap

  sudo pip install --ignore-installed enum34



ERROR:Cannot uninstall 'requests',It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

A:

 sudo pip install --ignore-installed requests

8、 设置mysql数据库连接

sudo pip install apache-airflow[mysql]

error：
Error: Package: 1:mariadb-devel-5.5.65-1.el7.x86_64 (base) Requires: libmysq

解决方法：

cd /etc/yum.repos.d/

rpm -ivh http://repo.mysql.com/mysql57-community-release-el7-8.noarch.rpm

yum install mysql-devel

创建airflow用户,创建airflow数据库并给出所有权限给此用户（注意在设置密码的时候还是前面讲的问题，不能太简单，否则不能通过）

修改airflow配置文件，指向数据库mysql
airflow.cfg 文件通常在~/airflow目录下

executor =  LocalExecutor
sql_alchemy_conn = mysql://airflow:AirFlow123!@192.168.189.11/airflow
对应字段解释如下： dialect+driver://username:password@host:port/database

修改mysql的配置文件

vim /etc/my.cnf

添加这一句

	explicit_defaults_for_timestamp=1

重启mysql

9、初始化airflow并启动web服务

初始化数据库
airflow initdb
启动 airflow webserver
airflow webserver

airflow scheduler
airflow worker

文档参考； https://www.cnblogs.com/braveym/p/11378851.html

入门指南： https://blog.csdn.net/qazplm12_3/article/details/53065654