Airflow 初试

smtp 配置：

[smtp]
# If you want airflow to send emails on retries, failure, and you want to use
# the airflow.utils.email.send_email_smtp function, you have to configure an smtp
# server here
smtp_host = 
smtp_starttls = False
smtp_ssl = False
smtp_user = 
smtp_port = 
smtp_password = 
smtp_mail_from =

一个DAG例子：test.py

from airflow.models import DAG
from airflow.operators import BashOperator
from datetime import datetime, timedelta

default_args = {
    'owner': 'hadoop',         
    'depends_on_past': False, 
    'start_date': datetime(2017, 4, 27),
    'email': ['***@163.com', ...],
    'email_on_failure': True,
    'email_on_retry': True,
    #'queue':'celery', 
}

dag = DAG(dag_id='dag1', 
        default_args=default_args,
        schedule_interval='0 0 * * *'
        )

t1 = BashOperator(
    task_id='task1', 
    bash_command="***", 
    dag=dag)

t2 = BashOperator(
    task_id='task2', 
    bash_command="***", 
    dag=dag)

t3 = BashOperator(
    task_id='task3', 
    bash_command="***", 
    dag=dag)

t2.set_upstream(t1)
t3.set_upstream(t2)

more：

1. http://pythonhosted.org/airflow/
2. http://itfish.net/article/63888.html
3. http://ju.outofmemory.cn/entry/245373