Django异步工具Celery安装

一、环境要求

操作系统版本：centos
操作系统内核：4.7.1
系统工具：yum
数据分区（200G容量以上）：/data

二、安装Celery相关服务

pip install celery
pip install celery-with-redis
pip install django-celery

三、编辑：settings.py文件添以下内容

#####配置celery####
import djcelery
djcelery.setup_loader()
BROKER_URL = 'redis://xx.xx.xx.xx:6379/10'
CELERY_RESULT_BACKEND = 'redis://xx.xx.xx.xx:6379/11'
CELERY_ACCEPT_CONTENT = ['application/json']
CELERY_TASK_SERIALIZER = 'json'
CELERY_RESULT_SERIALIZER = 'json'
CELERY_TIMEZONE = 'Africa/Nairobi'
SECRET_KEY = '8lu*6g0lg)9z!ba+a$ehk)xt)x%rxxgb$i1&022shmi1jcgihb*'

四、编辑：jumpserver/init.py文件添以下内容

from __future__ import absolute_import
from .celery import app as celery_app

五、编辑：jumpserver/celery.py文件添以下内容

from __future__ import absolute_import  
import os
import django
from celery import Celery  
from django.conf import settings  

# set the default Django settings module for the 'celery' program.  
os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'jumpserver.settings')
django.setup()
app = Celery('jumpserver')

# Using a string here means the worker will not have to  
# pickle the object when using Windows.  
app.config_from_object('django.conf:settings')  
app.autodiscover_tasks(lambda: settings.INSTALLED_APPS)  

@app.task(bind=True)  
def debug_task(self):  
    print('Request: {0!r}'.format(self.request))

六、编辑：jumpserver/tasks.py文件添以下内容

from jumpserver import celery_app

@celery_app.task()
def longtime_addd(x, y):
    print 'long time task begins'
    # sleep 5 seconds
    time.sleep(5)
    print 'long time task finished'
    return x + y

七、启动celery

celery -A jumpserver worker -l info

八、测试

python manage.py shell

from deploy.tasks import *

result = longtime_addd.delay(1,2)

print 'Task finished? ', result.ready()
print 'Task result: ', result.result

九、结合supervisor配置后台运行celery

安装：pip install supervisor
生成配置文件：echo_supervisord_conf > /etc/supervisord.conf
编辑配置文件：/etc/supervisord.conf添加以下内容
[program:celery]
command=celery -A jumpserver worker --loglevel=info
directory=/data/xxxxx
stdout_logfile=/data/xxxxx/logs/celery.log
autorestart=true
redirect_stderr=true

启动：supervisord -c /etc/supervisord.conf

查看日志：tail -f /data/polaris/logs/celery.log





     本文转自aaron428 51CTO博客，原文链接：http://blog.51cto.com/aaronsa/2056883，如需转载请自行联系原作者