Luigi is a Python package that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.
Luigi 是python的一个框架,可以实现复杂的Job批处理,可以很好的管理Job的依赖,workflow,并提供可视化和错误提示,并提供命令行执行
It includes support for running