python batch 批处理 框架_batch-processor-此库用于通过实现python多处理来启用批处理- install quickstart test build...

作者:

### 作者邮箱:

### 首页:https://github.com/leon0707/batch_processor

### 文档:None

### 下载链接

# batch_processor

install

pip install batch_processor

quickstart

from threading import Thread

from batch_processor import BatchProcessor

def batch_func(batch):

return [v + v for v in batch]

def create_bulk_request(n, processor):

print(n, processor.process(n))

processor = BatchProcessor(batch_func, worker_num=2, batch_size=32)

threads = []

for i in range(200):

t = Thread(target=create_bulk_request, args=(i, self.proc