python多进程拉取数据库数据

最新推荐文章于 2023-12-25 15:02:48 发布

EchoYMa

最新推荐文章于 2023-12-25 15:02:48 发布

阅读量301

点赞数

分类专栏： python 线程池文章标签：数据库

本文链接：https://blog.csdn.net/M_mmmy/article/details/129026389

版权

python 同时被 2 个专栏收录

4 篇文章 0 订阅

订阅专栏

线程池

2 篇文章 0 订阅

订阅专栏

import multiprocessing
import psycopg2

def get_data(start, end):
    driver = '{ODBC Driver 17 for SQL Server}'
    username = ''
    server = ''
    database = ''
    password = ''
    con_str = f'DRIVER={driver};SERVER={server};PORT=1433;DATABASE={database};UID={username};PWD={password}'
    cnxn = pyodbc.connect(con_str)
    cur = cnxn.cursor()
    cur.execute("SELECT * FROM mytable WHERE id BETWEEN %s AND %s", (start, end))
    rows = cur.fetchall()
    conn.close()
    return rows

def main():
    pool = multiprocessing.Pool(processes=4)
    results = []
    for i in range(0, 100, 25):
        result = pool.apply_async(get_data, args=(i, i+25))
        results.append(result)
    pool.close()
    pool.join()
    for result in results:
        print(result.get())

if __name__ == '__main__':
    main()