我已经定义了这个功能
def writeonfiles(a,seed):
random.seed(seed)
f = open(a, "w+")
for i in range(0,10):
j = random.randint(0,10)
#print j
f.write(j)
f.close()
其中a是包含文件路径的字符串,种子是整数种子.
我想以一种这样的方式并行化一个简单的程序,即每个内核都采用我提供的可用路径之一,播种其随机数生成器并在该文件上写入一些随机数,例如,如果我通过了
向量
vector = [Test/file1.txt, Test/file2.txt]
和种子
seeds = (123412, 989898),
它给第一个可用的核心功能
writeonfiles(Test/file1.txt, 123412)
第二个是具有不同参数的相同函数:
writeonfiles(Test/file2.txt, 989898)
我在Stackoverflow上浏览了很多类似的问题,但是我无法解决任何问题.
我试过的是:
def writeonfiles_unpack(args):
return writeonfiles(*args)
if __name__ == "__main__":
folder = ["Test/%d.csv" %i for i in range(0,4)]
seed = [234124, 663123, 12345 ,123833]
p = multiprocessing.Pool()
p.map(writeonfiles, (folder,seed))
并给我TypeError:writeonfiles()恰好接受2个参数(给定1个).
我也尝试过
if __name__ == "__main__":
folder = ["Test/%d.csv" %i for i in range(0,4)]
seed = [234124, 663123, 12345 ,123833]
p = multiprocessing.Process(target=writeonfiles, args= [folder,seed])
p.start()
但这给了我
??种子中的文件“ /usr/lib/python2.7/random.py”,第120行
????超级(随机,自我).种子(a)
TypeError:无法散列的类型:“列表”
最后,我尝试了contextmanager
@contextmanager
def poolcontext(*args, **kwargs):
pool = multiprocessing.Pool(*args, **kwargs)
yield pool
pool.terminate()
if __name__ == "__main__":
folder = ["Test/%d" %i for i in range(0,4)]
seed = [234124, 663123, 12345 ,123833]
a = zip(folder, seed)
with poolcontext(processes = 3) as pool:
results = pool.map(writeonfiles_unpack,a )
它导致
??在get中的文件“ /usr/lib/python2.7/multiprocessing/pool.py”,第572行
????提高自我价值
TypeError:“模块”对象不可调用