python字典初始化_如何在Python中设置字典的初始大小？

I'm putting around 4 million different keys into a Python dictionary.

Creating this dictionary takes about 15 minutes and consumes about 4GB of memory on my machine. After the dictionary is fully created, querying the dictionary is fast.

I suspect that dictionary creation is so resource consuming as the dictionary is very often rehashed (as it grows enormously).

Is is possible to create a dictionary in Python with some initial size or bucket number?

My dictionary points from a number to an object.

class MyObject(object):

def __init__(self):

# some fields...

d = {}

d[i] = MyObject() # 4M times on different key...

解决方案

With performance issues it's always best to measure. Here are some timings:

d = {}

for i in xrange(4000000):

d[i] = None

# 722ms

d = dict(itertools.izip(xrange(4000000), itertools.repeat(None)))

# 634ms

dict.fromkeys(xrange(4000000))

# 558ms

s = set(xrange(4000000))

dict.fromkeys(s)

# Not including set construction 353ms

The last option doesn't do any resizing, it just copies the hashes from the set and increments references. As you can see, the resizing isn't taking a lot of time. It's probably your object creation that is slow.