python的list和numpy两种数组都有需要去重的时候,总结一些网上资料如下。
list
方法1:listout = {}.fromkeys(listin).keys()
a = [1,1,2,3,5,7,5]
b = {}.fromkeys(a).keys()
方法2:listout = list(set(listin))
a = [1,1,2,3,5,7,5]
b = list(set(a))
方法3:itertools.groupby()
import itertools
a = [1,1,2,3,5,7,5]
a.sort()
it = itertools.groupby(a)
for k, g in it:
print (k)
numpy
使用np.unique()
import numpy as np
a = np.array([[1,2,3,4],[2,3,4,5]])
b = np.unique(a)