列表去重
1.方法1 借助一个临时列表
ids = [1,2,3,3,4,2,3,4,5,6,1]
news_ids = []
for id in ids:
if id not in news_ids:
news_ids.append(id)
print news_ids
2.方法2 使用set方法进行去重,此方法处理简单但是不会保留之前的顺序
ids = [1,4,3,3,4,2,3,4,5,6,1]
ids = set(ids)
3.方法3 使用匿名函数lambda和reduce函数处理
ids = [1,4,3,3,4,2,3,4,5,6,1]
func = lambda x,y:x if y in x else x + [y]
ids = reduce(func, [[], ] + ids)
print ids
import itertools
ids = [1,4,3,3,4,2,3,4,5,6,1]
ids.sort()
it = itertools.groupby(ids)
ids_new=[]
for k, g in it:
ids_new.append(k)
print ids_new
5.使用wihile遍历去重
ids = [1,2,1,1,1,2,3,4,5]
def delRepeat(liebiao):
for x in liebiao:
while liebiao.count(x)>1:
del liebiao[liebiao.index(x)]
print liebiao
delRepeat(ids)