apply筛选 pandas_如何做pandas数据筛选的性能优化

Function: digg_data_byrule at line 56

Line # Hits Time Per Hit % Time Line Contents

==============================================================

56 def digg_data_byrule(df,rules):

57 1546 1398.0 0.9 0.0 info=""

58 7730 6465.0 0.8 0.0 for rule in rules:

59 6184 2076181.0 335.7 9.4 date_list=utils.datelist(rule[0],rule[1])

60 6184 9205.0 1.5 0.0 days = len(date_list)

61 6184 4966183.0 803.1 22.6 temp_df = df[df["data_date"].isin(date_list)]

62 6184 7782.0 1.3 0.0 flag = False

63 6184 20854.0 3.4 0.1 if len(temp_df) == days:

64 3100 2613.0 0.8 0.0 temp_array = []</