Table_1: Online user behavior before Dec.2015. (ijcai2016_taobao)
User_id 、Seller_id、Item_id、Category_id、Online_Action_id、Time_Stamp
Category为商品类别,共72类,Online_Action分为0点击、1购买
Table_2: Users’shopping records at brick-and-mortar stores before Dec. 2015. (ijcai2016_koubei_train)
User_id、Merchant_id、Location_id 、Time_Stamp
Table_3: Merchant information. (ijcai2016_merchant_info)
Merchant_id 、Budget(budget constraints imposed on the merchant) 、Location_id_list
Table_4: Prediction result. (ijcai2016_koubei_test)
User_id、Location_id、Merchant_id_list
1、根据Table_2和Table_4中的User_id对Table_1进行过滤,4000W+的数据量减少到2000W+;
import pandas as pd, os
os.chdir('c:/Bai/taobao/data sets')
df1 = pd.read_csv('ijcai2016_koubei_test',header=None)
df2 = pd.read_csv('ijcai2016_koubei_train',header=None)
sets = set(df1[0])|set(df2[0])
df3 = pd.read_csv('ijcai2016_taobao',header=None)
df3 = df3[df3[0].isin(sets)]
2、对淘宝数据进行统计,得到feature.csv,内容为:User_id, Category_id, Online_Action_id, number;
import math,os,numpy as np,csv
os.chdir('c:/Bai/taobao/data sets')
f = open("taobao.csv")
context = f.readlines()
u_dict = [{}for i in range(2)]
for line in context:
line = line.replace('\n','')
array = line.split(',')
if int(array[0])==0:
continue
u_id = (array[0],