【Notes】Multi-Behavior Sequential Recommendation with Temporal Graph Transformer(2022)
Xia L, Huang C, Xu Y, et al. Multi-Behavior Sequential Recommendation with Temporal Graph Transformer[J]. IEEE Transactions on Knowledge and Data Engineering, 2022.
Key challenge:
(1)如何处理交叉行为之间的关系(不同行为可能传递互补的信号)
(2) 时序多行为的融合
问题定义:
给定用户 u i ∈ U u_i\in U ui∈U,其行为序列 S i ∈ S S_i\in S Si∈S由三元组构成: ( v k , i , b , t ) (v_{k,i},b,t) (vk,i,b,t),其中行为 b ∈ B b\in B b∈B
给定序列 s i s_i si,预测经过 t K , i t_{K,i} tK,i后可能进行交互的商品
1.对于用户 u i u_i ui分为几个sub-users,对应sub-sequence S i k S_i^k Sik(如何进行切分是一项调整的参数)(划分sub-sequence的我认为目的是分别对short-item和long-item两方面进行处理)
2.利用transformer的结构捕捉short-term的信息:首先分割为sub-sequence(short-term);(a)Behavior-Aware Context Embedding: 然后对于sub-sequence,time的embedding采用正余弦函数;与item和behavior的embedding相加构成使用的embedding(使得embedding可以包含时间信息和行为信息)(b)Item-Wise Sequential Dependency: 利用transformer的结构捕捉( E ‾ k r = ∥ h = 1 H ∑ k ′ = 1 K α k , k ′ V h E k ′ r \overline{E}_k^r=\Vert_{h=1}^H\sum^K_{k'=1}\alpha_{k,k'}V^hE_{k'}^r Ekr=∥h=1H∑k