深度学习在CTR预估中的应用

Deep Learning for Click-Through Rate Estimation

Weinan Zhang, Jiarui Qin, Wei Guo, Ruiming Tang, Xiuqiang He

Shanghai Jiao Tong University, Huawei Noah’s Ark Lab

https://arxiv.org/pdf/2104.10584.pdf

点击率预估在很多个性化在线服务中起着非常重要的作用，是一个重要模块，比如在线广告，推荐系统，网络搜索等。

自从2015年起，深度学习的成功开始用于提升点击率预估的效果，现在深度点击率模型已经广泛用于很多工业平台中。这篇综述会综合回顾点击率预估中的深度学习模型。首先回顾从浅层到深层点击率预估模型的转变，然后解释模型往深层发展趋势的必要性。

然后。简介ctr模型中显式特征交互模块。基于丰富的用户历史和大平台，介绍深层行为模型。最近兴起的自动设计深层点击率模型结构会简单介绍下。

多个域的类别数据示例如下

目标函数形式如下

点击率预估模型发展历史图示如下

单塔和双塔的ctr预估模型结构对比如下

几种典型的特征交互算子图示如下

用户行为建模图示如下

参考资料（文献列表）

Deepak Agarwal, Bo Long, Jonathan Traupman, Doris Xin, and Liang Zhang. Laser: A scalable response prediction platform for online advertising. In WSDM, pages 173–182, 2014. 

Mathieu Blondel, Akinori Fujino, Naonori Ueda, and Masakazu Ishihata. Higher-order factorization machines. In NIPS, 2016. 

Yin-Wen Chang, Cho-Jui Hsieh, KaiWei Chang, Michael Ringgaard, and Chih-Jen Lin. Training and testing low-degree polynomial data mappings via linear svm. Journal of Machine Learning Research, 11(4), 2010. 

Shih-Kang Chao and Guang Cheng. A generalization of regularized dual averaging and its dynamics. CoRR, abs/1909.10072, 2019. 

Qiwei Chen, Huan Zhao, Wei Li, Pipei Huang, and Wenwu Ou. Behavior sequence transformer for e-commerce recommendation in alibaba. In 1st DLP-KDD Workshop, pages 1–4, 2019. 

Yifan Chen, Pengjie Ren, Yang Wang, and Maarten de Rijke. Bayesian personalized feature interaction selection for factorization machines. In SIGIR, pages 665–674, 2019. 

Chen Cheng, Fen Xia, Tong Zhang, Irwin King, and Michael R Lyu. Gradient boosting factorization machines. In RecSys, pages 265–272. ACM, 2014. 

Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. Wide & deep learning for recommender systems. In 1st DLRS workshop, pages 7–10, 2016. 

Weiyu Cheng, Yanyan Shen, and Linpeng Huang. Differentiable neural input search for recommender systems. CoRR, abs/2006.04466, 2020. 

George Cybenko. Approximation by superpositions of