顶会速递 | ICLR 2020录用论文之自然语言处理篇

抽空为大家整理了人工智能顶会ICLR 2020录用的自然语言处理相关的最新论文，内容涉及到知识图谱、语言建模、文本生成、机器翻译等热门领域，还有几篇关于BERT、Transformer模型优化的文章。感兴趣的朋友们赶紧Mark读起来吧！

Reducing Transformer Depth on Demand with Structured Dropout
链接 | https://openreview.net/pdf?id=SylO2yStDr
作者 | Angela Fan, Edouard Grave, Armand Joulin
单位 | Facebook AI Research

DeFINE: Deep Factorized Input Token Embeddings for Neural Sequence Modeling
链接 | https://openreview.net/pdf?id=rJeXS04FPH
作者 | Sachin Mehta, Rik Koncel-Kedziorski, Mohammad Rastegari, Hannaneh Hajishirzi
单位 | University of Washington; Allen Institute for AI

Understanding Knowledge Distillation in Non-autoregressive Machine Translation
链接 | https://openreview.net/pdf?id=BygFVAEKDH
作者 | Chunting Zhou, Jiatao Gu, Graham Neubig
单位 | Carnegie Mellon University; Facebook AI Research

Encoding word order in complex embeddings
链接 | https://openreview.net/pdf?id=Hke-WTVtwr
作者 | Benyou Wang, Donghao Zhao, Christina Lioma, Qiuchi Li, Peng Zhang, Jakob Grue Simonsen

BERTScore: Evaluating Text Generation with BERT
链接 | https://openreview.net/pdf?id=SkeHuCVFDr
作者 | Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, Yoav Artzi
单位 | Cornell University

Are Transformers universal approximators of sequence-to-sequence functions?
链接 | https://openreview.net/pdf?id=ByxRM0Ntvr
作者 | Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank Reddi, Sanjiv Kumar
单位 | MIT; Google Research

Language GANs Falling Short
链接 | https://openreview.net/pdf?id=BJgza6VtPB
作者 | Massimo Caccia, Lucas Caccia, William Fedus, Hugo Larochelle, Joelle Pineau, Laurent Charlin
单位 | MILA; McGill University

Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction
链接 | https://openreview.net/pdf?id=H1xPR3NtPB
作者 | Taeuk Kim, Jihun Choi, Daniel Edmiston, Sang-goo Lee
单位 | University of Chicago; Seoul National University

Dynamically Pruned Message Passing Networks for Large-scale Knowledge Graph Reasoning
链接 | https://openreview.net/pdf?id=rkeuAhVKvB
作者 | Xiaoran Xu, Wei Feng, Yunsheng Jiang, Xiaohui Xie, Zhiqing Sun, Zhi-Hong Deng
单位 | Carnegie Mellon University; Peking University

Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation
链接 | https://openreview.net/pdf?id=HygnDhEtvr
作者 | Yu Chen, Lingfei Wu, Mohammed J. Zaki
单位 | Rensselaer Polytechnic Institute; IBM Research

Compressive Transformers for Long-Range Sequence Modelling
链接 | https://openreview.net/pdf?id=SylKikSYDH
作者 | Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, Chloe Hillier, Timothy P. Lillicrap

Incorporating BERT into Neural Machine Translation
链接 | https://openreview.net/pdf?id=Hyl7ygStwB
作者 | Jinhua Zhu, Yingce Xia, Lijun Wu, Di He, Tao Qin, Wengang Zhou, Houqiang Li, Tieyan Liu
单位 | University of Science and Technology of China; Microsoft Research; Sun Yat-sen University; Peking University

Robustness Verification for Transformers
链接 | https://openreview.net/pdf?id=BJxwPJHFwS
作者 | Zhouxing Shi, Huan Zhang, Kai-Wei Chang, Minlie Huang, Cho-Jui Hsieh
单位 | Tsinghua University; University of California, Los Angeles

Emergence of functional and structural properties of the head direction system by optimization of recurrent neural networks
链接 | https://openreview.net/pdf?id=HklSeREtPB
作者 | Christopher J. Cueva, Peter Y. Wang, Matthew Chin, Xue-Xin Wei
单位 | Columbia University

A Mutual Information Maximization Perspective of Language Representation Learning
链接 | https://openreview.net/pdf?id=Syx79eBKwr
作者 | Lingpeng Kong, Cyprien de Masson d’Autume, Lei Yu, Wang Ling, Zihang Dai, Dani Yogatama
单位 | DeepMind; Carnegie Mellon University; Google Brain

word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement
链接 | https://openreview.net/pdf?id=HkxARkrFwB
作者 | Aliakbar Panahi, Seyran Saeedi, Tom Arodz

Towards Hierarchical Importance Attribution: Explaining Compositional Semantics for Neural Sequence Models
链接 | https://openreview.net/pdf?id=BkxRRkSKwr
作者 | Xisen Jin, Zhongyu Wei, Junyi Du, Xiangyang Xue, Xiang Ren
单位 | University of Southern California; Fudan University

Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue
链接 | https://openreview.net/pdf?id=Hke0K1HKwr
作者 | Byeongchang Kim, Jaewoo Ahn, Gunhee Kim
单位 | Seoul National University

A Latent Morphology Model for Open-Vocabulary Neural Machine Translation