顶会速递 | ICLR 2020录用论文全集

由深度学习三巨头Yoshua Bengio和Yann LeCun牵头创办的人工智能顶会ICLR今年最终收到2594篇投稿，共687篇论文被接收，其中48篇orals，108篇spotlights，531篇posters，录取率为26.5%，相比去年的31.4%略有下降。华人学者占比为47%。这篇博客为大家列出全部录用的论文列表，方便大家自取。

同时，我也为大家归类整理了几个研究领域的论文列表，目的还是为了节省朋友们检索感兴趣领域的论文的宝贵时间。欢迎大家关注微信公众号"语言智能技术笔记簿"一起交流学习。

ICLR 2020录用论文之自然语言处理篇
ICLR 2020录用论文之元学习篇
ICLR 2020录用论文之强化学习篇
ICLR 2020录用论文之图神经网络篇

Spotlight Presentations

Program Guided Agent
链接 | https://openreview.net/pdf?id=BkxUvnEYDH
作者 | Shao-Hua Sun, Te-Lin Wu, Joseph J. Lim
单位 | University of Southern California

Sparse Coding with Gated Learned ISTA
链接 | https://openreview.net/pdf?id=BygPO2VKPH
作者 | Kailun Wu, Yiwen Guo, Ziang Li, Changshui Zhang
单位 | Tsinghua University

Graph Neural Networks Exponentially Lose Expressive Power for Node Classification
链接 | https://openreview.net/pdf?id=S1ldO2EFPr
作者 | Kenta Oono, Taiji Suzuki
单位 | The University of Tokyo

Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cells
链接 | https://openreview.net/pdf?id=rJljdh4KDH
作者 | Gengchen Mai, Krzysztof Janowicz, Bo Yan, Rui Zhu, Ling Cai, Ni Lao

InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization
链接 | https://openreview.net/pdf?id=r1lfF2NYvH
作者 | Fan-Yun Sun, Jordan Hoffman, Vikas Verma, Jian Tang
单位 | National Taiwan University; MILA; Harvard University

On Robustness of Neural Ordinary Differential Equations
链接 | https://openreview.net/pdf?id=B1e9Y2NYvS
作者 | Hanshu YAN, Jiawei DU, Vincent TAN, Jiashi FENG
单位 | National University of Singapore

Defending Against Physically Realizable Attacks on Image Classification
链接 | https://openreview.net/pdf?id=H1xscnEKDr
作者 | Tong Wu, Liang Tong, Yevgeniy Vorobeychik
单位 | Washington University in St. Louis

Estimating Gradients for Discrete Random Variables by Sampling without Replacement
链接 | https://openreview.net/pdf?id=rklEj2EFvB
作者 | Wouter Kool, Herke van Hoof, Max Welling
单位 | University of Amsterdam

Learning to Control PDEs with Differentiable Physics
链接 | https://openreview.net/pdf?id=HyeSin4FPB
作者 | Philipp Holl, Nils Thuerey, Vladlen Koltun

Intensity-Free Learning of Temporal Point Processes
链接 | https://openreview.net/pdf?id=HygOjhEYDH
作者 | Oleksandr Shchur, Marin Biloš, Stephan Günnemann

A Signal Propagation Perspective for Pruning Neural Networks at Initialization
链接 | https://openreview.net/pdf?id=HJeTo2VFwH
作者 | Namhoon Lee, Thalaiyasingam Ajanthan, Stephen Gould, Philip H. S. Torr
单位 | University of Oxford; Australian National University

Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNets
链接 | https://openreview.net/pdf?id=BJlRs34Fvr
作者 | Dongxian Wu, Yisen Wang, Shu-Tao Xia, James Bailey, Xingjun Ma
单位 | Tsinghua University; Shanghai Jiao Tong University; The University of Melbourne

White Noise Analysis of Neural Networks
链接 | https://openreview.net/pdf?id=H1ebhnEYDH
作者 | Ali Borji, Sikun Lin
单位 | University of California, Santa Barbara

Neural Machine Translation with Universal Visual Representation
链接 | https://openreview.net/pdf?id=Byl8hhNYPS
作者 | Zhuosheng Zhang, Kehai Chen, Rui Wang, Masao Utiyama, Eiichiro Sumita, Zuchao Li, Hai Zhao
单位 | Shanghai Jiao Tong University

Tranquil Clouds: Neural Networks for Learning Temporally Coherent Features in Point Clouds
链接 | https://openreview.net/pdf?id=BJeKh3VYDH
作者 | Lukas Prantl, Nuttapong Chentanez, Stefan Jeschke, Nils Thuerey

PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search
链接 | https://openreview.net/pdf?id=BJlS634tPr
作者 | Yuhui Xu, Lingxi Xie, Xiaopeng Zhang, Xin Chen, Guo-Jun Qi, Qi Tian, Hongkai Xiong
单位 | Shanghai Jiao Tong University; 2Huawei Noah’s Ark La

Online and stochastic optimization beyond Lipschitz continuity: A Riemannian approach
链接 | https://openreview.net/pdf?id=rkxZyaNtwB
作者 | Kimon Antonakopoulos, E. Veronica Belmega, Panayotis Mertikopoulos

Enhancing Adversarial Defense by k-Winners-Take-All
链接 | https://openreview.net/pdf?id=Skgvy64tvr
作者 | Chang Xiao, Peilin Zhong, Changxi Zheng
单位 | Columbia University

Encoding word order in complex embeddings
链接 | https://openreview.net/pdf?id=Hke-WTVtwr
作者 | Benyou Wang, Donghao Zhao, Christina Lioma, Qiuchi Li, Peng Zhang, Jakob Grue Simonsen

DDSP: Differentiable Digital Signal Processing
链接 | https://openreview.net/pdf?id=B1x1ma4tDr
作者 | Jesse Engel, Lamtharn (Hanoi) Hantrakul, Chenjie Gu, Adam Roberts
单位 | Google Research

Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation
链接 | https://openreview.net/pdf?id=SJl5Np4tPr
作者 | Hung-Yu Tseng, Hsin-Ying Lee, Jia-Bin Huang, Ming-Hsuan Yang

Ridge Regression: Structure, Cross-Validation, and Sketching
链接 | https://openreview.net/pdf?id=HklRwaEKwB
作者 | Sifan Liu, Edgar Dobriban
单位 | Stanford University; University of Pennsylvania

Finite Depth and Width Corrections to the Neural Tangent Kernel
链接 | https://openreview.net/pdf?id=SJgndT4KwB
作者 | Boris Hanin, Mihai Nica
单位 | Texas A&M University; University of Toronto

Meta-Learning without Memorization
链接 | https://openreview.net/pdf?id=BklEFpEYwS
作者 | Mingzhang Yin, George Tucker, Mingyuan Zhou, Sergey Levine, Chelsea Finn
单位 | UT Austin; Google Research; UC Berkeley; Stanford

Influence-Based Multi-Agent Exploration
链接 | https://openreview.net/pdf?id=BJgy96EYvr
作者 | Tonghan Wang, Jianhao Wang, Yi Wu, Chongjie Zhang
单位 | Tsinghua University

HOPPITY: LEARNING GRAPH TRANSFORMATIONS TO DETECT AND FIX BUGS IN PROGRAMS
链接 | https://openreview.net/pdf?id=SJeqs6EFvB
作者 | Elizabeth Dinella, Hanjun Dai, Ziyang Li, Mayur Naik, Le Song, Ke Wang
单位 | University of Pennsylvania; Google Brain; Georgia Tech

Sliced Cramer Synaptic Consolidation for Preserving Deeply Learned Representations
链接 | https://openreview.net/pdf?id=BJge3TNKwH
作者 | Soheil Kolouri, Nicholas A. Ketz, Andrea Soltoggio, Praveen K. Pilly

How much Position Information Do Convolutional Neural Networks Encode?
链接 | https://openreview.net/pdf?id=rJeB36NKvB
作者 | Md Amirul Islam, Sen Jia, Neil D. B. Bruce

Hamiltonian Generative Networks
链接 | https://openreview.net/pdf?id=HJenn6VFvB
作者 | Aleksandar Botev, Irina Higgins, Andrew Jaegle, Sebastian Racaniere, Danilo J. Rezende, Peter Toth
单位 | DeepMind

CoPhy: Counterfactual Learning of Physical Dynamics
链接 | https://openreview.net/pdf?id=SkeyppEFvS
作者 | Fabien Baradel, Natalia Neverova, Julien Mille, Greg Mori, Christian Wolf

Estimating counterfactual treatment outcomes over time through adversarially balanced representations
链接 | https://openreview.net/pdf?id=BJg866NFvB
作者 | Ioana Bica, Ahmed M Alaa, James Jordon, Mihaela van der Schaar
单位 | University of Oxford; University of California, Los Angeles

Gradientless Descent: High-Dimensional Zeroth-Order Optimization
链接 | https://openreview.net/pdf?id=Skep6TVYDB
作者 | Daniel Golovin, John Karro, Greg Kochanski, Chansoo Lee, Xingyou Song, Qiuyi Zhang
单位 | Google Brain

Conditional Learning of Fair Representations
链接 | https://openreview.net/pdf?id=Hkekl0NFPr
作者 | Han Zhao, Amanda Coston, Tameem Adel, Geoffrey J. Gordon
单位 | Carnegie Mellon University; University of Cambridge

Inductive Matrix Completion Based on Graph Neural Networks
链接 | https://openreview.net/pdf?id=ByxxgCEYDS
作者 | Muhan Zhang, Yixin Chen
单位 | Washington University in St. Louis

Duration-of-Stay Storage Assignment under Uncertainty
链接 | https://openreview.net/pdf?id=Hkx7xRVYDr
作者 | Michael Lingzhi Li, Elliott Wolf, Daniel Wintz

Emergence of functional and structural properties of the head direction system by optimization of recurrent neural networks
链接 | https://openreview.net/pdf?id=HklSeREtPB
作者 | Christopher J. Cueva, Peter Y. Wang, Matthew Chin, Xue-Xin Wei
单位 | Columbia University

Deep neuroethology of a virtual rodent
链接 | https://openreview.net/pdf?id=SyxrxR4KPS
作者 | Josh Merel, Diego Aldarondo, Jesse Marshall, Yuval Tassa, Greg Wayne, Bence Olveczky

Doubly Robust Bias Reduction in Infinite Horizon Off-Policy Estimation
链接 | https://openreview.net/pdf?id=S1glGANtDr
作者 | Ziyang Tang, Yihao Feng, Lihong Li, Dengyong Zhou, Qiang Liu
单位 | The University of Texas at Austin; Google Research

Learning Compositional Koopman Operators for Model-Based Control
链接 | https://openreview.net/pdf?id=H1ldzA4tPr
作者 | Yunzhu Li, Hao He, Jiajun Wu, Dina Katabi, Antonio Torralba
单位 | MIT

CLEVRER: Collision Events for Video Representation and Reasoning
链接 | https://openreview.net/pdf?id=HkxYzANYDB
作者 | Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum
单位 | Harvard University; MIT

The Logical Expressiveness of Graph Neural Networks
链接 | https://openreview.net/pdf?id=r1lZ7AEKvB
作者 | Pablo Barceló, Egor V. Kostylev, Mikael Monet, Jorge Pérez, Juan Reutter, Juan Pablo Silva

The Break-Even Point on Optimization Trajectories of Deep Neural Networks
链接 | https://openreview.net/pdf?id=r1g87C4KwB
作者 | Stanislaw Jastrzebski, Maciej Szymczak, Stanislav Fort, Devansh Arpit, Jacek Tabor, Kyunghyun Cho, Krzysztof Geras
单位 | New York University; Stanford University; Facebook AI Research; CIFAR

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
链接 | https://openreview.net/pdf?id=H1eA7AEtvS
作者 | Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, Radu Soricut
单位 | Google Research; Toyota Technological Institute at Chicago

Disentangling neural mechanisms for perceptual grouping
链接 | https://openreview.net/pdf?id=HJxrVA4FDS
作者 | Junkyung Kim, Drew Linsley, Kalpit Thakkar, Thomas Serre
单位 | Brown University

Learning to Plan in High Dimensions via Neural Exploration-Exploitation Trees
链接 | https://openreview.net/pdf?id=rJgJDAVKvB
作者 | Binghong Chen, Bo Dai, Qinjie Lin, Guo Ye, Han Liu, Le Song
单位 | Georgia Institute of Technology; Google Research; Northwestern University

Symplectic Recurrent Neural Networks
链接 | https://openreview.net/pdf?id=BkgYPREtPr
作者 | Zhengdao Chen, Jianyu Zhang, Martin Arjovsky, Léon Bottou
单位 | New York University; Tianjin University; Facebook AI Research

Asymptotics of Wide Networks from Feynman Diagrams
链接 | https://openreview.net/pdf?id=S1gFvANKDS
作者 | Ethan Dyer, Guy Gur-Ari
单位 | Google

Learning The Difference That Makes A Difference With Counterfactually-Augmented Data
链接 | https://openreview.net/pdf?id=Sklgs0NFvr
作者 | Divyansh Kaushik, Eduard Hovy, Zachary Lipton
单位 | Carnegie Mellon University

Is a Good Representation Sufficient for Sample Efficient Reinforcement Learning?
链接 | https://openreview.net/pdf?id=r1genAVKPB
作者 | Simon S. Du, Sham M. Kakade, Ruosong Wang, Lin F. Yang
单位 | University of Washington; Carnegie Mellon University; University of California, Los Angles

Simplified Action Decoder for Deep Multi-Agent Reinforcement Learning
链接 | https://openreview.net/pdf?id=B1xm3RVtwB
作者 | Hengyuan Hu, Jakob N Foerster
单位 | Facebook AI Research

Network Deconvolution
链接 | https://openreview.net/pdf?id=rkeu30EtvS
作者 | Chengxi Ye, Matthew Evanusa, Hua He, Anton Mitrokhin, Tom Goldstein, James A. Yorke, Cornelia Fermuller, Yiannis Aloimonos
单位 | University of Maryland, College Park

Neural Symbolic Reader: Scalable Integration of Distributed and Symbolic Representations for Reading Comprehension
链接 | https://openreview.net/pdf?id=ryxjnREFwH
作者 | Xinyun Chen, Chen Liang, Adams Wei Yu, Denny Zhou, Dawn Song, Quoc V. Le
单位 | UC Berkeley; Google Brain

Real or Not Real, that is the Question
链接 | https://openreview.net/pdf?id=B1lPaCNtPB
作者 | Yuanbo Xiangli, Yubin Deng, Bo Dai, Chen Change Loy, Dahua Lin
单位 | The Chinese University of Hong Kong; Nanyang Technological University

Dream to Control: Learning Behaviors by Latent Imagination
链接 | https://openreview.net/pdf?id=S1lOTC4tDS
作者 | Danijar Hafner, Timothy Lillicrap, Jimmy Ba, Mohammad Norouzi
单位 | University of Toronto; DeepMind; Google Brain

A Probabilistic Formulation of Unsupervised Text Style Transfer
链接 | https://openreview.net/pdf?id=HJlA0C4tPS
作者 | Junxian He, Xinyi Wang, Graham Neubig, Taylor Berg-Kirkpatrick
单位 | Carnegie Mellon University; University of California San Diego

Emergent Tool Use From Multi-Agent Autocurricula
链接 | https://openreview.net/pdf?id=SkxpxJBKwS
作者 | Bowen Baker, Ingmar Kanitscheider, Todor Markov, Yi Wu, Glenn Powell, Bob McGrew, Igor Mordatch
单位 | OpenAI; Google Brain

NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search
链接 | https://openreview.net/pdf?id=HJxyZkBKDr
作者 | Xuanyi Dong, Yi Yang
单位 | University of Technology Sydney; Baidu Research

Strategies for Pre-training Graph Neural Networks
链接 | https://openreview.net/pdf?id=HJlWWJSFDH
作者 | Weihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik, Percy Liang, Vijay Pande, Jure Leskovec
单位 | Stanford University; The University of Iowa; Harvard University

Behaviour Suite for Reinforcement Learning
链接 | https://openreview.net/pdf?id=rygf-kSYwH
作者 | Ian Osband, Yotam Doron, Matteo Hessel, John Aslanides, Eren Sezener, Andre Saraiva, Katrina McKinney, Tor Lattimore, Csaba Szepesvari, Satinder Singh, Benjamin Van Roy, Richard Sutton, David Silver, Hado Van Hasselt
单位 | DeepMind

FreeLB: Enhanced Adversarial Training for Natural Language Understanding
链接 | https://openreview.net/pdf?id=BygzbyHFvB
作者 | Chen Zhu, Yu Cheng, Zhe Gan, Siqi Sun, Tom Goldstein, Jingjing Liu
单位 | University of Maryland, College Park; Microsoft

Kernelized Wasserstein Natural Gradient
链接 | https://openreview.net/pdf?id=Hklz71rYvS
作者 | M Arbel, A Gretton, W Li, G Montufar
单位 | University College London; University of California, Los Angeles

And the Bit Goes Down: Revisiting the Quantization of Neural Networks
链接 | https://openreview.net/pdf?id=rJehVyrKwH
作者 | Pierre Stock, Armand Joulin, Rémi Gribonval, Benjamin Graham, Hervé Jégou
单位 | Facebook AI Research

A Latent Morphology Model for Open-Vocabulary Neural Machine Translation
链接 | https://openreview.net/pdf?id=BJxSI1SKDH
作者 | Duygu Ataman, Wilker Aziz, Alexandra Birch
单位 | University of Zurich; University of Amsterdam; University of Edinburgh

Understanding Why Neural Networks Generalize Well Through GSNR of Parameters
链接 | https://openreview.net/pdf?id=HyevIJStwH
作者 | Jinlong Liu, Yunzhi Bai, Guoqing Jiang, Ting Chen, Huayan Wang

Model Based Reinforcement Learning for Atari
链接 | https://openreview.net/pdf?id=S1xCPJHtDB
作者 | Łukasz Kaiser, Mohammad Babaeizadeh, Piotr Miłos, Błażej Osiński, Roy H Campbell, Konrad Czechowski, Dumitru Erhan, Chelsea Finn, Piotr Kozakowski, Sergey Levine, Afroz Mohiuddin, Ryan Sepassi, George Tucker, Henryk Michalewski
单位 | Google Brain

Disagreement-Regularized Imitation Learning
链接 | https://openreview.net/pdf?id=rkgbYyHtwB
作者 | Kiante Brantley, Wen Sun, Mikael Henaff
单位 | University of Maryland; Microsoft Research

Stable Rank Normalization for Improved Generalization in Neural Networks and GANs
链接 | https://openreview.net/pdf?id=H1enKkrFDB
作者 | Amartya Sanyal, Philip H. Torr, Puneet K. Dokania

Measuring the Reliability of Reinforcement Learning Algorithms
链接 | https://openreview.net/pdf?id=SJlpYJBKvH
作者 | Stephanie C.Y. Chan, Samuel Fishman, Anoop Korattikara, John Canny, Sergio Guadarrama
单位 | Google Research; UC Berkeley

Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue
链接 | https://openreview.net/pdf?id=Hke0K1HKwr
作者 | Byeongchang Kim, Jaewoo Ahn, Gunhee Kim
单位 | Seoul National University

Neural Tangents: Fast and Easy Infinite Neural Networks in Python
链接 | https://openreview.net/pdf?id=SklD9yrFPS
作者 | Roman Novak, Lechao Xiao, Jiri Hron, Jaehoon Lee, Alexander A. Alemi, Jascha Sohl-Dickstein, Samuel S. Schoenholz
单位 | Google Brain; University of Cambridge

Self-labelling via simultaneous clustering and representation learning
链接 | https://openreview.net/pdf?id=Hyx-jyBFPr
作者 | Asano YM., Rupprecht C., Vedaldi A.
单位 | University of Oxford

The intriguing role of module criticality in the generalization of deep networks
链接 | https://openreview.net/pdf?id=S1e4jkSKvB
作者 | Niladri Chatterji, Behnam Neyshabur, Hanie Sedghi

Harnessing the Power of Infinitely Wide Deep Nets on Small-data Tasks
链接 | https://openreview.net/pdf?id=rkl8sJBYvH
作者 | Sanjeev Arora, Simon S. Du, Zhiyuan Li, Ruslan Salakhutdinov, Ruosong Wang, Dingli Yu
单位 | Princeton University; Carnegie Mellon University

Differentiation of Blackbox Combinatorial Solvers
链接 | https://openreview.net/pdf?id=BkevoJSYPB
作者 | Marin Vlastelica Pogančić, Anselm Paulus, Vit Musil, Georg Martius, Michal Rolinek

Scaling Autoregressive Video Models
链接 | https://openreview.net/pdf?id=rJgsskrFwH
作者 | Dirk Weissenborn, Oscar Täckström, Jakob Uszkoreit

The Ingredients of Real World Robotic Reinforcement Learning
链接 | https://openreview.net/pdf?id=rJe2syrtvS
作者 | Henry Zhu, Justin Yu, Abhishek Gupta, Dhruv Shah, Kristian Hartikainen, Avi Singh, Vikash Kumar, Sergey Levine

Meta-Learning Acquisition Functions for Transfer Learning in Bayesian Optimization
链接 | https://openreview.net/pdf?id=ryeYpJSKwr
作者 | Michael Volpp, Lukas P. Fröhlich, Kirsten Fischer, Andreas Doerr, Stefan Falkner, Frank Hutter, Christian Daniel

Maximum Likelihood Constraint Inference for Inverse Reinforcement Learning
链接 | https://openreview.net/pdf?id=BJliakStvH
作者 | Dexter R.R. Scobee, S. Shankar Sastry
单位 | UC Berkeley

Spectral Embedding of Regularized Block Models
链接 | https://openreview.net/pdf?id=H1l_0JBYwS
作者 | Nathan De Lara, Thomas Bonald

Towards Hierarchical Importance Attribution: Explaining Compositional Semantics for Neural Sequence Models
链接 | https://openreview.net/pdf?id=BkxRRkSKwr
作者 | Xisen Jin, Zhongyu Wei, Junyi Du, Xiangyang Xue, Xiang Ren
单位 | University of Southern California; Fudan University

word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement
链接 | https://openreview.net/pdf?id=HkxARkrFwB
作者 | Aliakbar Panahi, Seyran Saeedi, Tom Arodz

What Can Neural Networks Reason About?
链接 | https://openreview.net/pdf?id=rJxbJeHFPS
作者 | Keyulu Xu, Jingling Li, Mozhi Zhang, Simon S. Du, Ken-ichi Kawarabayashi, Stefanie Jegelka
单位 | University of Maryland; MIT

Training individually fair ML models with sensitive subspace robustness
链接 | https://openreview.net/pdf?id=B1gdkxHFDH
作者 | Mikhail Yurochkin, Amanda Bower, Yuekai Sun
单位 | IBM Research; University of Michigan

Learning from Rules Generalizing Labeled Exemplars
链接 | https://openreview.net/pdf?id=SkeuexBtDr
作者 | Abhijeet Awasthi, Sabyasachi Ghosh, Rasna Goyal, Sunita Sarawagi

Directional Message Passing for Molecular Graphs
链接 | https://openreview.net/pdf?id=B1eWbxStPH
作者 | Johannes Klicpera, Janek Groß, Stephan Günnemann

Explanation by Progressive Exaggeration
链接 | https://openreview.net/pdf?id=H1xFWgrFPS
作者 | Sumedha Singla, Brian Pollack, Junxiang Chen, Kayhan Batmanghelich
单位 | University of Pittsburgh

Compression based bound for non-compressed network: unified generalization error analysis of large compressible deep neural network
链接 | https://openreview.net/pdf?id=ByeGzlrKwH
作者 | Taiji Suzuki, Hiroshi Abe, Tomoaki Nishimura

At Stability’s Edge: How to Adjust Hyperparameters to Preserve Minima Selection in Asynchronous Training of Neural Networks?
链接 | https://openreview.net/pdf?id=Bkeb7lHtvH
作者 | Niv Giladi, Mor Shpigel Nacson, Elad Hoffer, Daniel Soudry

Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)
链接 | https://openreview.net/pdf?id=rygeHgSFDH
作者 | Peter Sorrenson, Carsten Rother, Ullrich Köthe

Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps
链接 | https://openreview.net/pdf?id=BkgrBgSYDS
作者 | Tri Dao, Nimit Sohoni, Albert Gu, Matthew Eichhorn, Amit Blonder, Megan Leszczynski, Atri Rudra, Christopher Ré
单位 | Stanford University; Cornell University; The State University of New York

Improving Generalization in Meta Reinforcement Learning using Learned Objectives
链接 | https://openreview.net/pdf?id=S1evHerYPr
作者 | Louis Kirsch, Sjoerd van Steenkiste, Juergen Schmidhuber

Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks
链接 | https://openreview.net/pdf?id=BJxsrgStvr
作者 | Haoran You, Chaojian Li, Pengfei Xu, Yonggan Fu, Yue Wang, Xiaohan Chen, Richard G. Baraniuk, Zhangyang Wang, Yingyan Lin
单位 | Rice University; Texas A&M University

Truth or backpropaganda? An empirical investigation of deep learning theory
链接 | https://openreview.net/pdf?id=HyxyIgHFvr
作者 | Micah Goldblum, Jonas Geiping, Avi Schwarzschild, Michael Moeller, Tom Goldstein
单位 | University of Maryland;

Neural Arithmetic Units
链接 | https://openreview.net/pdf?id=H1gNOeHKPS
作者 | Andreas Madsen, Alexander Rosenberg Johansen

DeepSphere: a graph-based spherical CNN
链接 | https://openreview.net/pdf?id=B1e3OlStPB
作者 | Michaël Defferrard, Martino Milani, Frédérick Gusset, Nathanaël Perraudin

SUMO: Unbiased Estimation of Log Marginal Probability for Latent Variable Models
链接 | https://openreview.net/pdf?id=SylkYeHtwr
作者 | Yucen Luo, Alex Beatson, Mohammad Norouzi, Jun Zhu, David Duvenaud, Ryan P. Adams, Ricky T. Q. Chen
单位 | Tsinghua University; Princeton University; Google Research; University of Toronto

Deep Learning For Symbolic Mathematics
链接 | https://openreview.net/pdf?id=S1eZYeHFDS
作者 | Guillaume Lample, François Charton
单位 | Facebook AI Research

Making Sense of Reinforcement Learning and Probabilistic Inference
链接 | https://openreview.net/pdf?id=S1xitgHtvS
作者 | Brendan O’Donoghue, Ian Osband, Catalin Ionescu

Unbiased Contrastive Divergence Algorithm for Training Energy-Based Latent Variable Models
链接 | https://openreview.net/pdf?id=r1eyceSYPr
作者 | Yixuan Qiu, Lingsong Zhang, Xiao Wang
单位 | Carnegie Mellon University; Purdue University

A Mutual Information Maximization Perspective of Language Representation Learning
链接 | https://openreview.net/pdf?id=Syx79eBKwr
作者 | Lingpeng Kong, Cyprien de Masson d’Autume, Lei Yu, Wang Ling, Zihang Dai, Dani Yogatama
单位 | DeepMind; Carnegie Mellon University; Google Brain

Energy-based models for atomic-resolution protein conformations
链接 | https://openreview.net/pdf?id=S1e_9xrFvS
作者 | Yilun Du, Joshua Meier, Jerry Ma, Rob Fergus, Alexander Rives
单位 | MIT; Facebook AI Research; New York University

Depth-Width Trade-offs for ReLU Networks via Sharkovsky’s Theorem
链接 | https://openreview.net/pdf?id=BJe55gBtvH
作者 | Vaggos Chatziafratis, Sai Ganesh Nagarajan, Ioannis Panageas, Xiao Wang
单位 | Stanford University; Singapore University of Technology and Design

Generalization of Two-layer Neural Networks: An Asymptotic Viewpoint
链接 | https://openreview.net/pdf?id=H1gBsgBYwH
作者 | Jimmy Ba, Murat Erdogdu, Taiji Suzuki, Denny Wu, Tianzong Zhang
单位 | University of Toronto; Vector Institute; University of Tokyo; Tsinghua University

Reconstructing continuous distributions of 3D protein structure from cryo-EM images
链接 | https://openreview.net/pdf?id=SJxUjlBtwB
作者 | Ellen D. Zhong, Tristan Bepler, Joseph H. Davis, Bonnie Berger
单位 | MIT

PROGRESSIVE LEARNING AND DISENTANGLEMENT OF HIERARCHICAL REPRESENTATIONS
链接 | https://openreview.net/pdf?id=SJxpsxrYPS
作者 | Zhiyuan Li, Jaideep Vitthal Murkute, Prashnna Kumar Gyawali, Linwei Wang
单位 | Rochester Institute of Technology

An Exponential Learning Rate Schedule for Deep Learning
链接 | https://openreview.net/pdf?id=rJg8TeSFDH
作者 | Zhiyuan Li, Sanjeev Arora
单位 | Princeton University

Geom-GCN: Geometric Graph Convolutional Networks
链接 | https://openreview.net/pdf?id=S1e2agrFvS
作者 | Hongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei, Bo Yang

Oral Presentations

CATER: A diagnostic dataset for Compositional Actions & TEmporal Reasoning
链接 | https://openreview.net/pdf?id=HJgzt2VKPB
作者 | Rohit Girdhar, Deva Ramanan
单位 | Carnegie Mellon University; Argo AI

BackPACK: Packing more into Backprop
链接 | https://openreview.net/pdf?id=BJlrF24twB
作者 | Felix Dangel, Frederik Kunstner, Philipp Hennig

GenDICE: Generalized Offline Estimation of Stationary Values
链接 | https://openreview.net/pdf?id=HkxlcnVFwB
作者 | Ruiyi Zhang, Bo Dai, Lihong Li, Dale Schuurmans
单位 | Duke University; Google Brain

Principled Weight Initialization for Hypernetworks
链接 | https://openreview.net/pdf?id=H1lma24tPB
作者 | Oscar Chang, Lampros Flokas, Hod Lipson
单位 | Columbia University

On the Convergence of FedAvg on Non-IID Data
链接 | https://openreview.net/pdf?id=HJxNAnVtDS
作者 | Xiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang, Zhihua Zhang
单位 | Peking University;

Data-dependent Gaussian Prior Objective for Language Generation
链接 | https://openreview.net/pdf?id=S1efxTVYDr
作者 | Zuchao Li, Rui Wang, Kehai Chen, Masso Utiyama, Eiichiro Sumita, Zhuosheng Zhang, Hai Zhao
单位 | Shanghai Jiao Tong University

Contrastive Learning of Structured World Models
链接 | https://openreview.net/pdf?id=H1gax6VtDB
作者 | Thomas Kipf, Elise van der Pol, Max Welling
单位 | University of Amsterdam

Neural Network Branching for Neural Network Verification
链接 | https://openreview.net/pdf?id=B1evfa4tPB
作者 | Jingyue Lu, M. Pawan Kumar
单位 | University of Oxford

Why Gradient Clipping Accelerates Training: A Theoretical Justification for Adaptivity
链接 | https://openreview.net/pdf?id=BJgnXpVYwS
作者 | Jingzhao Zhang, Tianxing He, Suvrit Sra, Ali Jadbabaie
单位 | MIT

Posterior sampling for multi-agent reinforcement learning: solving extensive games with imperfect information
链接 | https://openreview.net/pdf?id=Syg-ET4FPS
作者 | Yichi Zhou, Jialian Li, Jun Zhu
单位 | Tsinghua University; RealAI

Mogrifier LSTM
链接 | https://openreview.net/pdf?id=SJe5P6EYvS
作者 | Gábor Melis, Tomáš Kočiský, Phil Blunsom
单位 | DeepMind; University of Oxford

Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech
链接 | https://openreview.net/pdf?id=B1elCp4KwH
作者 | David Harwath, Wei-Ning Hsu, James Glass
单位 | MIT

Mirror-Generative Neural Machine Translation
链接 | https://openreview.net/pdf?id=HkxQRTNYPH
作者 | Zaixiang Zheng, Hao Zhou, Shujian Huang, Lei Li, Xin-Yu Dai, Jiajun Chen
单位 | Nanjing University

Cyclical Stochastic Gradient MCMC for Bayesian Deep Learning
链接 | https://openreview.net/pdf?id=rkeS1RVtPS
作者 | Ruqi Zhang, Chunyuan Li, Jianyi Zhang, Changyou Chen, Andrew Gordon Wilson
Cornell University; Microsoft Research, Redmond; Duke University; University at Buffalo, SUNY; New York University

Your classifier is secretly an energy based model and you should treat it like one
链接 | https://openreview.net/pdf?id=Hkxzx0NtDB
作者 | Will Grathwohl, Kuan-Chieh Wang, Joern-Henrik Jacobsen, David Duvenaud, Mohammad Norouzi, Kevin Swersky
单位 | University of Toronto; Vector Institute; Google Research

Dynamics-Aware Unsupervised Skill Discovery
链接 | https://openreview.net/pdf?id=HJgLZR4KvH
作者 | Archit Sharma, Shixiang Gu, Sergey Levine, Vikash Kumar, Karol Hausman
单位 | Google Brain

Optimal Strategies Against Generative Attacks
链接 | https://openreview.net/pdf?id=BkgzMCVtPB
作者 | Roy Mor, Erez Peterfreund, Matan Gavish, Amir Globerson

GraphZoom: A Multi-level Spectral Approach for Accurate and Scalable Graph Embedding
链接 | https://openreview.net/pdf?id=r1lGO0EKDH
作者 | Chenhui Deng, Zhiqiang Zhao, Yongyu Wang, Zhiru Zhang, Zhuo Feng
单位 | Cornell University;

Harnessing Structures for Value-Based Planning and Reinforcement Learning
链接 | https://openreview.net/pdf?id=rklHqRVKvH
作者 | Yuzhe Yang, Guo Zhang, Zhi Xu, Dina Katabi
单位 | MIT

Comparing Rewinding and Fine-tuning in Neural Network Pruning
链接 | https://openreview.net/pdf?id=S1gSj0NKvB
作者 | Alex Renda, Jonathan Frankle, Michael Carbin
单位 | MIT

Meta-Q-Learning
链接 | https://openreview.net/pdf?id=SJeD3CEFPH
作者 | Rasool Fakoor, Pratik Chaudhari, Stefano Soatto, Alexander J. Smola
Amazon; University of Pennsylvania

Mathematical Reasoning in Latent Space
链接 | https://openreview.net/pdf?id=Ske31kBtPr
作者 | Dennis Lee, Christian Szegedy, Markus Rabe, Sarah Loos, Kshitij Bansal
单位 | Google Research

A Theory of Usable Information under Computational Constraints
链接 | https://openreview.net/pdf?id=r1eBeyHFDH
作者 | Yilun Xu, Shengjia Zhao, Jiaming Song, Russell Stewart, Stefano Ermon
单位 | Peking University; Stanford University;

Geometric Analysis of Nonconvex Optimization Landscapes for Overcomplete Learning
链接 | https://openreview.net/pdf?id=rygixkHKDH
作者 | Qing Qu, Yuexiang Zhai, Xiao Li, Yuqian Zhang, Zhihui Zhu
单位 | New York University; UC Berkeley; CUHK; Rutgers University

Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds
链接 | https://openreview.net/pdf?id=ryghZJBKPS
作者 | Jordan T. Ash, Chicheng Zhang, Akshay Krishnamurthy, John Langford, Alekh Agarwal
单位 | Princeton University; University of Arizona; Microsoft Research

Understanding and Robustifying Differentiable Architecture Search
链接 | https://openreview.net/pdf?id=H1gDNyrKDS
作者 | Arber Zela, Thomas Elsken, Tonmoy Saikia, Yassine Marrakchi, Thomas Brox, Frank Hutter

A Closer Look at Deep Policy Gradients
链接 | https://openreview.net/pdf?id=ryxdEkHtPS
作者 | Andrew Ilyas, Logan Engstrom, Shibani Santurkar, Dimitris Tsipras, Firdaus Janoos, Larry Rudolph, Aleksander Madry

Implementation Matters in Deep RL: A Case Study on PPO and TRPO
链接 | https://openreview.net/pdf?id=r1etN1rtPB
作者 | Logan Engstrom, Andrew Ilyas, Shibani Santurkar, Dimitris Tsipras, Firdaus Janoos, Larry Rudolph, Aleksander Madry

Fast Task Inference with Variational Intrinsic Successor Features
链接 | https://openreview.net/pdf?id=BJeAHkrYDS
作者 | Steven Hansen, Will Dabney, Andre Barreto, David Warde-Farley, Tom Van de Wiele, Volodymyr Mnih
单位 | DeepMind

Learning to Balance: Bayesian Meta-Learning for Imbalanced and Out-of-distribution Tasks
链接 | https://openreview.net/pdf?id=rkeZIJBYvr
作者 | Hae Beom Lee, Hayeon Lee, Donghyun Na, Saehoon Kim, Minseop Park, Eunho Yang, Sung Ju Hwang

RNA Secondary Structure P