[转载]自动机器学习(AutoML)领域论文合集

转载自:2019年 https://blog.csdn.net/mrjkzhangma/article/details/103024818

Awesome-AutoML-Papers includes very up-to-date overviews of the bread-and-butter techniques we need in AutoML:

  • Automated Data Clean (Auto Clean)
  • Automated Feature Enginnering (Auto FE)
  • Hyperparameter Optimization (HPO)
  • Meta-Learning
  • Neural Architecture Search (NAS)
    在这里插入图片描述

Table of Contents

Papers

Surveys

  • 2019 | AutoML: A Survey of the State-of-the-Art | Xin He, et al. | arXiv | PDF
  • 2019 | Survey on Automated Machine Learning | Marc Zoeller, Marco F. Huber | arXiv | PDF
  • 2019 | Automated Machine Learning: State-of-The-Art and Open Challenges | Radwa Elshawi, et al. | arXiv | PDF
  • 2018 | Taking Human out of Learning Applications: A Survey on Automated Machine Learning | Quanming Yao, et al. | arXiv | PDF

Automated Feature Engineering

  • Expand Reduce
    • 2017 | AutoLearn — Automated Feature Generation and Selection | Ambika Kaul, et al. | ICDM | PDF
    • 2017 | One button machine for automating feature engineering in relational databases | Hoang Thanh Lam, et al. | arXiv | PDF
    • 2016 | Automating Feature Engineering | Udayan Khurana, et al. | NIPS | PDF
    • 2016 | ExploreKit: Automatic Feature Generation and Selection | Gilad Katz, et al. | ICDM | PDF
    • 2015 | Deep Feature Synthesis: Towards Automating Data Science Endeavors | James Max Kanter, Kalyan Veeramachaneni | DSAA | PDF
  • Hierarchical Organization of Transformations
    • 2016 | Cognito: Automated Feature Engineering for Supervised Learning | Udayan Khurana, et al. | ICDMW | PDF
  • Meta Learning
    • 2017 | Learning Feature Engineering for Classification | Fatemeh Nargesian, et al. | IJCAI | PDF
  • Reinforcement Learning
    • 2017 | Feature Engineering for Predictive Modeling using Reinforcement Learning | Udayan Khurana, et al. | arXiv | PDF
    • 2010 | Feature Selection as a One-Player Game | Romaric Gaudel, Michele Sebag | ICML | PDF

Architecture Search

  • Evolutionary Algorithms
    • 2019 | Evolutionary Neural AutoML for Deep Learning | Jason Liang, et al. | arXiv | PDF
    • 2017 | Large-Scale Evolution of Image Classifiers | Esteban Real, et al. | PMLR | PDF
    • 2002 | Evolving Neural Networks through Augmenting Topologies | Kenneth O.Stanley, Risto Miikkulainen | Evolutionary Computation | PDF
  • Local Search
    • 2017 | Simple and Efficient Architecture Search for Convolutional Neural Networks | Thomoas Elsken, et al. | ICLR | PDF
  • Meta Learning
    • 2016 | Learning to Optimize | Ke Li, Jitendra Malik | arXiv | PDF
  • Reinforcement Learning
    • 2018 | AMC: AutoML for Model Compression and Acceleration on Mobile Devices | Yihui He, et al. | ECCV | PDF
    • 2018 | Efficient Neural Architecture Search via Parameter Sharing | Hieu Pham, et al. | arXiv | PDF
    • 2017 | Neural Architecture Search with Reinforcement Learning | Barret Zoph, Quoc V. Le | ICLR | PDF
  • Transfer Learning
    • 2017 | Learning Transferable Architectures for Scalable Image Recognition | Barret Zoph, et al. | arXiv | PDF
  • Network Morphism
    • 2018 | Efficient Neural Architecture Search with Network Morphism | Haifeng Jin, et al. | arXiv | PDF
  • Continuous Optimization
    • 2018 | Neural Architecture Optimization | Renqian Luo, et al. | arXiv | PDF
    • 2019 | DARTS: Differentiable Architecture Search | Hanxiao Liu, et al. | ICLR | PDF

Frameworks

  • 2019 | Towards modular and programmable architecture search | Renato Negrinho, et al. | NeurIPS | PDF
  • 2019 | Evolutionary Neural AutoML for Deep Learning | Jason Liang, et al. | arXiv | PDF
  • 2017 | ATM: A Distributed, Collaborative, Scalable System for Automated Machine Learning | T. Swearingen, et al. | IEEE | PDF
  • 2017 | Google Vizier: A Service for Black-Box Optimization | Daniel Golovin, et al. | KDD |PDF
  • 2015 | AutoCompete: A Framework for Machine Learning Competitions | Abhishek Thakur, et al. | ICML | PDF

Hyperparameter Optimization

  • Bayesian Optimization
    • 2018 | A Tutorial on Bayesian Optimization. | PDF
    • 2018 | Efficient High Dimensional Bayesian Optimization with Additivity and Quadrature Fourier Features | Mojmír Mutný, et al. | NeurIPS | PDF
    • 2018 | High-Dimensional Bayesian Optimization via Additive Models with Overlapping Groups. | PMLR | PDF
    • 2016 | Bayesian Optimization with Robust Bayesian Neural Networks | Jost Tobias Springenberg, et al. | NIPS | PDF
    • 2016 | Scalable Hyperparameter Optimization with Products of Gaussian Process Experts | Nicolas Schilling, et al. | PKDD | PDF
    • 2016 | Taking the Human Out of the Loop: A Review of Bayesian Optimization | Bobak Shahriari, et al. | IEEE | PDF
    • 2016 | Towards Automatically-Tuned Neural Networks | Hector Mendoza, et al. | JMLR | PDF
    • 2016 | Two-Stage Transfer Surrogate Model for Automatic Hyperparameter Optimization | Martin Wistuba, et al. | PKDD | PDF
    • 2015 | Efficient and Robust Automated Machine Learning | PDF
    • 2015 | Hyperparameter Optimization with Factorized Multilayer Perceptrons | Nicolas Schilling, et al. | PKDD | PDF
    • 2015 | Hyperparameter Search Space Pruning - A New Component for Sequential Model-Based Hyperparameter Optimization | Martin Wistua, et al. | PDF
    • 2015 | Joint Model Choice and Hyperparameter Optimization with Factorized Multilayer Perceptrons | Nicolas Schilling, et al. | ICTAI | PDF
    • 2015 | Learning Hyperparameter Optimization Initializations | Martin Wistuba, et al. | DSAA | PDF
    • 2015 | Scalable Bayesian optimization using deep neural networks | Jasper Snoek, et al. | ACM | PDF
    • 2015 | Sequential Model-free Hyperparameter Tuning | Martin Wistuba, et al. | ICDM | PDF
    • 2013 | Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms | PDF
    • 2013 | Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures | J. Bergstra | JMLR | PDF
    • 2012 | Practical Bayesian Optimization of Machine Learning Algorithms | PDF
    • 2011 | Sequential Model-Based Optimization for General Algorithm Configuration(extended version) | PDF
  • Evolutionary Algorithms
    • 2018 | Autostacker: A Compositional Evolutionary Learning System | Boyuan Chen, et al. | arXiv | PDF
    • 2017 | Large-Scale Evolution of Image Classifiers | Esteban Real, et al. | PMLR | PDF
    • 2016 | Automating biomedical data science through tree-based pipeline optimization | Randal S. Olson, et al. | ECAL | PDF
    • 2016 | Evaluation of a tree-based pipeline optimization tool for automating data science | Randal S. Olson, et al. | GECCO | PDF
  • Lipschitz Functions
    • 2017 | Global Optimization of Lipschitz functions | C´edric Malherbe, Nicolas Vayatis | arXiv | PDF
  • Local Search
    • 2009 | ParamILS: An Automatic Algorithm Configuration Framework | Frank Hutter, et al. | JAIR | PDF
  • Meta Learning
    • 2008 | Cross-Disciplinary Perspectives on Meta-Learning for Algorithm Selection | PDF
    • 2019 | SMARTML: A Meta Learning-Based Framework for Automated Selection and Hyperparameter Tuning for Machine Learning Algorithms | PDF
  • Particle Swarm Optimization
    • 2017 | Particle Swarm Optimization for Hyper-parameter Selection in Deep Neural Networks | Pablo Ribalta Lorenzo, et al. | GECCO | PDF
    • 2008 | Particle Swarm Optimization for Parameter Determination and Feature Selection of Support Vector Machines | Shih-Wei Lin, et al. | Expert Systems with Applications | PDF
  • Random Search
    • 2016 | Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization | Lisha Li, et al. | arXiv | PDF
    • 2012 | Random Search for Hyper-Parameter Optimization | James Bergstra, Yoshua Bengio | JMLR | PDF
    • 2011 | Algorithms for Hyper-parameter Optimization | James Bergstra, et al. | NIPS | PDF
  • Transfer Learning
    • 2016 | Efficient Transfer Learning Method for Automatic Hyperparameter Tuning | Dani Yogatama, Gideon Mann | JMLR | PDF
    • 2016 | Flexible Transfer Learning Framework for Bayesian Optimisation | Tinu Theckel Joy, et al. | PAKDD | PDF
    • 2016 | Hyperparameter Optimization Machines | Martin Wistuba, et al. | DSAA | PDF
    • 2013 | Collaborative Hyperparameter Tuning | R´emi Bardenet, et al. | ICML | PDF

Miscellaneous

  • 2018 | Accelerating Neural Architecture Search using Performance Prediction | Bowen Baker, et al. | ICLR | PDF
  • 2017 | Automatic Frankensteining: Creating Complex Ensembles Autonomously | Martin Wistuba, et al. | SIAM | PDF

Tutorials

Bayesian Optimization

  • 2010 | A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning | PDF

Meta Learning

  • 2008 | Metalearning - A Tutorial | PDF

Blog

TypeBlog TitleLink
HPOBayesian Optimization for Hyperparameter TuningLink
Meta-LearningLearning to learnLink
Meta-LearningWhy Meta-learning is Crucial for Further Advances of Artificial Intelligence?Link

Books

Year of PublicationTypeBook TitleAuthorsPublisherLink
2009Meta-LearningMetalearning - Applications to Data MiningBrazdil, P., Giraud Carrier, C., Soares, C., Vilalta, R.SpringerDownload
2019HPO, Meta-Learning, NASAutoML: Methods, Systems, ChallengesFrank Hutter, Lars Kotthoff, Joaquin VanschorenDownload

Projects

ProjectTypeLanguageLicenseLink
AdaNetNASPythonApache-2.0Github
AdvisorHPOPythonApache-2.0Github
AMLAHPO, NASPythonApache-2.0Github
ATMHPOPythonMITGithub
AugerHPOPythonCommercialHomepage
Auto-KerasNASPythonLicenseGithub
AutoML VisionNASPythonCommercialHomepage
AutoML Video IntelligenceNASPythonCommercialHomepage
AutoML Natural LanguageNASPythonCommercialHomepage
AutoML TranslationNASPythonCommercialHomepage
AutoML TablesAutoFE, HPOPythonCommercialHomepage
auto-sklearnHPOPythonLicenseGithub
auto_mlHPOPythonMITGithub
BayesianOptimizationHPOPythonMITGithub
BayesOptHPOC++AGPL-3.0Github
cometHPOPythonCommercialHomepage
DataRobotHPOPythonCommercialHomepage
DEvolNASPythonMITGithub
DeepArchitectNASPythonMITGithub
Driverless AIAutoFEPythonCommercialHomepage
FAR-HOHPOPythonMITGithub
H2O AutoMLHPOPython, R, Java, ScalaApache-2.0Github
HpBandSterHPOPythonBSD-3-ClauseGithub
HyperBandHPOPythonLicenseGithub
HyperoptHPOPythonLicenseGithub
Hyperopt-sklearnHPOPythonLicenseGithub
Hyperparameter HunterHPOPythonMITGithub
KatibHPOPythonApache-2.0Github
MateLabsHPOPythonCommercialGithub
MilanoHPOPythonApache-2.0Github
MLJARHPOPythonCommercialHomepage
nasbotNASPythonMITGithub
neptuneHPOPythonCommercialHomepage
NNIHPO, NASPythonMITGithub
OptunityHPOPythonLicenseGithub
R2.aiHPOCommercialHomepage
RBFOptHPOPythonLicenseGithub
RoBOHPOPythonBSD-3-ClauseGithub
Scikit-OptimizeHPOPythonLicenseGithub
SigOptHPOPythonCommercialHomepage
SMAC3HPOPythonLicenseGithub
TPOTAutoFE, HPOPythonLGPL-3.0Github
TransmogrifAIHPOScalaBSD-3-ClauseGithub
TuneHPOPythonApache-2.0Github
XcessivHPOPythonApache-2.0Github
SmartMLHPORGPL-3.0Github
MLBoxAutoFE, HPOPythonBSD-3 LicenseGithub
AutoAI WatsonAutoFE, HPOCommercialHomepage

Slides

TypeSlide TitleAuthorsLink
AutoFEAutomated Feature Engineering for Predictive ModelingUdyan Khurana, etc al.Download
HPOA Tutorial on Bayesian Optimization for Machine LearningRyan P. AdamsDownload
HPOBayesian OptimisationGilles LouppeDownload
  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值