《Computer age statistical inference》学习笔记-Part I

最近在看统计推断的时候发现一本好书,《Computer age statistical inference》(中译大致是《计算机时代的统计推断》),作者是Bradley Efron 和 Trevor Hastie。统计界大牛,书的电子版作者免费放到了网上,《Computer age statistical inference》

图书封面

书的内容主要按照时间分三部分,第一部分是电子计算机时代之前的经典统计推断内容,包括:频率学派,贝叶斯学派,和Fisherian以及常见的参数模型,并介绍了指数分布族,时间为1763年(贝叶斯发表贝叶斯公式的那个文章)到1950年之间;第二部分为计算机时代早期统计方法,时间跨度为1950-1990年,依托于计算机的出现,这个时间段涌现了很多经典的统计方法,书中主要介绍了经验贝叶斯、James-Stein估计、广义线性模型(GLM)和回归树、生存分析、EM算法、以及经典重抽样方法:Jackknife和Bootstrap、交叉验证、MCMC等方法;第三部分为21世纪出现的统计学习方法,如:稀疏模型和Lasso、Random Forest和Boosting方法、神经网络与深度学习、SVM和核技巧等,这部分和作者之一 Trevor Hastie的另一本经典书《 The Elements of Statistical Learning》(中译名为《统计学习基础》有交叉部分,可以互相参考)。ESL也是网上各种推荐。

图书封面

按照三部分,慢慢写点读书笔记吧,记录一下心得。

 

转载于:https://www.cnblogs.com/xiaobaijiang/p/9215662.html

  • 1
    点赞
  • 5
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
1 Algorithms and Inference 3 1.1 A Regression Example 4 1.2 Hypothesis Testing 8 1.3 Notes 11 2 Frequentist Inference 12 2.1 Frequentism in Practice 14 2.2 Frequentist Optimality 18 2.3 Notes and Details 20 3 Bayesian Inference 22 3.1 Two Examples 24 3.2 Uninformative Prior Distributions 28 3.3 Flaws in Frequentist Inference 30 3.4 A Bayesian/Frequentist Comparison List 33 3.5 Notes and Details 36 4 Fisherian Inference and Maximum Likelihood Estimation 38 4.1 Likelihood and Maximum Likelihood 38 4.2 Fisher Information and the MLE 41 4.3 Conditional Inference 45 4.4 Permutation and Randomization 49 4.5 Notes and Details 51 5 Parametric Models and Exponential Families 53 ix x Contents 5.1 Univariate Families 54 5.2 The Multivariate Normal Distribution 55 5.3 Fisher’s Information Bound for Multiparameter Families 59 5.4 The Multinomial Distribution 61 5.5 Exponential Families 64 5.6 Notes and Details 69 Part II Early Computer-Age Methods 73 6 Empirical Bayes 75 6.1 Robbins’ Formula 75 6.2 The Missing-Species Problem 78 6.3 A Medical Example 84 6.4 Indirect Evidence 1 88 6.5 Notes and Details 88 7 James–Stein Estimation and Ridge Regression 91 7.1 The James–Stein Estimator 91 7.2 The Baseball Players 94 7.3 Ridge Regression 97 7.4 Indirect Evidence 2 102 7.5 Notes and Details 104 8 Generalized Linear Models and Regression Trees 108 8.1 Logistic Regression 109 8.2 Generalized Linear Models 116 8.3 Poisson Regression 120 8.4 Regression Trees 124 8.5 Notes and Details 128 9 Survival Analysis and the EM Algorithm 131 9.1 Life Tables and Hazard Rates 131 9.2 Censored Data and the Kaplan–Meier Estimate 134 9.3 The Log-Rank Test 139 9.4 The Proportional Hazards Model 143 9.5 Missing Data and the EM Algorithm 146 9.6 Notes and Details 150 10 The Jackknife and the Bootstrap 155 10.1 The Jackknife Estimate of Standard Error 156 10.2 The Nonparametric Bootstrap 159 10.3 Resampling Plans 162 Contents xi 10.4 The Parametric Bootstrap 169 10.5 Influence Functions and Robust Estimation 174 10.6 Notes and Details 177 11 Bootstrap Confidence Intervals 181 11.1 Neyman’s Construction for One-Parameter Problems 181 11.2 The Percentile Method 185 11.3 Bias-Corrected Confidence Intervals 190 11.4 Second-Order Accuracy 192 11.5 Bootstrap-t Intervals 195 11.6 Objective Bayes Intervals and the Confidence Distribution 198 11.7 Notes and Details 204 12 Cross-Validation and Cp Estimates of Prediction Error 208 12.1 Prediction Rules 208 12.2 Cross-Validation 213 12.3 Covariance Penalties 218 12.4 Training, Validation, and Ephemeral Predictors 227 12.5 Notes and Details 230 13 Objective Bayes Inference and MCMC 233 13.1 Objective Prior Distributions 234 13.2 Conjugate Prior Distributions 237 13.3 Model Selection and the Bayesian Information Criterion 243 13.4 Gibbs Sampling and MCMC 251 13.5 Example: Modeling Population Admixture 256 13.6 Notes and Details 261 14 Postwar Statistical Inference and Methodology 264 Part III Twenty-First-Century Topics 269 15 Large-Scale Hypothesis Testing and FDRs 271 15.1 Large-Scale Testing 272 15.2 False-Discovery Rates 275 15.3 Empirical Bayes Large-Scale Testing 278 15.4 Local False-Discovery Rates 282 15.5 Choice of the Null Distribution 286 15.6 Relevance 290 15.7 Notes and Details 294 16 Sparse Modeling and the Lasso 298 xii Contents 16.1 Forward Stepwise Regression 299 16.2 The Lasso 303 16.3 Fitting Lasso Models 308 16.4 Least-Angle Regression 309 16.5 Fitting Generalized Lasso Models 313 16.6 Post-Selection Inference for the Lasso 317 16.7 Connections and Extensions 319 16.8 Notes and Details 321 17 Random Forests and Boosting 324 17.1 Random Forests 325 17.2 Boosting with Squared-Error Loss 333 17.3 Gradient Boosting 338 17.4 Adaboost: the Original Boosting Algorithm 341 17.5 Connections and Extensions 345 17.6 Notes and Details 347 18 Neural Networks and Deep Learning 351 18.1 Neural Networks and the Handwritten Digit Problem 353 18.2 Fitting a Neural Network 356 18.3 Autoencoders 362 18.4 Deep Learning 364 18.5 Learning a Deep Network 368 18.6 Notes and Details 371 19 Support-Vector Machines and Kernel Methods 375 19.1 Optimal Separating Hyperplane 376 19.2 Soft-Margin Classifier 378 19.3 SVM Criterion as Loss Plus Penalty 379 19.4 Computations and the Kernel Trick 381 19.5 Function Fitting Using Kernels 384 19.6 Example: String Kernels for Protein Classification 385 19.7 SVMs: Concluding Remarks 387 19.8 Kernel Smoothing and Local Regression 387 19.9 Notes and Details 390 20 Inference After Model Selection 394 20.1 Simultaneous Confidence Intervals 395 20.2 Accuracy After Model Selection 402 20.3 Selection Bias 408 20.4 Combined Bayes–Frequentist Estimation 412 20.5 Notes and Details 417 Contents xiii 21 Empirical Bayes Estimation Strategies 421 21.1 Bayes Deconvolution 421 21.2 g-Modeling and Estimation 424 21.3 Likelihood, Regularization, and Accuracy 427 21.4 Two Examples 432 21.5 Generalized Linear Mixed Models 437 21.6 Deconvolution and f -Modeling 440 21.7 Notes and Details 444 Epilogue 446 References 453 Author Index 463 Subject Index 467

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值