ADMM求解各种优化函数及Matalb例子


MATLAB scripts for alternating direction method of multipliers

S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein

This page gives MATLAB implementations of the examples inour paper on distributed optimization with the alternating direction method of multipliers.

These scripts are serial implementations of ADMM for various problems. In cases where the scripts solve distributed consensus problems (e.g., distributedell_1-regularized logistic regression), the code runs serially instead of in parallel. These scripts give an idea of the structure and flavor of ADMM; an implementation in C/C++ that follows the structure laid out in our scripts and exploits parallelism can be competitive with state-of-the-art solvers for these problems. These are presented in MATLAB for readability. Unless otherwise noted on this page, most scripts stand alone and work in Matlab without further modification. Some scripts may requireCVX.

As output, each example script displays the primal residual |r^k|, the primal feasibility toleranceepsilon^mathrm{pri}, the dual residual|s^k|, and the dual feasibility toleranceepsilon^mathrm{dual}. See section 3.3 of the paper for more details on these quantities. Also included are plots of the objective value and the primal and dual residual by iteration. Note that the objective value at any particular iteration can go below the true solution valuep^star because the iterates need not be feasible (e.g., if the constraint isx - z = 0, we can havex^k - z^k neq 0 for somek).

You can use the grabcode function built in to MATLAB to obtain these codes. Please report any issues to the authors.

Examples

  1. Basis pursuit

    1. ADMM function

    2. Example

  2. Sparse inverse covariance selection

    1. ADMM function

    2. Example

  3. Huber fitting

    1. ADMM function

    2. Example

  4. Intersection of polyhedra

    1. ADMM function

    2. Example

  5. Lasso

    1. ADMM function

    2. Example

  6. Lasso with LSQR, an iterative method for solving sparse systems Ax = b

    1. ADMM function

    2. Example

  7. Least absolute deviations

    1. ADMM function

    2. Example

  8. Linear programming

    1. ADMM function

    2. Example

  9. ell_1-regularized logistic regression

    1. ADMM function

    2. Example

  10. Distributed ell_1-regularized logistic regression

    1. ADMM function - also requiresl2_log, l2_log_grad, record_bfgs_iters, and LBFGS-B for Matlab.

    2. Example

  11. Regressor selection (nonconvex problem)

    1. ADMM function

    2. Example

  12. Quadratic programming

    1. ADMM function

    2. Example

  13. Sum-of-norms regularization (group lasso)

    1. ADMM function

    2. Example

  14. Sum-of-norms regularization (group lasso) with feature splitting

    1. ADMM function

    2. Example

  15. Support vector machine

    1. ADMM function

    2. Example

  16. Total variation minimization

    1. ADMM function

    2. Example

评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值