凸优化第五章对偶 作业题

Lagrange对偶问题

The dual function provides a lower bound on the optimal value for convex optimization problems only.

对偶函数可以为任意优化问题的最优值提供下界。

The dual function of an optimization problem evaluated at some (λ,ν), with λ⪰0, is equal to 42. Enter a number that can represent the optimal value of the original problem.

因为对偶函数为优化问题的最优值提供下界,只有最优值大于等于42即可。

强弱对偶性

Consider a convex optimization problem

\begin{array}{ll} \mbox{minimize} & f_0(x)\\ \mbox{subject to} & f_i(x) \leq b_i, \quad i=1, \ldots, m\\ & Ax = d \end{array}

that satisfies Slater's constraint qualification.

Which of the following are true?

当原问题是凸问题,且满足Slater约束时,满足强对偶性,所以选项1正确。但是强对偶性成立,并不代表原问题和对有问题可行,选项2,3不正确。

几何解释

If the feasible set of an optimization problem is not convex, then the duality gap is always nonzero.

优化问题的可行集是凸集,大部分情况下对偶间隙是0,即强对偶性成立。但可行集不是凸集时,也可能对偶间隙为0.

优化条件

Consider a convex optimization problem

\begin{array}{ll} \mbox{minimize} & f_0(x)\\ \mbox{subject to} & f_i(x) \leq 0, \quad i=1, \ldots, m\\ & Ax = d \end{array}

that satisfies Slater's constraint qualification.

What is the value of \lambda_1^{\star} if  f_1(x^\star) = -0.2 ?

凸优化问题满足Slater约束条件,所以强对偶性成立,所以

f_0(x^*)=g(\lambda ^*,v^*)=\underset{x }{inf}(f_0(x)+\sum _{i=1}^m \lambda_i^* f_i(x)+\sum _{i=1}^p v^*_ih_i(x))\\ \leq (f_0(x^*)+\sum _{i=1}^m \lambda_i^* f_i(x^*)+\sum _{i=1}^p v^*_ih_i(x^*))\\ \leq f_0(x^*)

所以

\sum _{i=1}^m \lambda_i^* f_i(x^*)+\sum _{i=1}^p v^*_ih_i(x^*)=0\Rightarrow \sum _{i=1}^m \lambda_i^* f_i(x^*)=0

f_i(x)\leq 0,\lambda^*_i\geq 0\Rightarrow f_i(x)\lambda_i^*=0,i=1,\cdots m

所以当f_1(x^\star) = -0.2时,\lambda^*_1=0

扰动及灵敏度分析

Consider the convex optimization problem

\begin{array}{ll} \mbox{minimize} & f_0(x) \\ \mbox{subject to} & f_1(x) \leq s\\ & Ax = b, \end{array}

with variable x\in R^n, where s is some fixed real number. Let \lambda ^* be an optimal dual variable (Lagrange multiplier) associated with the constraint f_1(x)\leq s. Below we consider scenarios in which we change the value of s, and then solve the modified problem. We are interested in the optimal objective value of this modified problem, compared to the original one above.

If \lambda ^* is large, then decreasing s

If \lambda ^* is small, then increasing s

  • 0
    点赞
  • 10
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值