[笔记] Convex Optimization 2015.11.18

本文深入探讨了凸函数的定义、性质及其在不同场景下的应用,包括凸集、谱范数、最小化问题等。通过具体实例,展示了如何验证凸函数的性质,并讨论了凸函数在实际问题中的重要性。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

Let {fa:aA} be a collection of convex functinos from Rn to R, with same domain, then f(x)=supaAfa(x) is a convex function.

  • Proof1: Take x,ydomf, θ[0,1],
    f(θx+(1θ)y)==supafa(θx+(1θ)y)supa[θfa(x)+(1θ)fa(y)]θsupafa(x)+(1θ)supafa(y)θf(x)+(1θ)f(y)

(The proposition is true for domf=aAdomfa, but false for domf=aAdomfa.)

  • Proof2:

    epi(f)==={(x,t):xdomf,t>fa(x)aA}{(x,t):(x,t)epi(fa)aA}aAepi(fa)
  • Example: Let x[i] denote the i-th largest component of x=(x1,,xn)Rn,
    then maxsumr(x)=x[1]+x[2]++x[r] is convex.

  • Proof: maxsumr(x)xi1+xi2++xir
    for any {i1,,ir}{1,,n} with ijik for jk
    so it is convex.

  • Example: Let CRn, define Sc(x)=sup{yTx:yC}, then Sc is convex.

  • Example: Let f:SnR, f(X) is the largest eigenvalue of X.
    Claim: f is convex.

  • Proof: First claim that f(X)=sup{yTXy:y2=1}
  • Proof of claim:

    supy2=1yTXy====supy2=1yTPDPTysupv2=1vTDvsupv2=1λiv2isupv2=1max(λi)i=1nv2imax(λi)
  • Example: Let f:Rm×nR be defined by f(X)=X2 where X2=supy2=1Xy2 is the spectural norm of XRm×n.

  • Claim: f(X)=supu,v{uTXv:u2=1,v2=1}
    because Xv2=sup{uTXv:uRn,u2=1}
    more generally: Xa,b=sup{Xvb:va=1}=sup{uTXv:va=1,ub=1}
    (Xvb=Xvb=supu{uTXv:ub=1})

  • Composition: Have f(x)=h(g(x)), xRn, g(x)R, when is f convex?

  • Would-be-proof: Take x,ydomf, θ[0,1] then

    f(θx+(1θ)y)==h(g(θx+(1θ)y))h(θg(x)+(1θ)g(y))θh(g(x))+(1θ)h(g(y))θf(x)+(1θ)f(y)use domf is convexuse g is convex/concave, h is nondecreasing/nonincreasinguse h is convex
--1234
Conditiongconvexconcaveconvexconcave
-hnondecreasingnonincreasingnonincreasingnondecreasing
-hconvexconvexconcaveconcave
Resultfconvexconvexconcaveconcave

- Example: g(x)=x21,h(x)=x3/2,domh=R+
then dom(hg)=(,1][1,+] is not convex.

  • Example 3.13:
    If g is convex then eg(x) is convex. 1
    If g is concave and positive then log(g(x)) is concave. 4
    If g is concave and positive then 1g(x) is convex. 2
    If g is convex and nonnegative and p1, g(x)p is convex. 1
    g:RnRm, say g is K-convex, where K is a cone in Rm,
    if domg is convex and g(θx+(1θ)y)Kθg(x)+(1θ)g(t)
    xKyh(x)h(y) K-nondecreasing.

  • Example 3.14:
    h(z)=log(ki=1ezi), so log(ki=1egi(x)) will be convex if g1,,gk are convex.

  • Minimization: Let f:Rn×Rm be a convex function, then
    g(x)=infy:(x,y)domff(x,y) is convex.

  • Proof: Let x1,x2domg, θ[0,1].
    then for any ε>0, y1,y2, s.t.
    g(x1)f(x1,y1)ε, g(x2)f(x2,y2)εand

    g(θx1+(1θ)x2)=infyf(θx1+(1θ)x2,y)f(θx1+(1θ)x2,θy1+(1θ)y2)θf(x1,y1)+(1θ)f(x2,y2)θg(x1)+(1θ)g(x2)+ε
  • Example: Let CRn be a convex set, then
    g(x)=infyCxy is a convex function.

  • Proof: Use f(x,y)=xydomf=Rn×C,
    f(θx1+(1θ)x2,θy+(1θ)y2)===θx1+(1θ)x2θy1(1θ)y2θ(x1y1)+(1θ)(x2y2)θx1y1+(1θ)x2y2f(x1,y1)+f(x2,y2)

Consider function g(w)=infxmi=1wi(aTixbi)2, “weighted least square”
concave function of w
Let g(w)=infx(Axb)TW(Axb)=infx(xTATWAx2bTWAx+bTWb)
assume ATWA0, then optimal x=(ATWA)1ATWb
(minx(xTAx+2bTx),=2Ax+2b=0bestx=A1b)

optimal value====bTWA(ATWA)1ATWb2bTWA(ATWA)1ATWb+bTWbbTWA(ATWA)1ATWb+bTWbi=1mb2iwi(i=1mwibiaTi)(i=1mwiaiaTi)1(i=1mwibiai)i=1mb2iwii,jwiwjbibjaTi(i=1mwiaiaTi)1aj

(ATWA=ai(wiaTi)=wiaiaTi)
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值