《高等运筹学》复习题手写解答 Advanced Operations Research: Final Exam:Review Exercises

Nonlinear Program 非线性规划

Problem 29.
Suppose $p<1,p\ne 0$ . Show that the function of
$$f(x)={(\sum _{i=1}^n{x}_i^p)}^{1/p}$$ with $domf=R_{++}^n$ is concave.

Solution

Problem 18.
Let $\Omega$ be a subset of $E^n$ and let $f\in C^2$ be a function on $\Omega$. If $x^{\ast }$ is a relative minimum point of $f$ over $\Omega$, then for any $d\in E^n$ that is a feasible direction at $x^{\ast }$ we have

1. $▽f(x^{\ast })d\ge 0$
2. if $▽f(x^{\ast })d=0$, then $d^T{▽}^{2}f(x^{\ast })d\ge 0$

Solution
Problem 4.
Find the minimum number of $c$, such that any local optimal solution is a global optimal solution for the following nonlinear program of $P4$.
$$\begin{gathered} P4)\max f(x)=-c\ast x_1^2+x_1{x}_2+2x_1-\frac{1}{2}{x}_2^2 \\ s.t.x_1\le 2 \end{gathered}$$
Solution

KKT condition KKT条件

Problem 3.
Show the KKT condition for the nonlinear program of $P3$, and try to solve it with the KKT conditions.
$$\begin{gathered} P3)\max -2x_1^2-2x_1{x}_2-x_2^2+10x_1+10x_2 \\ s.t.x_1^2+x_2^2\le 5 \\ 3x_1+x_2\le 6 \end{gathered}$$
Solution

Golden section method 黄金分割法

Problem 16.
For the problem $\min f(x)$ over $x\in [a,b]$, we use golden section method to solve it. Please prove the convergence ratio is $0.618$.

Solution

Newton’s method 牛顿法

Problem 17.
For one dimension nonlinear problem $\min f(x)$ over $x\in [a,b]$, we use Newton’s Method to solve it. Please prove the convergence ratio of Newton’s method is at least two.

Solution

Gradient steepest descent/ ascent method 梯度下降/上升法

*Problem 4.
$$\max f(x)=-\frac{1}{2}{x}_1^2+x_1{x}_2+2x_1-\frac{1}{2}{x}_2^2$$ Use the gradient steepest ascent method to find the optimal solution of above nonlinear program, with the start point $x_0=(0,4{)}^T$.

Solution

Integer Programming 整数规划

Branch and bound 分支定界法

Problem 1.
Use branch and bound method to solve $P1)$.
Note that at each branching node, you can use graphic method to get the (local) upper bound for each node.
Draw the branch and bound tree, and point out the Node Program, GLB and LUB clearly.
$$\begin{gathered} P1)\max 13x_1+5x_2 \\ s.t.3x_1+2x_2\le 6.5 \\ -2x_1+3x_2\le 8 \\ {x}_1,x_2\ge 0,integers \end{gathered}$$
Solution

branch and bound tree

Gomory cutting plane algorithm 割平面法/ Column generation 列生成算法

Problem 26.
$$\begin{gathered} \min {\text{c}}^T\text{x} \\ s.t.\text{Ax}=\text{b} \\ \text{x}\in integer \end{gathered}$$For above $IP$, suppose now we have a basic feasible solution corresponding to basis matrix $\text{B}$ and Non-basis $\text{N}$, i.e., $\text{A}=(\text{B},\text{N})$, and let $a_{ij}=({\text{B}}^{-1}{\text{A}}_j{)}_i$and $a_{i0}=({\text{B}}^{-1}\text{b}{)}_i$. Prove:
$$x_i+\sum _{j\in \text{N}}\lfloor a_{ij}\rfloor x_j\le \lfloor a_{i0}\rfloor$$
Solution

Problem 12.
Use the Gomory cutting plane algorithm to solve the following integer linear programming.
$$\begin{gathered} \min x_1-2x_2 \\ s.t.-4x_1+6x_2\le 9 \\ {x}_1+x_2\le 4 \\ {x}_1,x_2\ge 0,integers \end{gathered}$$
Solution

Problem 28.
$$\begin{gathered} IP)\min c^{T}x \\ s.t.Ax=b \\ x\ge 0and\in integers \end{gathered}$$For above $IP$, denote $A=[a_1,a_2,\cdot \cdot \cdot ,a_n]$ by columns. Let $k<n$, denote $A_k=[a_1,a_2,\cdot \cdot \cdot ,a_k]$.
$$\begin{gathered} IPR)\min c^{T}x \\ s.t.Ax=b \\ x\ge 0 \end{gathered}$$$$\begin{gathered} IP{R}_k)\min c^{T}x \\ s.t.A_{k}x=b \\ x\ge 0 \end{gathered}$$Suppose $x_k^{\ast }$, and $x^{\ast }$ is the optimal solution for subproblem $IP{R}_k)$ and $IPR)$ respectively, and objectives of $OB{J}_{IP{R}_k}$,$OB{J}_{IPR}$ correspondingly. Let S = { a 1 , a 2 , ⋅ ⋅ ⋅ , a n } S = \{a_1,a_2,··· ,a_n\} S={a1​,a2​,⋅⋅⋅,an​}, $B$ is the basis related to $x_k^{\ast }$ for $IP{R}_k$.
$$\begin{gathered} PP)\min c_a-c_B{B}^{-1}a \\ s.t.a\in S \end{gathered}$$Please prove: If $OB{J}_{PP}\ge 0$, then $OB{J}_{IP{R}_k}=OB{J}_{IPR}$

Solution

Dynamic programming 动态规划

IP 有整数约束

Problem 8.
Use dynamic programming method to solve the following integer programming.
$$\begin{gathered} \max 2x_1+3x_2+x_3+2x_4 \\ s.t.5x_1+7x_2+6x_3+5x_4\le 14 \\ {x}_1,x_2,x_3,x_4\ge 0,integers \end{gathered}$$Note that you need to point out recursive formula clearly, and write down calculation steps clearly.

Solution

LP 无整数约束

*Problem 8.
Use dynamic programming method to solve the following linear programming.
$$\begin{gathered} \max 2x_1+3x_2+x_3+2x_4 \\ s.t.5x_1+7x_2+6x_3+5x_4\le 14 \\ {x}_1,x_2,x_3,x_4\ge 0, \end{gathered}$$Note that you need to point out recursive formula clearly, and write down calculation steps clearly.

Solution

Linear programming 线性规划

Central path 中心路径法（内点法）

Problem 25.
Let $(x(\mu ),y(\mu ),s(\mu ))$ be the central path of
$$\begin{gathered} x◦s=\mu e \\ Ax=b \\ {A}^{T}y+s=c \\ x\ge 0,s\ge 0 \end{gathered}$$ Then prove:
(a) The central path point $(x(\mu ),y(\mu ),s(\mu ))$ is bounded for $0<\mu \le {\mu }_0$ and any given $0<\mu <\infty$.
(b) For $0<{\mu }^{\prime }<\mu$,
$$c^{T}x({\mu }^{\prime })\le c^{T}x(\mu )and{b}^{T}y({\mu }^{\prime })\ge b^{T}y(\mu )$$Furthermore, if $x({\mu }^{\prime })\ne x(\mu )$ and $y({\mu }^{\prime })\ne y(\mu )$.
$$c^{T}x({\mu }^{\prime })<c^{T}x(\mu )and{b}^{T}y({\mu }^{\prime })>b^{T}y(\mu )$$
Solution

Problem 11.
Compute the central path for the following linear programming.
$$\begin{gathered} \min x_1 \\ s.t.x_1+x_2+x_3=2 \end{gathered}$$
Solution

Karmarkar算法（内点法）

Problem 6.
What are the differences between Karmarkar method and Simplex method for linear programming? Please show the logics of them clearly. Possibly you can use figures to show what your idea.

Solution

Eliposoid method 椭球法（外点法）

Problem 7.
Use ellipsoid method solve:
$$\begin{gathered} \max 0 \\ s.t.x_1+5x_2\le 7 \\ {x}_1+2x_2\ge 6 \\ {x}_1,x_2\ge 0. \end{gathered}$$The initial Ellipsoid is taken to be $E(0,100\times I_{2\times 2})$.
You only need to give THREE STEPS

Solution

Transportation problem & unimodular matrix 运输问题与幺模矩阵

Problem 20.
For transportation problem stated as follows.
There are m origins that contain various amounts of a commodity that must be shipped to $n$ destinations to meet demand requirements. Specially, origin $i$ contains an amount $a_i$, and destination $j$ has a requirement of amount $b_i$. It is assumed that the system is balanced in the sense that total supply equals total demand. There is unit cost $c_{ij}$ associated with the shipping of the commodity from origin $i$ to destination $j$. The problem is to find the shipping pattern between origins and destinations that satisfies all the requirements and minimized the total shipping cost.
(1) build an mixed integer linear programming model for above problem.
(2) If the row and column sums of a transportation problem are integers, then the basic variables in any basic solution are integers. 如果运输问题的行和列的和是整数，证明所有基可行解的基变量为整数。

Problem 21.
A matrix $\text{A}$ is said to be totally unimodular if the determinant of every square submatrix formed from it has value $0,+1$ or $-1$. （完全幺模矩阵的各阶子式均为0,1或-1）
(1) Show that the matrix $\text{A}$ defining the equality constraints of a transportation prolblem is totally unimodular. 证明运输问题的系数矩阵是完全幺模的。
(2) In the system of equations $\text{Ax}=\text{b}$, assume that $\text{A}$ is totally unimodular and that all elements of $\text{A}$ and $\text{b}$ are integers. Show that all basic solutions have integer components.
与Problem20(2)的区别在于：此时$\text{A}$是任意矩阵，秩不再是$m+n-1$

Solution

Graph Theory 图论

Maximum flow 最大流

Problem 9.
Use the Ford-Fulkerson method to solve decide the maximum flow for the following network problem.

Solution

附原题