v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
184 CHAPTER 2. CONVEX GEOMETRY 2.13.10.1.2 Example. Optimality conditions for conic problem. Consider a convex optimization problem having real differentiable convex objective function f(x) : R n →R defined on domain R n minimize f(x) x subject to x ∈ K (407) The feasible set is a pointed polyhedral cone K possessing a linearly independent set of generators and whose subspace membership is made explicit by fat full-rank matrix C ∈ R p×n ; id est, we are given the halfspace-description K = {x | Ax ≽ 0, Cx = 0} ⊆ R n (259a) where A∈ R m×n . The vertex-description of this cone, assuming (ÂZ)† skinny-or-square full-rank, is K = {Z(ÂZ)† b | b ≽ 0} (398) where Â∈ Rm−l×n , l is the number of conically dependent rows in AZ (2.10) that must be removed, and Z ∈ R n×n−rank C holds basis N(C) columnar. From optimality condition (319), because ∇f(x ⋆ ) T (Z(ÂZ)† b − x ⋆ )≥ 0 ∀b ≽ 0 (408) −∇f(x ⋆ ) T Z(ÂZ)† (b − b ⋆ )≤ 0 ∀b ≽ 0 (409) x ⋆ ∆ = Z(ÂZ)† b ⋆ ∈ K (410) From membership relation (404) and Example 2.13.10.1.1 〈−(Z T Â T ) † Z T ∇f(x ⋆ ), b − b ⋆ 〉 ≤ 0 for all b ∈ R m−l + ⇔ (411) −(Z T Â T ) † Z T ∇f(x ⋆ ) ∈ −R m−l + ∩ b ⋆⊥ Then the equivalent necessary and sufficient conditions for optimality of the conic problem (407) with pointed polyhedral feasible set K are: (confer (326))
2.13. DUAL CONE & GENERALIZED INEQUALITY 185 (Z T Â T ) † Z T ∇f(x ⋆ ) ≽ R m−l + 0, b ⋆ ≽ R m−l + 0, ∇f(x ⋆ ) T Z(ÂZ)† b ⋆ = 0 (412) When K = R n + , in particular, then C =0, A=Z =I ∈ S n ; id est, minimize f(x) x subject to x ≽ 0 (413) The necessary and sufficient conditions become (confer [53,4.2.3]) R n + ∇f(x ⋆ ) ≽ 0, x ⋆ ≽ 0, ∇f(x ⋆ ) T x ⋆ = 0 (414) R n + R n + 2.13.10.1.3 Example. Linear complementarity. [235] [269] Given matrix A ∈ R n×n and vector q ∈ R n , the complementarity problem is a feasibility problem: find w , z subject to w ≽ 0 z ≽ 0 w T z = 0 w = q + Az (415) Volumes have been written about this problem, most notably by Cottle [76]. The problem is not convex if both vectors w and z are variable. But if one of them is fixed, then the problem becomes convex with a very simple geometric interpretation: Define the affine subset A ∆ = {y ∈ R n | Ay=w − q} (416) For w T z to vanish, there must be a complementary relationship between the nonzero entries of vectors w and z ; id est, w i z i =0 ∀i. Given w ≽0, then z belongs to the convex set of feasible solutions: z ∈ −K ⊥ R n + (w ∈ Rn +) ∩ A = R n + ∩ w ⊥ ∩ A (417) where KR ⊥ (w) is the normal cone to n Rn + + at w (406). If this intersection is nonempty, then the problem is solvable.
- Page 133 and 134: 2.12. CONVEX POLYHEDRA 133 It follo
- Page 135 and 136: 2.12. CONVEX POLYHEDRA 135 Coeffici
- Page 137 and 138: 2.12. CONVEX POLYHEDRA 137 2.12.3 U
- Page 139 and 140: 2.12. CONVEX POLYHEDRA 139
- Page 141 and 142: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 143 and 144: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 145 and 146: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 147 and 148: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 149 and 150: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 151 and 152: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 153 and 154: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 155 and 156: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 157 and 158: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 159 and 160: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 161 and 162: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 163 and 164: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 165 and 166: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 167 and 168: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 169 and 170: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 171 and 172: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 173 and 174: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 175 and 176: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 177 and 178: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 179 and 180: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 181 and 182: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 183: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 187 and 188: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 189 and 190: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 191 and 192: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 193 and 194: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 195 and 196: Chapter 3 Geometry of convex functi
- Page 197 and 198: 3.1. CONVEX FUNCTION 197 f 1 (x) f
- Page 199 and 200: 3.1. CONVEX FUNCTION 199 3.1.3 norm
- Page 201 and 202: 3.1. CONVEX FUNCTION 201 A B 1 Figu
- Page 203 and 204: 3.1. CONVEX FUNCTION 203 k/m 1 0.9
- Page 205 and 206: k∑ i=1 3.1. CONVEX FUNCTION 205 S
- Page 207 and 208: 3.1. CONVEX FUNCTION 207 rather x >
- Page 209 and 210: 3.1. CONVEX FUNCTION 209 rather ] x
- Page 211 and 212: 3.1. CONVEX FUNCTION 211 3.1.6.0.2
- Page 213 and 214: 3.1. CONVEX FUNCTION 213 q(x) f(x)
- Page 215 and 216: 3.1. CONVEX FUNCTION 215 3.1.7.0.2
- Page 217 and 218: 3.1. CONVEX FUNCTION 217 We learned
- Page 219 and 220: 3.1. CONVEX FUNCTION 219 Since opti
- Page 221 and 222: 3.1. CONVEX FUNCTION 221 2 1.5 1 0.
- Page 223 and 224: 3.1. CONVEX FUNCTION 223 Setting th
- Page 225 and 226: 3.1. CONVEX FUNCTION 225 Similarly,
- Page 227 and 228: 3.1. CONVEX FUNCTION 227 For vector
- Page 229 and 230: 3.1. CONVEX FUNCTION 229 This means
- Page 231 and 232: 3.1. CONVEX FUNCTION 231 f(Y ) −
- Page 233 and 234: 3.2. MATRIX-VALUED CONVEX FUNCTION
2.13. DUAL CONE & GENERALIZED INEQUALITY 185<br />
(Z T Â T ) † Z T ∇f(x ⋆ ) ≽<br />
R m−l<br />
+<br />
0, b ⋆ ≽<br />
R m−l<br />
+<br />
0, ∇f(x ⋆ ) T Z(ÂZ)† b ⋆ = 0 (412)<br />
When K = R n + , in particular, then C =0, A=Z =I ∈ S n ; id est,<br />
minimize f(x)<br />
x<br />
subject to x ≽ 0 (413)<br />
The necessary and sufficient conditions become (confer [53,4.2.3])<br />
R n +<br />
∇f(x ⋆ ) ≽ 0, x ⋆ ≽ 0, ∇f(x ⋆ ) T x ⋆ = 0 (414)<br />
R n +<br />
R n +<br />
<br />
2.13.10.1.3 Example. Linear complementarity. [235] [269]<br />
Given matrix A ∈ R n×n and vector q ∈ R n , the complementarity problem is<br />
a feasibility problem:<br />
find w , z<br />
subject to w ≽ 0<br />
z ≽ 0<br />
w T z = 0<br />
w = q + Az<br />
(415)<br />
Volumes have been written about this problem, most notably by Cottle [76].<br />
The problem is not convex if both vectors w and z are variable. But if one of<br />
them is fixed, then the problem becomes convex with a very simple geometric<br />
interpretation: Define the affine subset<br />
A ∆ = {y ∈ R n | Ay=w − q} (416)<br />
For w T z to vanish, there must be a complementary relationship between the<br />
nonzero entries of vectors w and z ; id est, w i z i =0 ∀i. Given w ≽0, then<br />
z belongs to the convex set of feasible solutions:<br />
z ∈ −K ⊥ R n + (w ∈ Rn +) ∩ A = R n + ∩ w ⊥ ∩ A (417)<br />
where KR ⊥ (w) is the normal cone to n Rn + + at w (406). If this intersection is<br />
nonempty, then the problem is solvable.