v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
208 CHAPTER 2. CONVEX GEOMETRYwhich is simply a restatement of optimality conditions (460) for conic problem(454). Suitable f(z) is the quadratic objective from convex problem1minimizez 2 zT Bz + q T zsubject to z ≽ 0(467)which means B ∈ S n + should be (symmetric) positive semidefinite for solutionof (465) by this method. Then (465) has solution iff (467) does. 2.13.10.1.5 Exercise. Optimality for equality constrained conic problem.Consider a conic optimization problem like (454) having real differentiableconvex objective function f(x) : R n →Rminimize f(x)xsubject to Cx = dx ∈ K(468)minimized over convex cone K but, this time, constrained to affine setA = {x | Cx = d}. Show, by means of first-order optimality condition(352) or (452), that necessary and sufficient optimality conditions are:(confer (460))x ⋆ ∈ KCx ⋆ = d∇f(x ⋆ ) + C T ν ⋆ ∈ K ∗(469)〈∇f(x ⋆ ) + C T ν ⋆ , x ⋆ 〉 = 0where ν ⋆ is any vector 2.83 satisfying these conditions.2.13.11 Proper nonsimplicial K , dual, X fat full-rankSince conically dependent columns can always be removed from X toconstruct K or to determine K ∗ [Wıκımization], then assume we are givena set of N conically independent generators (2.10) of an arbitrary properpolyhedral cone K in R n arranged columnar in X ∈ R n×N such that N > n(fat) and rankX = n . Having found formula (420) to determine the dual ofa simplicial cone, the easiest way to find a vertex-description of proper dual2.83 an optimal dual variable, these optimality conditions are equivalent to the KKTconditions [61,5.5.3].
2.13. DUAL CONE & GENERALIZED INEQUALITY 209cone K ∗ is to first decompose K into simplicial parts K i so that K = ⋃ K i . 2.84Each component simplicial cone in K corresponds to some subset of nlinearly independent columns from X . The key idea, here, is how theextreme directions of the simplicial parts must remain extreme directions ofK . Finding the dual of K amounts to finding the dual of each simplicial part:2.13.11.0.1 Theorem. Dual cone intersection. [330,2.7]Suppose proper cone K ⊂ R n equals the union of M simplicial cones K i whoseextreme directions all coincide with those of K . Then proper dual cone K ∗is the intersection of M dual simplicial cones K ∗ i ; id est,M⋃M⋂K = K i ⇒ K ∗ = K ∗ i (470)i=1Proof. For X i ∈ R n×n , a complete matrix of linearly independentextreme directions (p.145) arranged columnar, corresponding simplicial K i(2.12.3.1.1) has vertex-descriptionNow suppose,K =K =i=1K i = {X i c | c ≽ 0} (471)M⋃K i =i=1M⋃{X i c | c ≽ 0} (472)i=1The union of all K i can be equivalently expressed⎧⎡ ⎤⎪⎨[ X 1 X 2 · · · X M ] ⎢⎣⎪⎩aḅ.c⎥⎦ | a , b ... c ≽ 0 ⎫⎪ ⎬⎪ ⎭(473)Because extreme directions of the simplices K i are extreme directions of Kby assumption, then2.84 That proposition presupposes, of course, that we know how to perform simplicialdecomposition efficiently; also called “triangulation”. [303] [173,3.1] [174,3.1] Existenceof multiple simplicial parts means expansion of x∈ K , like (411), can no longer be uniquebecause number N of extreme directions in K exceeds dimension n of the space.⋄
- Page 157 and 158: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 159 and 160: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 161 and 162: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 163 and 164: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 165 and 166: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 167 and 168: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 169 and 170: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 171 and 172: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 173 and 174: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 175 and 176: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 177 and 178: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 179 and 180: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 181 and 182: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 183 and 184: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 185 and 186: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 187 and 188: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 189 and 190: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 191 and 192: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 193 and 194: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 195 and 196: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 197 and 198: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 199 and 200: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 201 and 202: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 203 and 204: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 205 and 206: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 207: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 211 and 212: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 213 and 214: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 215 and 216: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 217 and 218: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 219 and 220: Chapter 3Geometry of convex functio
- Page 221 and 222: 3.1. CONVEX FUNCTION 221f 1 (x)f 2
- Page 223 and 224: 3.1. CONVEX FUNCTION 223Rf(b)f(X
- Page 225 and 226: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 227 and 228: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 229 and 230: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 231 and 232: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 233 and 234: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 235 and 236: 3.3. INVERTED FUNCTIONS AND ROOTS 2
- Page 237 and 238: 3.4. AFFINE FUNCTION 237rather]x >
- Page 239 and 240: 3.4. AFFINE FUNCTION 239f(z)Az 2z 1
- Page 241 and 242: 3.5. EPIGRAPH, SUBLEVEL SET 241{a T
- Page 243 and 244: 3.5. EPIGRAPH, SUBLEVEL SET 243Subl
- Page 245 and 246: 3.5. EPIGRAPH, SUBLEVEL SET 245wher
- Page 247 and 248: 3.5. EPIGRAPH, SUBLEVEL SET 247part
- Page 249 and 250: 3.5. EPIGRAPH, SUBLEVEL SET 249that
- Page 251 and 252: 3.6. GRADIENT 251respect to its vec
- Page 253 and 254: 3.6. GRADIENT 253Invertibility is g
- Page 255 and 256: 3.6. GRADIENT 2553.6.1.0.2 Theorem.
- Page 257 and 258: 3.6. GRADIENT 257f(Y )[ ∇f(X)−1
2.13. DUAL CONE & GENERALIZED INEQUALITY 209cone K ∗ is to first decompose K into simplicial parts K i so that K = ⋃ K i . 2.84Each component simplicial cone in K corresponds to some subset of nlinearly independent columns from X . The key idea, here, is how theextreme directions of the simplicial parts must remain extreme directions ofK . Finding the dual of K amounts to finding the dual of each simplicial part:2.13.11.0.1 Theorem. Dual cone intersection. [330,2.7]Suppose proper cone K ⊂ R n equals the union of M simplicial cones K i whoseextreme directions all coincide with those of K . Then proper dual cone K ∗is the intersection of M dual simplicial cones K ∗ i ; id est,M⋃M⋂K = K i ⇒ K ∗ = K ∗ i (470)i=1Proof. For X i ∈ R n×n , a complete matrix of linearly independentextreme directions (p.145) arranged columnar, corresponding simplicial K i(2.12.3.1.1) has vertex-descriptionNow suppose,K =K =i=1K i = {X i c | c ≽ 0} (471)M⋃K i =i=1M⋃{X i c | c ≽ 0} (472)i=1The union of all K i can be equivalently expressed⎧⎡ ⎤⎪⎨[ X 1 X 2 · · · X M ] ⎢⎣⎪⎩aḅ.c⎥⎦ | a , b ... c ≽ 0 ⎫⎪ ⎬⎪ ⎭(473)Because extreme directions of the simplices K i are extreme directions of Kby assumption, then2.84 That proposition presupposes, of course, that we know how to perform simplicialdecomposition efficiently; also called “triangulation”. [303] [173,3.1] [174,3.1] Existenceof multiple simplicial parts means expansion of x∈ K , like (411), can no longer be uniquebecause number N of extreme directions in K exceeds dimension n of the space.⋄