v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
242 CHAPTER 3. GEOMETRY OF CONVEX FUNCTIONSq(x)f(x)quasiconvexconvexxxFigure 75: Quasiconvex function q epigraph is not necessarily convex, butconvex function f epigraph is convex in any dimension. Sublevel sets arenecessarily convex for either function, but sufficient only for quasiconvexity.all invariant properties of convex sets carry over directly to convex functions.Generalization of epigraph to a vector-valued function f(X) : R p×k →R M isstraightforward: [294]epi f {(X , t)∈ R p×k × R M | X ∈ domf , f(X) ≼t } (556)R M +id est,f convex ⇔ epif convex (557)Necessity is proven: [61, exer.3.60] Given any (X, u), (Y , v)∈ epif , wemust show for all µ∈[0, 1] that µ(X, u) + (1−µ)(Y , v)∈ epif ; id est, wemust showf(µX + (1−µ)Y ) ≼µu + (1−µ)v (558)Yet this holds by definition because f(µX+(1−µ)Y ) ≼ µf(X)+(1−µ)f(Y ).The converse also holds.R M +3.5.0.0.1 Exercise. Epigraph sufficiency.Prove that converse: Given any (X, u), (Y , v)∈ epi f , if for all µ∈[0, 1]µ(X, u) + (1−µ)(Y , v)∈ epif holds, then f must be convex.
3.5. EPIGRAPH, SUBLEVEL SET 243Sublevel sets of a convex real function are convex. Likewise, correspondingto each and every ν ∈ R ML ν f {X ∈ dom f | f(X) ≼ν } ⊆ R p×k (559)R M +sublevel sets of a convex vector-valued function are convex. As for convexreal functions, the converse does not hold. (Figure 75)To prove necessity of convex sublevel sets: For any X,Y ∈ L ν f we mustshow for each and every µ∈[0, 1] that µX + (1−µ)Y ∈ L ν f . By definition,f(µX + (1−µ)Y ) ≼R M +µf(X) + (1−µ)f(Y ) ≼R M +ν (560)When an epigraph (556) is artificially bounded above, t ≼ ν , then thecorresponding sublevel set can be regarded as an orthogonal projection ofepigraph on the function domain.Sense of the inequality is reversed in (556), for concave functions, and weuse instead the nomenclature hypograph. Sense of the inequality in (559) isreversed, similarly, with each convex set then called superlevel set.3.5.0.0.2 Example. Matrix pseudofractional function.Consider a real function of two variablesf(A, x) : S n × R n → R = x T A † x (561)on domf = S+× n R(A). This function is convex simultaneously in bothvariables when variable matrix A belongs to the entire positive semidefinitecone S n + and variable vector x is confined to range R(A) of matrix A .To explain this, we need only demonstrate that the function epigraph is
- Page 191 and 192: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 193 and 194: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 195 and 196: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 197 and 198: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 199 and 200: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 201 and 202: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 203 and 204: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 205 and 206: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 207 and 208: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 209 and 210: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 211 and 212: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 213 and 214: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 215 and 216: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 217 and 218: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 219 and 220: Chapter 3Geometry of convex functio
- Page 221 and 222: 3.1. CONVEX FUNCTION 221f 1 (x)f 2
- Page 223 and 224: 3.1. CONVEX FUNCTION 223Rf(b)f(X
- Page 225 and 226: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 227 and 228: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 229 and 230: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 231 and 232: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 233 and 234: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 235 and 236: 3.3. INVERTED FUNCTIONS AND ROOTS 2
- Page 237 and 238: 3.4. AFFINE FUNCTION 237rather]x >
- Page 239 and 240: 3.4. AFFINE FUNCTION 239f(z)Az 2z 1
- Page 241: 3.5. EPIGRAPH, SUBLEVEL SET 241{a T
- Page 245 and 246: 3.5. EPIGRAPH, SUBLEVEL SET 245wher
- Page 247 and 248: 3.5. EPIGRAPH, SUBLEVEL SET 247part
- Page 249 and 250: 3.5. EPIGRAPH, SUBLEVEL SET 249that
- Page 251 and 252: 3.6. GRADIENT 251respect to its vec
- Page 253 and 254: 3.6. GRADIENT 253Invertibility is g
- Page 255 and 256: 3.6. GRADIENT 2553.6.1.0.2 Theorem.
- Page 257 and 258: 3.6. GRADIENT 257f(Y )[ ∇f(X)−1
- Page 259 and 260: 3.6. GRADIENT 259αβα ≥ β ≥
- Page 261 and 262: 3.6. GRADIENT 2613.6.4 second-order
- Page 263 and 264: 3.7. CONVEX MATRIX-VALUED FUNCTION
- Page 265 and 266: 3.7. CONVEX MATRIX-VALUED FUNCTION
- Page 267 and 268: 3.7. CONVEX MATRIX-VALUED FUNCTION
- Page 269 and 270: 3.8. QUASICONVEX 269exponential alw
- Page 271 and 272: 3.9. SALIENT PROPERTIES 2713.8.0.0.
- Page 273 and 274: Chapter 4Semidefinite programmingPr
- Page 275 and 276: 4.1. CONIC PROBLEM 275(confer p.162
- Page 277 and 278: 4.1. CONIC PROBLEM 277PCsemidefinit
- Page 279 and 280: 4.1. CONIC PROBLEM 279is the affine
- Page 281 and 282: 4.1. CONIC PROBLEM 281faces of S 3
- Page 283 and 284: 4.1. CONIC PROBLEM 2834.1.2.3 Previ
- Page 285 and 286: 4.2. FRAMEWORK 285Semidefinite Fark
- Page 287 and 288: 4.2. FRAMEWORK 287On the other hand
- Page 289 and 290: 4.2. FRAMEWORK 2894.2.2.1 Dual prob
- Page 291 and 292: 4.2. FRAMEWORK 291For symmetric pos
242 CHAPTER 3. GEOMETRY OF CONVEX FUNCTIONSq(x)f(x)quasiconvexconvexxxFigure 75: Quasiconvex function q epigraph is not necessarily convex, butconvex function f epigraph is convex in any dimension. Sublevel sets arenecessarily convex for either function, but sufficient only for quasiconvexity.all invariant properties of convex sets carry over directly to convex functions.Generalization of epigraph to a vector-valued function f(X) : R p×k →R M isstraightforward: [294]epi f {(X , t)∈ R p×k × R M | X ∈ domf , f(X) ≼t } (556)R M +id est,f convex ⇔ epif convex (557)Necessity is proven: [61, exer.3.60] Given any (X, u), (Y , v)∈ epif , wemust show for all µ∈[0, 1] that µ(X, u) + (1−µ)(Y , v)∈ epif ; id est, wemust showf(µX + (1−µ)Y ) ≼µu + (1−µ)v (558)Yet this holds by definition because f(µX+(1−µ)Y ) ≼ µf(X)+(1−µ)f(Y ).The converse also holds.R M +3.5.0.0.1 Exercise. Epigraph sufficiency.Prove that converse: Given any (X, u), (Y , v)∈ epi f , if for all µ∈[0, 1]µ(X, u) + (1−µ)(Y , v)∈ epif holds, then f must be convex.