v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
240 CHAPTER 3. GEOMETRY OF CONVEX FUNCTIONS Figure 69: Iconic unimodal differentiable quasiconvex function of two variables graphed in R 2 × R on some open disc in R 2 . Note reversal of curvature in direction of gradient.
3.3. QUASICONVEX 241 Unlike convex functions, quasiconvex functions are not necessarily continuous; e.g., quasiconcave rank(X) on S M + (2.9.2.6.2) and card(x) on R M + . Although insufficient for convex functions, convexity of each and every sublevel set serves as a definition of quasiconvexity: 3.3.0.0.2 Definition. Quasiconvex multidimensional function. Scalar-, vector-, or matrix-valued function g(X) : R p×k →S M is a quasiconvex function of matrix X iff dom g is a convex set and the sublevel set corresponding to each and every S ∈ S M L S g = {X ∈ domg | g(X) ≼ S } ⊆ R p×k (567) is convex. Vectors are compared with respect to the nonnegative orthant R M + while matrices are with respect to the positive semidefinite cone S M + . Convexity of the superlevel set corresponding to each and every S ∈ S M , likewise L S g = {X ∈ domg | g(X) ≽ S } ⊆ R p×k (579) is necessary and sufficient for quasiconcavity. △ 3.3.0.0.3 Exercise. Nonconvexity of matrix product. Consider real function f on a positive definite domain f(X) = tr(X 1 X 2 ) , X ∆ = [ X1 X 2 ] ∈ domf ∆ = [ rel int S N + rel int S N + ] (580) with superlevel sets L s f = {X ∈ domf | 〈X 1 , X 2 〉 ≥ s } (581) Prove: f(X) is not quasiconcave except when N = 1, nor is it quasiconvex unless X 1 = X 2 . 3.3.1 bilinear Bilinear function 3.20 x T y of vectors x and y is quasiconcave (monotonic) on the entirety of the nonnegative orthants only when vectors are of dimension 1. 3.20 Convex envelope of bilinear functions is well known. [2]
- Page 189 and 190: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 191 and 192: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 193 and 194: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 195 and 196: Chapter 3 Geometry of convex functi
- Page 197 and 198: 3.1. CONVEX FUNCTION 197 f 1 (x) f
- Page 199 and 200: 3.1. CONVEX FUNCTION 199 3.1.3 norm
- Page 201 and 202: 3.1. CONVEX FUNCTION 201 A B 1 Figu
- Page 203 and 204: 3.1. CONVEX FUNCTION 203 k/m 1 0.9
- Page 205 and 206: k∑ i=1 3.1. CONVEX FUNCTION 205 S
- Page 207 and 208: 3.1. CONVEX FUNCTION 207 rather x >
- Page 209 and 210: 3.1. CONVEX FUNCTION 209 rather ] x
- Page 211 and 212: 3.1. CONVEX FUNCTION 211 3.1.6.0.2
- Page 213 and 214: 3.1. CONVEX FUNCTION 213 q(x) f(x)
- Page 215 and 216: 3.1. CONVEX FUNCTION 215 3.1.7.0.2
- Page 217 and 218: 3.1. CONVEX FUNCTION 217 We learned
- Page 219 and 220: 3.1. CONVEX FUNCTION 219 Since opti
- Page 221 and 222: 3.1. CONVEX FUNCTION 221 2 1.5 1 0.
- Page 223 and 224: 3.1. CONVEX FUNCTION 223 Setting th
- Page 225 and 226: 3.1. CONVEX FUNCTION 225 Similarly,
- Page 227 and 228: 3.1. CONVEX FUNCTION 227 For vector
- Page 229 and 230: 3.1. CONVEX FUNCTION 229 This means
- Page 231 and 232: 3.1. CONVEX FUNCTION 231 f(Y ) −
- Page 233 and 234: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 235 and 236: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 237 and 238: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 239: 3.3. QUASICONVEX 239 exponential al
- Page 243 and 244: 3.4. SALIENT PROPERTIES 243 6. (af
- Page 245 and 246: Chapter 4 Semidefinite programming
- Page 247 and 248: 4.1. CONIC PROBLEM 247 where K is a
- Page 249 and 250: 4.1. CONIC PROBLEM 249 4.1.1.2 Redu
- Page 251 and 252: 4.1. CONIC PROBLEM 251 In any SDP f
- Page 253 and 254: 4.1. CONIC PROBLEM 253 Proposition
- Page 255 and 256: 4.2. FRAMEWORK 255 sets are closed
- Page 257 and 258: 4.2. FRAMEWORK 257 4.2.1.1.3 Exampl
- Page 259 and 260: 4.2. FRAMEWORK 259 4.2.2 Duals The
- Page 261 and 262: 4.2. FRAMEWORK 261 When equality is
- Page 263 and 264: 4.2. FRAMEWORK 263 The pseudoinvers
- Page 265 and 266: 4.2. FRAMEWORK 265 For the data giv
- Page 267 and 268: 4.2. FRAMEWORK 267 minimizes an aff
- Page 269 and 270: 4.3. RANK REDUCTION 269 whose rank
- Page 271 and 272: 4.3. RANK REDUCTION 271 and where m
- Page 273 and 274: 4.3. RANK REDUCTION 273 4.3.3 Optim
- Page 275 and 276: 4.3. RANK REDUCTION 275 Initialize:
- Page 277 and 278: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 279 and 280: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 281 and 282: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 283 and 284: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 285 and 286: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 287 and 288: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 289 and 290: 4.4. RANK-CONSTRAINED SEMIDEFINITE
3.3. QUASICONVEX 241<br />
Unlike convex functions, quasiconvex functions are not necessarily<br />
continuous; e.g., quasiconcave rank(X) on S M + (2.9.2.6.2) and card(x)<br />
on R M + . Although insufficient for convex functions, convexity of each and<br />
every sublevel set serves as a definition of quasiconvexity:<br />
3.3.0.0.2 Definition. Quasiconvex multidimensional function.<br />
Scalar-, vector-, or matrix-valued function g(X) : R p×k →S M is a quasiconvex<br />
function of matrix X iff dom g is a convex set and the sublevel set<br />
corresponding to each and every S ∈ S M<br />
L S<br />
g = {X ∈ domg | g(X) ≼ S } ⊆ R p×k (567)<br />
is convex. Vectors are compared with respect to the nonnegative orthant R M +<br />
while matrices are with respect to the positive semidefinite cone S M + .<br />
<strong>Convex</strong>ity of the superlevel set corresponding to each and every S ∈ S M ,<br />
likewise<br />
L S g = {X ∈ domg | g(X) ≽ S } ⊆ R p×k (579)<br />
is necessary and sufficient for quasiconcavity.<br />
△<br />
3.3.0.0.3 Exercise. Nonconvexity of matrix product.<br />
Consider real function f on a positive definite domain<br />
f(X) = tr(X 1 X 2 ) , X ∆ =<br />
[<br />
X1<br />
X 2<br />
]<br />
∈ domf ∆ =<br />
[<br />
rel int S<br />
N<br />
+<br />
rel int S N +<br />
]<br />
(580)<br />
with superlevel sets<br />
L s f = {X ∈ domf | 〈X 1 , X 2 〉 ≥ s } (581)<br />
Prove: f(X) is not quasiconcave except when N = 1, nor is it quasiconvex<br />
unless X 1 = X 2 .<br />
<br />
3.3.1 bilinear<br />
Bilinear function 3.20 x T y of vectors x and y is quasiconcave (monotonic) on<br />
the entirety of the nonnegative orthants only when vectors are of dimension 1.<br />
3.20 <strong>Convex</strong> envelope of bilinear functions is well known. [2]