v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
192 CHAPTER 2. CONVEX GEOMETRY2.13.8.1 x ∈ KSuppose x belongs to K ⊆ R n . Then x =Xa for some a≽0. Vector a isunique only when {Γ i } is a linearly independent set. 2.74 Vector a∈ R N cantake the form a =Bx if R(B)= R N . Then we require Xa =XBx = x andBx=BXa = a . The pseudoinverse B =X † ∈ R N×n (E) is suitable when Xis skinny-or-square and full-rank. In that case rankX =N , and for all c ≽ 0and i=1... Na ≽ 0 ⇔ X † Xa ≽ 0 ⇔ a T X T X †T c ≥ 0 ⇔ Γ T i X †T c ≥ 0 (405)The penultimate inequality follows from the generalized inequality andmembership corollary, while the last inequality is a consequence of thatcorollary’s discretization (2.13.4.2.1). 2.75 From (405) and (393) we deduceK ∗ ∩ aff K = cone(X †T ) = {X †T c | c ≽ 0} ⊆ R n (406)is the vertex-description for that section of K ∗ in the affine hull of K becauseR(X †T ) = R(X) by definition of the pseudoinverse. From (310), we knowK ∗ ∩ aff K must be pointed if rel int K is logically assumed nonempty withrespect to aff K .Conversely, suppose full-rank skinny-or-square matrix (N ≤ n)[ ]X †T Γ ∗ 1 Γ ∗ 2 · · · Γ ∗ N ∈ R n×N (407)comprises the extreme directions {Γ ∗ i } ⊂ aff K of the dual-cone intersectionwith the affine hull of K . 2.76 From the discretized membership theorem and2.74 Conic independence alone (2.10) is insufficient to guarantee uniqueness.2.75a ≽ 0 ⇔ a T X T X †T c ≥ 0 ∀(c ≽ 0 ⇔ a T X T X †T c ≥ 0 ∀a ≽ 0)∀(c ≽ 0 ⇔ Γ T i X†T c ≥ 0 ∀i) Intuitively, any nonnegative vector a is a conic combination of the standard basis{e i ∈ R N }; a≽0 ⇔ a i e i ≽0 for all i. The last inequality in (405) is a consequence of thefact that x=Xa may be any extreme direction of K , in which case a is a standard basisvector; a = e i ≽0. Theoretically, because c ≽ 0 defines a pointed polyhedral cone (in fact,the nonnegative orthant in R N ), we can take (405) one step further by discretizing c :a ≽ 0 ⇔ Γ T i Γ ∗ j ≥ 0 for i,j =1... N ⇔ X † X ≥ 0In words, X † X must be a matrix whose entries are each nonnegative.2.76 When closed convex cone K is not full-dimensional, K ∗ has no extreme directions.
2.13. DUAL CONE & GENERALIZED INEQUALITY 193(314) we get a partial dual to (393); id est, assuming x∈aff cone X{ }x ∈ K ⇔ γ ∗T x ≥ 0 for all γ ∗ ∈ Γ ∗ i , i=1... N ⊂ ∂K ∗ ∩ aff K (408)⇔ X † x ≽ 0 (409)that leads to a partial halfspace-description,K = { x∈aff coneX | X † x ≽ 0 } (410)For γ ∗ =X †T e i , any x =Xa , and for all i we have e T i X † Xa = e T i a ≥ 0only when a ≽ 0. Hence x∈ K .When X is full-rank, then the unique biorthogonal expansion of x ∈ Kbecomes (403)x = XX † x =N∑i=1Γ i Γ ∗Ti x (411)whose coordinates Γ ∗Ti x must be nonnegative because K is assumed pointedclosed and convex. Whenever X is full-rank, so is its pseudoinverse X † .(E) In the present case, the columns of X †T are linearly independentand generators of the dual cone K ∗ ∩ aff K ; hence, the columns constituteits extreme directions. (2.10.2) That section of the dual cone is itself apolyhedral cone (by (287) or the cone intersection theorem,2.7.2.1.1) havingthe same number of extreme directions as K .2.13.8.2 x ∈ aff KThe extreme directions of K and K ∗ ∩ aff K have a distinct relationship;because X † X = I , then for i,j = 1... N , Γ T i Γ ∗ i = 1, while for i ≠ j ,Γ T i Γ ∗ j = 0. Yet neither set of extreme directions, {Γ i } nor {Γ ∗ i } , isnecessarily orthogonal. This is a biorthogonality condition, precisely,[365,2.2.4] [202] implying each set of extreme directions is linearlyindependent. (B.1.1.1)The biorthogonal expansion therefore applies more broadly; meaning,for any x ∈ aff K , vector x can be uniquely expressed x =Xb whereb∈R N because aff K contains the origin. Thus, for any such x∈ R(X)(conferE.1.1), biorthogonal expansion (411) becomes x =XX † Xb =Xb .
- Page 141 and 142: 2.10. CONIC INDEPENDENCE (C.I.) 141
- Page 143 and 144: 2.10. CONIC INDEPENDENCE (C.I.) 143
- Page 145 and 146: 2.10. CONIC INDEPENDENCE (C.I.) 145
- Page 147 and 148: 2.12. CONVEX POLYHEDRA 147all dimen
- Page 149 and 150: 2.12. CONVEX POLYHEDRA 149convex po
- Page 151 and 152: 2.12. CONVEX POLYHEDRA 1512.12.2.2
- Page 153 and 154: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 155 and 156: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 157 and 158: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 159 and 160: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 161 and 162: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 163 and 164: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 165 and 166: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 167 and 168: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 169 and 170: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 171 and 172: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 173 and 174: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 175 and 176: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 177 and 178: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 179 and 180: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 181 and 182: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 183 and 184: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 185 and 186: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 187 and 188: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 189 and 190: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 191: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 195 and 196: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 197 and 198: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 199 and 200: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 201 and 202: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 203 and 204: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 205 and 206: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 207 and 208: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 209 and 210: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 211 and 212: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 213 and 214: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 215 and 216: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 217 and 218: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 219 and 220: Chapter 3Geometry of convex functio
- Page 221 and 222: 3.1. CONVEX FUNCTION 221f 1 (x)f 2
- Page 223 and 224: 3.1. CONVEX FUNCTION 223Rf(b)f(X
- Page 225 and 226: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 227 and 228: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 229 and 230: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 231 and 232: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 233 and 234: 3.2. PRACTICAL NORM FUNCTIONS, ABSO
- Page 235 and 236: 3.3. INVERTED FUNCTIONS AND ROOTS 2
- Page 237 and 238: 3.4. AFFINE FUNCTION 237rather]x >
- Page 239 and 240: 3.4. AFFINE FUNCTION 239f(z)Az 2z 1
- Page 241 and 242: 3.5. EPIGRAPH, SUBLEVEL SET 241{a T
2.13. DUAL CONE & GENERALIZED INEQUALITY 193(314) we get a partial dual to (393); id est, assuming x∈aff cone X{ }x ∈ K ⇔ γ ∗T x ≥ 0 for all γ ∗ ∈ Γ ∗ i , i=1... N ⊂ ∂K ∗ ∩ aff K (408)⇔ X † x ≽ 0 (409)that leads to a partial halfspace-description,K = { x∈aff coneX | X † x ≽ 0 } (410)For γ ∗ =X †T e i , any x =Xa , and for all i we have e T i X † Xa = e T i a ≥ 0only when a ≽ 0. Hence x∈ K .When X is full-rank, then the unique biorthogonal expansion of x ∈ Kbecomes (403)x = XX † x =N∑i=1Γ i Γ ∗Ti x (411)whose coordinates Γ ∗Ti x must be nonnegative because K is assumed pointedclosed and convex. Whenever X is full-rank, so is its pseudoinverse X † .(E) In the present case, the columns of X †T are linearly independentand generators of the dual cone K ∗ ∩ aff K ; hence, the columns constituteits extreme directions. (2.10.2) That section of the dual cone is itself apolyhedral cone (by (287) or the cone intersection theorem,2.7.2.1.1) havingthe same number of extreme directions as K .2.13.8.2 x ∈ aff KThe extreme directions of K and K ∗ ∩ aff K have a distinct relationship;because X † X = I , then for i,j = 1... N , Γ T i Γ ∗ i = 1, while for i ≠ j ,Γ T i Γ ∗ j = 0. Yet neither set of extreme directions, {Γ i } nor {Γ ∗ i } , isnecessarily orthogonal. This is a biorthogonality condition, precisely,[365,2.2.4] [202] implying each set of extreme directions is linearlyindependent. (B.1.1.1)The biorthogonal expansion therefore applies more broadly; meaning,for any x ∈ aff K , vector x can be uniquely expressed x =Xb whereb∈R N because aff K contains the origin. Thus, for any such x∈ R(X)(conferE.1.1), biorthogonal expansion (411) becomes x =XX † Xb =Xb .