v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
134 CHAPTER 2. CONVEX GEOMETRYwhich describe an intersection of four halfspaces in R m(m+1)/2 . Thatintersection creates the proper polyhedral cone K (2.12.1) whoseconstruction is illustrated in Figure 48. Drawn truncated is the boundaryof the positive semidefinite cone svec S 2 + and the bounding hyperplanessupporting K .Created by means of Geršgorin discs, K always belongs to the positivesemidefinite cone for any nonnegative value of p ∈ R m + . Hence any point inK corresponds to some positive semidefinite matrix A . Only the extremedirections of K intersect the positive semidefinite cone boundary in thisdimension; the four extreme directions of K are extreme directions of thepositive semidefinite cone. As p 1 /p 2 increases in value from 0, two extremedirections of K sweep the entire boundary of this positive semidefinite cone.Because the entire positive semidefinite cone can be swept by K , the systemof linear inequalities[Y T p1 ±psvec A 2 / √ ]2 00 ±p 1 / √ svec A ≽ 0 (252)2 p 2when made dynamic can replace a semidefinite constraint A≽0 ; id est, forgiven p where Y ∈ R m(m+1)/2×m2m−1butK = {z | Y T z ≽ 0} ⊂ svec S m + (253)svec A ∈ K ⇒ A ∈ S m + (254)∃p Y T svec A ≽ 0 ⇔ A ≽ 0 (255)In other words, diagonal dominance [202, p.349,7.2.3]A ii ≥m∑|A ij | , ∀i = 1... m (256)j=1j ≠ iis only a sufficient condition for membership to the PSD cone; but bydynamic weighting p in this dimension, it was made necessary andsufficient.In higher dimension (m > 2), boundary of the positive semidefinite coneis no longer constituted completely by its extreme directions (symmetric
2.9. POSITIVE SEMIDEFINITE (PSD) CONE 135rank-one matrices); its geometry becomes intricate. How all the extremedirections can be swept by an inscribed polyhedral cone, 2.49 similarly to theforegoing example, remains an open question.2.9.2.8.4 Exercise. Dual inscription.Find dual proper polyhedral cone K ∗ from Figure 48.2.9.2.9 Boundary constituents of the positive semidefinite cone2.9.2.9.1 Lemma. Sum of positive semidefinite matrices.For A,B ∈ S M +rank(A + B) = rank(µA + (1 −µ)B) (257)over open interval (0, 1) of µ .Proof. Any positive semidefinite matrix belonging to the PSD conehas an eigenvalue decomposition that is a positively scaled sum of linearlyindependent symmetric dyads. By the linearly independent dyads definitioninB.1.1.0.1, rank of the sum A +B is equivalent to the number of linearlyindependent dyads constituting it. Linear independence is insensitive tofurther positive scaling by µ . The assumption of positive semidefinitenessprevents annihilation of any dyad from the sum A +B . 2.9.2.9.2 Example. Rank function quasiconcavity. (confer3.8)For A,B ∈ R m×n [202,0.4]that follows from the fact [331,3.6]rankA + rankB ≥ rank(A + B) (258)dim R(A) + dim R(B) = dim R(A + B) + dim(R(A) ∩ R(B)) (259)For A,B ∈ S M +rankA + rankB ≥ rank(A + B) ≥ min{rankA, rankB} (1466)that follows from the factN(A + B) = N(A) ∩ N(B) , A,B ∈ S M + (160)2.49 It is not necessary to sweep the entire boundary in higher dimension.⋄
- Page 83 and 84: 2.4. HALFSPACE, HYPERPLANE 832.4.2.
- Page 85 and 86: 2.5. SUBSPACE REPRESENTATIONS 852.5
- Page 87 and 88: 2.5. SUBSPACE REPRESENTATIONS 87(Ex
- Page 89 and 90: 2.5. SUBSPACE REPRESENTATIONS 89(a)
- Page 91 and 92: 2.5. SUBSPACE REPRESENTATIONS 91are
- Page 93 and 94: 2.6. EXTREME, EXPOSED 93A one-dimen
- Page 95 and 96: 2.6. EXTREME, EXPOSED 952.6.1.1 Den
- Page 97 and 98: 2.7. CONES 97X(a)00(b)XFigure 33: (
- Page 99 and 100: 2.7. CONES 99XXFigure 37: Truncated
- Page 101 and 102: 2.7. CONES 101Figure 39: Not a cone
- Page 103 and 104: 2.7. CONES 103cone that is a halfli
- Page 105 and 106: 2.7. CONES 105A pointed closed conv
- Page 107 and 108: 2.8. CONE BOUNDARY 107That means th
- Page 109 and 110: 2.8. CONE BOUNDARY 1092.8.1.1 extre
- Page 111 and 112: 2.8. CONE BOUNDARY 1112.8.2 Exposed
- Page 113 and 114: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 115 and 116: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 117 and 118: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 119 and 120: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 121 and 122: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 123 and 124: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 125 and 126: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 127 and 128: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 129 and 130: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 131 and 132: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 133: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 137 and 138: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 139 and 140: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 141 and 142: 2.10. CONIC INDEPENDENCE (C.I.) 141
- Page 143 and 144: 2.10. CONIC INDEPENDENCE (C.I.) 143
- Page 145 and 146: 2.10. CONIC INDEPENDENCE (C.I.) 145
- Page 147 and 148: 2.12. CONVEX POLYHEDRA 147all dimen
- Page 149 and 150: 2.12. CONVEX POLYHEDRA 149convex po
- Page 151 and 152: 2.12. CONVEX POLYHEDRA 1512.12.2.2
- Page 153 and 154: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 155 and 156: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 157 and 158: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 159 and 160: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 161 and 162: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 163 and 164: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 165 and 166: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 167 and 168: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 169 and 170: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 171 and 172: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 173 and 174: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 175 and 176: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 177 and 178: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 179 and 180: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 181 and 182: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 183 and 184: 2.13. DUAL CONE & GENERALIZED INEQU
2.9. POSITIVE SEMIDEFINITE (PSD) CONE 135rank-one matrices); its geometry becomes intricate. How all the extremedirections can be swept by an inscribed polyhedral cone, 2.49 similarly to theforegoing example, remains an open question.2.9.2.8.4 Exercise. Dual inscription.Find dual proper polyhedral cone K ∗ from Figure 48.2.9.2.9 Boundary constituents of the positive semidefinite cone2.9.2.9.1 Lemma. Sum of positive semidefinite matrices.For A,B ∈ S M +rank(A + B) = rank(µA + (1 −µ)B) (257)over open interval (0, 1) of µ .Proof. Any positive semidefinite matrix belonging to the PSD conehas an eigenvalue decomposition that is a positively scaled sum of linearlyindependent symmetric dyads. By the linearly independent dyads definitioninB.1.1.0.1, rank of the sum A +B is equivalent to the number of linearlyindependent dyads constituting it. Linear independence is insensitive tofurther positive scaling by µ . The assumption of positive semidefinitenessprevents annihilation of any dyad from the sum A +B . 2.9.2.9.2 Example. Rank function quasiconcavity. (confer3.8)For A,B ∈ R m×n [202,0.4]that follows from the fact [331,3.6]rankA + rankB ≥ rank(A + B) (258)dim R(A) + dim R(B) = dim R(A + B) + dim(R(A) ∩ R(B)) (259)For A,B ∈ S M +rankA + rankB ≥ rank(A + B) ≥ min{rankA, rankB} (1466)that follows from the factN(A + B) = N(A) ∩ N(B) , A,B ∈ S M + (160)2.49 It is not necessary to sweep the entire boundary in higher dimension.⋄