v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
114 CHAPTER 2. CONVEX GEOMETRY2.9.0.0.1 Definition. Positive semidefinite cone.The set of all symmetric positive semidefinite matrices of particulardimension M is called the positive semidefinite cone:S M + { A ∈ S M | A ≽ 0 }= { A ∈ S M | y T Ay ≥0 ∀ ‖y‖ = 1 }= ⋂ {A ∈ S M | 〈yy T , A〉 ≥ 0 }(191)‖y‖=1= {A ∈ S M + | rankA ≤ M }formed by the intersection of an infinite number of halfspaces (2.4.1.1) invectorized variable 2.37 A , each halfspace having partial boundary containingthe origin in isomorphic R M(M+1)/2 . It is a unique immutable proper conein the ambient space of symmetric matrices S M .The positive definite (full-rank) matrices comprise the cone interiorint S M + = { A ∈ S M | A ≻ 0 }= { A ∈ S M | y T Ay>0 ∀ ‖y‖ = 1 }= ⋂ {A ∈ S M | 〈yy T , A〉 > 0 }‖y‖=1= {A ∈ S M + | rankA = M }(192)while all singular positive semidefinite matrices (having at least one0 eigenvalue) reside on the cone boundary (Figure 43); (A.7.5)∂S M + = { A ∈ S M | A ≽ 0, A ⊁ 0 }= { A ∈ S M | min{λ(A) i , i=1... M } = 0 }= { A ∈ S M + | 〈yy T , A〉=0 for some ‖y‖ = 1 }= {A ∈ S M + | rankA < M }(193)where λ(A)∈ R M holds the eigenvalues of A .The only symmetric positive semidefinite matrix in S M +0-eigenvalues resides at the origin. (A.7.3.0.1)△having M2.37 infinite in number when M >1. Because y T A y=y T A T y , matrix A is almost alwaysassumed symmetric. (A.2.1)
2.9. POSITIVE SEMIDEFINITE (PSD) CONE 115γsvec ∂ S 2 +[ α ββ γ]α√2βMinimal set of generators are the extreme directions: svec{yy T | y ∈ R M }Figure 43: (d’Aspremont) Truncated boundary of PSD cone in S 2 plotted inisometrically isomorphic R 3 via svec (56); 0-contour of smallest eigenvalue(193). Lightest shading is closest, darkest shading is farthest and inside shell.Entire boundary can be constructed{ from an√ aggregate of rays (2.7.0.0.1)emanating exclusively from origin: κ 2 [z12 2z1 z 2 z2 2 ] T | κ∈ R , z ∈ R 2} .A circular cone in this dimension (2.9.2.8), each and every ray on boundarycorresponds to an extreme direction but such is not the case in any higherdimension (confer Figure 24). PSD cone geometry is not as simple in higherdimensions [26,II.12] although PSD cone is selfdual (377) in ambient realspace of symmetric matrices. [195,II] PSD cone has no two-dimensionalface in any dimension, its only extreme point residing at 0.
- Page 63 and 64: 2.3. HULLS 63Aaffine hull (drawn tr
- Page 65 and 66: 2.3. HULLS 65subset of the affine h
- Page 67 and 68: 2.3. HULLS 672.3.2.0.2 Example. Nuc
- Page 69 and 70: 2.3. HULLS 692.3.2.0.3 Exercise. Co
- Page 71 and 72: 2.3. HULLS 71Figure 24: A simplicia
- Page 73 and 74: 2.4. HALFSPACE, HYPERPLANE 73H + =
- Page 75 and 76: 2.4. HALFSPACE, HYPERPLANE 7511−1
- Page 77 and 78: 2.4. HALFSPACE, HYPERPLANE 772.4.2.
- Page 79 and 80: 2.4. HALFSPACE, HYPERPLANE 792.4.2.
- Page 81 and 82: 2.4. HALFSPACE, HYPERPLANE 81tradit
- Page 83 and 84: 2.4. HALFSPACE, HYPERPLANE 832.4.2.
- Page 85 and 86: 2.5. SUBSPACE REPRESENTATIONS 852.5
- Page 87 and 88: 2.5. SUBSPACE REPRESENTATIONS 87(Ex
- Page 89 and 90: 2.5. SUBSPACE REPRESENTATIONS 89(a)
- Page 91 and 92: 2.5. SUBSPACE REPRESENTATIONS 91are
- Page 93 and 94: 2.6. EXTREME, EXPOSED 93A one-dimen
- Page 95 and 96: 2.6. EXTREME, EXPOSED 952.6.1.1 Den
- Page 97 and 98: 2.7. CONES 97X(a)00(b)XFigure 33: (
- Page 99 and 100: 2.7. CONES 99XXFigure 37: Truncated
- Page 101 and 102: 2.7. CONES 101Figure 39: Not a cone
- Page 103 and 104: 2.7. CONES 103cone that is a halfli
- Page 105 and 106: 2.7. CONES 105A pointed closed conv
- Page 107 and 108: 2.8. CONE BOUNDARY 107That means th
- Page 109 and 110: 2.8. CONE BOUNDARY 1092.8.1.1 extre
- Page 111 and 112: 2.8. CONE BOUNDARY 1112.8.2 Exposed
- Page 113: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 117 and 118: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 119 and 120: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 121 and 122: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 123 and 124: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 125 and 126: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 127 and 128: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 129 and 130: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 131 and 132: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 133 and 134: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 135 and 136: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 137 and 138: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 139 and 140: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 141 and 142: 2.10. CONIC INDEPENDENCE (C.I.) 141
- Page 143 and 144: 2.10. CONIC INDEPENDENCE (C.I.) 143
- Page 145 and 146: 2.10. CONIC INDEPENDENCE (C.I.) 145
- Page 147 and 148: 2.12. CONVEX POLYHEDRA 147all dimen
- Page 149 and 150: 2.12. CONVEX POLYHEDRA 149convex po
- Page 151 and 152: 2.12. CONVEX POLYHEDRA 1512.12.2.2
- Page 153 and 154: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 155 and 156: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 157 and 158: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 159 and 160: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 161 and 162: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 163 and 164: 2.13. DUAL CONE & GENERALIZED INEQU
114 CHAPTER 2. CONVEX GEOMETRY2.9.0.0.1 Definition. Positive semidefinite cone.The set of all symmetric positive semidefinite matrices of particulardimension M is called the positive semidefinite cone:S M + { A ∈ S M | A ≽ 0 }= { A ∈ S M | y T Ay ≥0 ∀ ‖y‖ = 1 }= ⋂ {A ∈ S M | 〈yy T , A〉 ≥ 0 }(191)‖y‖=1= {A ∈ S M + | rankA ≤ M }formed by the intersection of an infinite number of halfspaces (2.4.1.1) invectorized variable 2.37 A , each halfspace having partial boundary containingthe origin in isomorphic R M(M+1)/2 . It is a unique immutable proper conein the ambient space of symmetric matrices S M .The positive definite (full-rank) matrices comprise the cone interiorint S M + = { A ∈ S M | A ≻ 0 }= { A ∈ S M | y T Ay>0 ∀ ‖y‖ = 1 }= ⋂ {A ∈ S M | 〈yy T , A〉 > 0 }‖y‖=1= {A ∈ S M + | rankA = M }(192)while all singular positive semidefinite matrices (having at least one0 eigenvalue) reside on the cone boundary (Figure 43); (A.7.5)∂S M + = { A ∈ S M | A ≽ 0, A ⊁ 0 }= { A ∈ S M | min{λ(A) i , i=1... M } = 0 }= { A ∈ S M + | 〈yy T , A〉=0 for some ‖y‖ = 1 }= {A ∈ S M + | rankA < M }(193)where λ(A)∈ R M holds the eigenvalues of A .The only symmetric positive semidefinite matrix in S M +0-eigenvalues resides at the origin. (A.7.3.0.1)△having M2.37 infinite in number when M >1. Because y T A y=y T A T y , matrix A is almost alwaysassumed symmetric. (A.2.1)