v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
108 CHAPTER 2. CONVEX GEOMETRY 2.9.1.0.2 Example. Inverse image of positive semidefinite cone. Now consider finding the set of all matrices X ∈ S N satisfying given A,B∈ S N . Define the set AX + B ≽ 0 (183) X ∆ = {X | AX + B ≽ 0} ⊆ S N (184) which is the inverse image of the positive semidefinite cone under affine transformation g(X) =AX+B ∆ . Set X must therefore be convex by Theorem 2.1.9.0.1. Yet we would like a less amorphous characterization of this set, so instead we consider its vectorization (30) which is easier to visualize: where vec g(X) = vec(AX) + vec B = (I ⊗A) vec X + vec B (185) I ⊗A ∆ = QΛQ T ∈ S N 2 (186) is a block-diagonal matrix formed by Kronecker product (A.1.1 no.25, D.1.2.1). Assign x ∆ = vec X ∈ R N 2 b ∆ = vec B ∈ R N 2 (187) then make the equivalent problem: Find where vec X = {x∈ R N 2 | (I ⊗A)x + b ∈ K} (188) K ∆ = vec S N + (189) is a proper cone isometrically isomorphic with the positive semidefinite cone in the subspace of symmetric matrices; the vectorization of every element of S N + . Utilizing the diagonalization (186), vec X = {x | ΛQ T x ∈ Q T (K − b)} = {x | ΦQ T x ∈ Λ † Q T (K − b)} ⊆ R N 2 (190) where † denotes matrix pseudoinverse (E) and Φ ∆ = Λ † Λ (191)
2.9. POSITIVE SEMIDEFINITE (PSD) CONE 109 is a diagonal projection matrix whose entries are either 1 or 0 (E.3). We have the complementary sum ΦQ T x + (I − Φ)Q T x = Q T x (192) So, adding (I −Φ)Q T x to both sides of the membership within (190) admits vec X = {x∈ R N 2 | Q T x ∈ Λ † Q T (K − b) + (I − Φ)Q T x} = {x | Q T x ∈ Φ ( Λ † Q T (K − b) ) ⊕ (I − Φ)R N 2 } = {x ∈ QΛ † Q T (K − b) ⊕ Q(I − Φ)R N 2 } = (I ⊗A) † (K − b) ⊕ N(I ⊗A) (193) where we used the facts: linear function Q T x in x on R N 2 is a bijection, and ΦΛ † = Λ † . vec X = (I ⊗A) † vec(S N + − B) ⊕ N(I ⊗A) (194) In words, set vec X is the vector sum of the translated PSD cone (linearly mapped onto the rowspace of I ⊗ A (E)) and the nullspace of I ⊗ A (synthesis of fact fromA.6.3 andA.7.3.0.1). Should I ⊗A have no nullspace, then vec X =(I ⊗A) −1 vec(S N + − B) which is the expected result. 2.9.2 Positive semidefinite cone boundary For any symmetric positive semidefinite matrix A of rank ρ , there must exist a rank ρ matrix Y such that A be expressible as an outer product in Y ; [287,6.3] A = Y Y T ∈ S M + , rankA=ρ , Y ∈ R M×ρ (195) Then the boundary of the positive semidefinite cone may be expressed ∂S M + = { A ∈ S M + | rankA
- Page 57 and 58: 2.3. HULLS 57 The affine hull of tw
- Page 59 and 60: 2.3. HULLS 59 2.3.2 Convex hull The
- Page 61 and 62: 2.3. HULLS 61 In case k = N , the F
- Page 63 and 64: 2.3. HULLS 63 2.3.2.0.3 Exercise. C
- Page 65 and 66: 2.3. HULLS 65 Figure 20: A simplici
- Page 67 and 68: 2.4. HALFSPACE, HYPERPLANE 67 H + a
- Page 69 and 70: 2.4. HALFSPACE, HYPERPLANE 69 1 1
- Page 71 and 72: 2.4. HALFSPACE, HYPERPLANE 71 Recal
- Page 73 and 74: 2.4. HALFSPACE, HYPERPLANE 73 C H
- Page 75 and 76: 2.4. HALFSPACE, HYPERPLANE 75 2.4.2
- Page 77 and 78: 2.4. HALFSPACE, HYPERPLANE 77 (conf
- Page 79 and 80: 2.5. SUBSPACE REPRESENTATIONS 79 Ra
- Page 81 and 82: 2.5. SUBSPACE REPRESENTATIONS 81 If
- Page 83 and 84: 2.6. EXTREME, EXPOSED 83 2.6 Extrem
- Page 85 and 86: 2.6. EXTREME, EXPOSED 85 A B C D Fi
- Page 87 and 88: 2.7. CONES 87 2.6.1.3.1 Definition.
- Page 89 and 90: 2.7. CONES 89 0 Figure 30: Boundary
- Page 91 and 92: 2.7. CONES 91 2.7.2 Convex cone We
- Page 93 and 94: 2.7. CONES 93 Then a pointed closed
- Page 95 and 96: 2.7. CONES 95 A pointed closed conv
- Page 97 and 98: 2.8. CONE BOUNDARY 97 So the ray th
- Page 99 and 100: 2.8. CONE BOUNDARY 99 2.8.1.1 extre
- Page 101 and 102: 2.8. CONE BOUNDARY 101 2.8.2 Expose
- Page 103 and 104: 2.8. CONE BOUNDARY 103 From Theorem
- Page 105 and 106: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 107: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 111 and 112: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 113 and 114: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 115 and 116: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 117 and 118: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 119 and 120: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 121 and 122: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 123 and 124: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 125 and 126: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 127 and 128: 2.10. CONIC INDEPENDENCE (C.I.) 127
- Page 129 and 130: 2.10. CONIC INDEPENDENCE (C.I.) 129
- Page 131 and 132: 2.10. CONIC INDEPENDENCE (C.I.) 131
- Page 133 and 134: 2.12. CONVEX POLYHEDRA 133 It follo
- Page 135 and 136: 2.12. CONVEX POLYHEDRA 135 Coeffici
- Page 137 and 138: 2.12. CONVEX POLYHEDRA 137 2.12.3 U
- Page 139 and 140: 2.12. CONVEX POLYHEDRA 139
- Page 141 and 142: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 143 and 144: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 145 and 146: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 147 and 148: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 149 and 150: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 151 and 152: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 153 and 154: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 155 and 156: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 157 and 158: 2.13. DUAL CONE & GENERALIZED INEQU
2.9. POSITIVE SEMIDEFINITE (PSD) CONE 109<br />
is a diagonal projection matrix whose entries are either 1 or 0 (E.3). We<br />
have the complementary sum<br />
ΦQ T x + (I − Φ)Q T x = Q T x (192)<br />
So, adding (I −Φ)Q T x to both sides of the membership within (190) admits<br />
vec X = {x∈ R N 2 | Q T x ∈ Λ † Q T (K − b) + (I − Φ)Q T x}<br />
= {x | Q T x ∈ Φ ( Λ † Q T (K − b) ) ⊕ (I − Φ)R N 2 }<br />
= {x ∈ QΛ † Q T (K − b) ⊕ Q(I − Φ)R N 2 }<br />
= (I ⊗A) † (K − b) ⊕ N(I ⊗A)<br />
(193)<br />
where we used the facts: linear function Q T x in x on R N 2 is a bijection,<br />
and ΦΛ † = Λ † .<br />
vec X = (I ⊗A) † vec(S N + − B) ⊕ N(I ⊗A) (194)<br />
In words, set vec X is the vector sum of the translated PSD cone<br />
(linearly mapped onto the rowspace of I ⊗ A (E)) and the nullspace of<br />
I ⊗ A (synthesis of fact fromA.6.3 andA.7.3.0.1). Should I ⊗A have no<br />
nullspace, then vec X =(I ⊗A) −1 vec(S N + − B) which is the expected result.<br />
<br />
2.9.2 Positive semidefinite cone boundary<br />
For any symmetric positive semidefinite matrix A of rank ρ , there must<br />
exist a rank ρ matrix Y such that A be expressible as an outer product<br />
in Y ; [287,6.3]<br />
A = Y Y T ∈ S M + , rankA=ρ , Y ∈ R M×ρ (195)<br />
Then the boundary of the positive semidefinite cone may be expressed<br />
∂S M + = { A ∈ S M + | rankA