v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

108 CHAPTER 2. CONVEX GEOMETRY 2.9.1.0.2 Example. Inverse image of positive semidefinite cone. Now consider finding the set of all matrices X ∈ S N satisfying given A,B∈ S N . Define the set AX + B ≽ 0 (183) X ∆ = {X | AX + B ≽ 0} ⊆ S N (184) which is the inverse image of the positive semidefinite cone under affine transformation g(X) =AX+B ∆ . Set X must therefore be convex by Theorem 2.1.9.0.1. Yet we would like a less amorphous characterization of this set, so instead we consider its vectorization (30) which is easier to visualize: where vec g(X) = vec(AX) + vec B = (I ⊗A) vec X + vec B (185) I ⊗A ∆ = QΛQ T ∈ S N 2 (186) is a block-diagonal matrix formed by Kronecker product (A.1.1 no.25, D.1.2.1). Assign x ∆ = vec X ∈ R N 2 b ∆ = vec B ∈ R N 2 (187) then make the equivalent problem: Find where vec X = {x∈ R N 2 | (I ⊗A)x + b ∈ K} (188) K ∆ = vec S N + (189) is a proper cone isometrically isomorphic with the positive semidefinite cone in the subspace of symmetric matrices; the vectorization of every element of S N + . Utilizing the diagonalization (186), vec X = {x | ΛQ T x ∈ Q T (K − b)} = {x | ΦQ T x ∈ Λ † Q T (K − b)} ⊆ R N 2 (190) where † denotes matrix pseudoinverse (E) and Φ ∆ = Λ † Λ (191)

2.9. POSITIVE SEMIDEFINITE (PSD) CONE 109 is a diagonal projection matrix whose entries are either 1 or 0 (E.3). We have the complementary sum ΦQ T x + (I − Φ)Q T x = Q T x (192) So, adding (I −Φ)Q T x to both sides of the membership within (190) admits vec X = {x∈ R N 2 | Q T x ∈ Λ † Q T (K − b) + (I − Φ)Q T x} = {x | Q T x ∈ Φ ( Λ † Q T (K − b) ) ⊕ (I − Φ)R N 2 } = {x ∈ QΛ † Q T (K − b) ⊕ Q(I − Φ)R N 2 } = (I ⊗A) † (K − b) ⊕ N(I ⊗A) (193) where we used the facts: linear function Q T x in x on R N 2 is a bijection, and ΦΛ † = Λ † . vec X = (I ⊗A) † vec(S N + − B) ⊕ N(I ⊗A) (194) In words, set vec X is the vector sum of the translated PSD cone (linearly mapped onto the rowspace of I ⊗ A (E)) and the nullspace of I ⊗ A (synthesis of fact fromA.6.3 andA.7.3.0.1). Should I ⊗A have no nullspace, then vec X =(I ⊗A) −1 vec(S N + − B) which is the expected result. 2.9.2 Positive semidefinite cone boundary For any symmetric positive semidefinite matrix A of rank ρ , there must exist a rank ρ matrix Y such that A be expressible as an outer product in Y ; [287,6.3] A = Y Y T ∈ S M + , rankA=ρ , Y ∈ R M×ρ (195) Then the boundary of the positive semidefinite cone may be expressed ∂S M + = { A ∈ S M + | rankA

2.9. POSITIVE SEMIDEFINITE (PSD) CONE 109<br />

is a diagonal projection matrix whose entries are either 1 or 0 (E.3). We<br />

have the complementary sum<br />

ΦQ T x + (I − Φ)Q T x = Q T x (192)<br />

So, adding (I −Φ)Q T x to both sides of the membership within (190) admits<br />

vec X = {x∈ R N 2 | Q T x ∈ Λ † Q T (K − b) + (I − Φ)Q T x}<br />

= {x | Q T x ∈ Φ ( Λ † Q T (K − b) ) ⊕ (I − Φ)R N 2 }<br />

= {x ∈ QΛ † Q T (K − b) ⊕ Q(I − Φ)R N 2 }<br />

= (I ⊗A) † (K − b) ⊕ N(I ⊗A)<br />

(193)<br />

where we used the facts: linear function Q T x in x on R N 2 is a bijection,<br />

and ΦΛ † = Λ † .<br />

vec X = (I ⊗A) † vec(S N + − B) ⊕ N(I ⊗A) (194)<br />

In words, set vec X is the vector sum of the translated PSD cone<br />

(linearly mapped onto the rowspace of I ⊗ A (E)) and the nullspace of<br />

I ⊗ A (synthesis of fact fromA.6.3 andA.7.3.0.1). Should I ⊗A have no<br />

nullspace, then vec X =(I ⊗A) −1 vec(S N + − B) which is the expected result.<br />

<br />

2.9.2 Positive semidefinite cone boundary<br />

For any symmetric positive semidefinite matrix A of rank ρ , there must<br />

exist a rank ρ matrix Y such that A be expressible as an outer product<br />

in Y ; [287,6.3]<br />

A = Y Y T ∈ S M + , rankA=ρ , Y ∈ R M×ρ (195)<br />

Then the boundary of the positive semidefinite cone may be expressed<br />

∂S M + = { A ∈ S M + | rankA

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!