v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

122 CHAPTER 2. CONVEX GEOMETRY 2.9.2.6.3 Theorem. Convex subsets of positive semidefinite cone. The subsets of the positive semidefinite cone S M + , for 0≤ρ≤M S M +(ρ) ∆ = {X ∈ S M + | rankX ≥ ρ} (232) are pointed convex cones, but not closed unless ρ = 0 ; id est, S M +(0)= S M + . ⋄ Proof. Given ρ , a subset S M +(ρ) is convex if and only if convex combination of any two members has rank at least ρ . That is confirmed applying identity (229) from Lemma 2.9.2.6.1 to (1370); id est, for A,B ∈ S M +(ρ) on the closed interval µ∈[0, 1] rank(µA + (1 −µ)B) ≥ min{rankA, rankB} (233) It can similarly be shown, almost identically to proof of the lemma, any conic combination of A,B in subset S M +(ρ) remains a member; id est, ∀ζ, ξ ≥0 rank(ζA + ξB) ≥ min{rank(ζA), rank(ξB)} (234) Therefore, S M +(ρ) is a convex cone. Another proof of convexity can be made by projection arguments: 2.9.2.7 Projection on S M +(ρ) Because these cones S M +(ρ) indexed by ρ (232) are convex, projection on them is straightforward. Given a symmetric matrix H having diagonalization H = ∆ QΛQ T ∈ S M (A.5.2) with eigenvalues Λ arranged in nonincreasing order, then its Euclidean projection (minimum-distance projection) on S M +(ρ) P S M + (ρ)H = QΥ ⋆ Q T (235) corresponds to a map of its eigenvalues: Υ ⋆ ii = { max {ǫ , Λii } , i=1... ρ max {0, Λ ii } , i=ρ+1... M (236) where ǫ is positive but arbitrarily close to 0.

2.9. POSITIVE SEMIDEFINITE (PSD) CONE 123 2.9.2.7.1 Exercise. Projection on open convex cones. Prove (236) using Theorem E.9.2.0.1. Because each H ∈ S M has unique projection on S M +(ρ) (despite possibility of repeated eigenvalues in Λ), we may conclude it is a convex set by the Bunt-Motzkin theorem (E.9.0.0.1). Compare (236) to the well-known result regarding Euclidean projection on a rank ρ subset of the positive semidefinite cone (2.9.2.1) S M + \ S M +(ρ + 1) = {X ∈ S M + | rankX ≤ ρ} (237) P S M + \S M + (ρ+1) H = QΥ ⋆ Q T (238) As proved in7.1.4, this projection of H corresponds to the eigenvalue map Υ ⋆ ii = { max {0 , Λii } , i=1... ρ 0 , i=ρ+1... M (1246) Together these two results (236) and (1246) mean: A higher-rank solution to projection on the positive semidefinite cone lies arbitrarily close to any given lower-rank projection, but not vice versa. Were the number of nonnegative eigenvalues in Λ known a priori not to exceed ρ , then these two different projections would produce identical results in the limit ǫ→0. 2.9.2.8 Uniting constituents Interior of the PSD cone int S M + is convex by Theorem 2.9.2.6.3, for example, because all positive semidefinite matrices having rank M constitute the cone interior. All positive semidefinite matrices of rank less than M constitute the cone boundary; an amalgam of positive semidefinite matrices of different rank. Thus each nonconvex subset of positive semidefinite matrices, for 0

122 CHAPTER 2. CONVEX GEOMETRY<br />

2.9.2.6.3 Theorem. <strong>Convex</strong> subsets of positive semidefinite cone.<br />

The subsets of the positive semidefinite cone S M + , for 0≤ρ≤M<br />

S M +(ρ) ∆ = {X ∈ S M + | rankX ≥ ρ} (232)<br />

are pointed convex cones, but not closed unless ρ = 0 ; id est, S M +(0)= S M + .<br />

⋄<br />

Proof. Given ρ , a subset S M +(ρ) is convex if and only if<br />

convex combination of any two members has rank at least ρ . That is<br />

confirmed applying identity (229) from Lemma 2.9.2.6.1 to (1370); id est,<br />

for A,B ∈ S M +(ρ) on the closed interval µ∈[0, 1]<br />

rank(µA + (1 −µ)B) ≥ min{rankA, rankB} (233)<br />

It can similarly be shown, almost identically to proof of the lemma, any conic<br />

combination of A,B in subset S M +(ρ) remains a member; id est, ∀ζ, ξ ≥0<br />

rank(ζA + ξB) ≥ min{rank(ζA), rank(ξB)} (234)<br />

Therefore, S M +(ρ) is a convex cone.<br />

<br />

Another proof of convexity can be made by projection arguments:<br />

2.9.2.7 Projection on S M +(ρ)<br />

Because these cones S M +(ρ) indexed by ρ (232) are convex, projection on<br />

them is straightforward. Given a symmetric matrix H having diagonalization<br />

H = ∆ QΛQ T ∈ S M (A.5.2) with eigenvalues Λ arranged in nonincreasing<br />

order, then its Euclidean projection (minimum-distance projection) on S M +(ρ)<br />

P S M<br />

+ (ρ)H = QΥ ⋆ Q T (235)<br />

corresponds to a map of its eigenvalues:<br />

Υ ⋆ ii =<br />

{ max {ǫ , Λii } , i=1... ρ<br />

max {0, Λ ii } , i=ρ+1... M<br />

(236)<br />

where ǫ is positive but arbitrarily close to 0.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!