v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
510 CHAPTER 7. PROXIMITY PROBLEMS 7.1.3.1 Orthant is best spectral cone for Problem 1 This means unique minimum-distance projection of γ on the nearest spectral member of the rank ρ subset is tantamount to presorting γ into nonincreasing order. Only then does unique spectral projection on a subset K ρ M+ of the monotone nonnegative cone become equivalent to unique spectral projection on a subset R ρ + of the nonnegative orthant (which is simpler); in other words, unique minimum-distance projection of sorted γ on the nonnegative orthant in a ρ-dimensional subspace of R N is indistinguishable from its projection on the subset K ρ M+ of the monotone nonnegative cone in that same subspace. 7.1.4 Closest-EDM Problem 1, “nonconvex” case Trosset’s proof of solution (1221), for projection on a rank ρ subset of the positive semidefinite cone S N−1 + , was algebraic in nature. [306,2] Here we derive that known result but instead using a more geometric argument via spectral projection on a polyhedral cone (subsuming the proof in7.1.1). In so doing, we demonstrate how nonconvex Problem 1 is transformed to a convex optimization: 7.1.4.0.1 Proof. Solution (1221), nonconvex case. As explained in7.1.2, we may instead work with the more facile generic problem (1228). With diagonalization of unknown B ∆ = UΥU T ∈ S N−1 (1239) given desired affine dimension 0 ≤ ρ ≤ N −1 and diagonalizable A ∆ = QΛQ T ∈ S N−1 (1240) having eigenvalues in Λ arranged in nonincreasing order, by (41) the generic problem is equivalent to minimize ‖B − A‖ 2 B∈S N−1 F subject to rankB ≤ ρ B ≽ 0 ≡ minimize ‖Υ − R T ΛR‖ 2 F R , Υ subject to rank Υ ≤ ρ (1241) Υ ≽ 0 R −1 = R T
7.1. FIRST PREVALENT PROBLEM: 511 where R ∆ = Q T U ∈ R N−1×N−1 (1242) in U on the set of orthogonal matrices is a linear bijection. We propose solving (1241) by instead solving the problem sequence: minimize ‖Υ − R T ΛR‖ 2 F Υ subject to rank Υ ≤ ρ Υ ≽ 0 minimize ‖Υ ⋆ − R T ΛR‖ 2 F R subject to R −1 = R T (a) (b) (1243) Problem (1243a) is equivalent to: (1) orthogonal projection of R T ΛR on an N − 1-dimensional subspace of isometrically isomorphic R N(N−1)/2 containing δ(Υ)∈ R N−1 + , (2) nonincreasingly ordering the [ result, (3) unique R ρ ] + minimum-distance projection of the ordered result on . (E.9.5) 0 Projection on that N−1-dimensional subspace amounts to zeroing R T ΛR at all entries off the main diagonal; thus, the equivalent sequence leading with a spectral projection: minimize ‖δ(Υ) − π ( δ(R T ΛR) ) ‖ 2 Υ [ R ρ ] + subject to δ(Υ) ∈ 0 minimize ‖Υ ⋆ − R T ΛR‖ 2 F R subject to R −1 = R T (a) (b) (1244) Because any permutation matrix is an orthogonal matrix, it is always feasible that δ(R T ΛR)∈ R N−1 be arranged in nonincreasing order; hence, the permutation operator π . Unique minimum-distance projection of vector π ( δ(R T ΛR) ) [ R ρ ] + on the ρ-dimensional subset of nonnegative orthant 0
- Page 459 and 460: 6.5. EDM DEFINITION IN 11 T 459 by
- Page 461 and 462: 6.5. EDM DEFINITION IN 11 T 461 6.5
- Page 463 and 464: 6.5. EDM DEFINITION IN 11 T 463 1 0
- Page 465 and 466: 6.5. EDM DEFINITION IN 11 T 465 6.5
- Page 467 and 468: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 469 and 470: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 471 and 472: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 473 and 474: 6.7. VECTORIZATION & PROJECTION INT
- Page 475 and 476: 6.7. VECTORIZATION & PROJECTION INT
- Page 477 and 478: 6.8. DUAL EDM CONE 477 When the Fin
- Page 479 and 480: 6.8. DUAL EDM CONE 479 Proof. First
- Page 481 and 482: 6.8. DUAL EDM CONE 481 EDM 2 = S 2
- Page 483 and 484: 6.8. DUAL EDM CONE 483 whose veraci
- Page 485 and 486: 6.8. DUAL EDM CONE 485 6.8.1.3.1 Ex
- Page 487 and 488: 6.8. DUAL EDM CONE 487 has dual aff
- Page 489 and 490: 6.8. DUAL EDM CONE 489 6.8.1.7 Scho
- Page 491 and 492: 6.9. THEOREM OF THE ALTERNATIVE 491
- Page 493 and 494: 6.10. POSTSCRIPT 493 When D is an E
- Page 495 and 496: Chapter 7 Proximity problems In sum
- Page 497 and 498: 497 project on the subspace, then p
- Page 499 and 500: 499 H S N h 0 EDM N K = S N h ∩ R
- Page 501 and 502: 501 7.0.3 Problem approach Problems
- Page 503 and 504: 7.1. FIRST PREVALENT PROBLEM: 503 f
- Page 505 and 506: 7.1. FIRST PREVALENT PROBLEM: 505 7
- Page 507 and 508: 7.1. FIRST PREVALENT PROBLEM: 507 d
- Page 509: 7.1. FIRST PREVALENT PROBLEM: 509 7
- Page 513 and 514: 7.1. FIRST PREVALENT PROBLEM: 513 T
- Page 515 and 516: 7.2. SECOND PREVALENT PROBLEM: 515
- Page 517 and 518: 7.2. SECOND PREVALENT PROBLEM: 517
- Page 519 and 520: 7.2. SECOND PREVALENT PROBLEM: 519
- Page 521 and 522: 7.2. SECOND PREVALENT PROBLEM: 521
- Page 523 and 524: 7.2. SECOND PREVALENT PROBLEM: 523
- Page 525 and 526: 7.3. THIRD PREVALENT PROBLEM: 525 g
- Page 527 and 528: 7.3. THIRD PREVALENT PROBLEM: 527 w
- Page 529 and 530: 7.3. THIRD PREVALENT PROBLEM: 529 7
- Page 531 and 532: 7.3. THIRD PREVALENT PROBLEM: 531 7
- Page 533 and 534: 7.3. THIRD PREVALENT PROBLEM: 533 O
- Page 535 and 536: 7.4. CONCLUSION 535 The rank constr
- Page 537 and 538: Appendix A Linear algebra A.1 Main-
- Page 539 and 540: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 541 and 542: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 543 and 544: A.2. SEMIDEFINITENESS: DOMAIN OF TE
- Page 545 and 546: A.3. PROPER STATEMENTS 545 (AB) T
- Page 547 and 548: A.3. PROPER STATEMENTS 547 A.3.1 Se
- Page 549 and 550: A.3. PROPER STATEMENTS 549 For A di
- Page 551 and 552: A.3. PROPER STATEMENTS 551 Diagonal
- Page 553 and 554: A.3. PROPER STATEMENTS 553 For A,B
- Page 555 and 556: A.3. PROPER STATEMENTS 555 A.3.1.0.
- Page 557 and 558: A.4. SCHUR COMPLEMENT 557 A.4 Schur
- Page 559 and 560: A.4. SCHUR COMPLEMENT 559 A.4.0.0.2
510 CHAPTER 7. PROXIMITY PROBLEMS<br />
7.1.3.1 Orthant is best spectral cone for Problem 1<br />
This means unique minimum-distance projection of γ on the nearest<br />
spectral member of the rank ρ subset is tantamount to presorting γ into<br />
nonincreasing order. Only then does unique spectral projection on a subset<br />
K ρ M+<br />
of the monotone nonnegative cone become equivalent to unique spectral<br />
projection on a subset R ρ + of the nonnegative orthant (which is simpler);<br />
in other words, unique minimum-distance projection of sorted γ on the<br />
nonnegative orthant in a ρ-dimensional subspace of R N is indistinguishable<br />
from its projection on the subset K ρ M+<br />
of the monotone nonnegative cone in<br />
that same subspace.<br />
7.1.4 Closest-EDM Problem 1, “nonconvex” case<br />
Trosset’s proof of solution (1221), for projection on a rank ρ subset of the<br />
positive semidefinite cone S N−1<br />
+ , was algebraic in nature. [306,2] Here we<br />
derive that known result but instead using a more geometric argument via<br />
spectral projection on a polyhedral cone (subsuming the proof in7.1.1).<br />
In so doing, we demonstrate how nonconvex Problem 1 is transformed to a<br />
convex optimization:<br />
7.1.4.0.1 Proof. Solution (1221), nonconvex case.<br />
As explained in7.1.2, we may instead work with the more facile generic<br />
problem (1228). With diagonalization of unknown<br />
B ∆ = UΥU T ∈ S N−1 (1239)<br />
given desired affine dimension 0 ≤ ρ ≤ N −1 and diagonalizable<br />
A ∆ = QΛQ T ∈ S N−1 (1240)<br />
having eigenvalues in Λ arranged in nonincreasing order, by (41) the generic<br />
problem is equivalent to<br />
minimize ‖B − A‖ 2<br />
B∈S N−1<br />
F<br />
subject to rankB ≤ ρ<br />
B ≽ 0<br />
≡<br />
minimize ‖Υ − R T ΛR‖ 2 F<br />
R , Υ<br />
subject to rank Υ ≤ ρ (1241)<br />
Υ ≽ 0<br />
R −1 = R T