v2007.09.13 - Convex Optimization
v2007.09.13 - Convex Optimization v2007.09.13 - Convex Optimization
452 CHAPTER 7. PROXIMITY PROBLEMS7.1.3.1 Orthant is best spectral cone for Problem 1This means unique minimum-distance projection of γ on the nearestspectral member of the rank ρ subset is tantamount to presorting γ intononincreasing order. Only then does unique spectral projection on a subsetK ρ M+of the monotone nonnegative cone become equivalent to unique spectralprojection on a subset R ρ + of the nonnegative orthant (which is simpler);in other words, unique minimum-distance projection of sorted γ on thenonnegative orthant in a ρ-dimensional subspace of R N is indistinguishablefrom its projection on the subset K ρ M+of the monotone nonnegative cone inthat same subspace.7.1.4 Closest-EDM Problem 1, “nonconvex” caseTrosset’s proof of solution (1118), for projection on a rank ρ subset of thepositive semidefinite cone S N−1+ , was algebraic in nature. [262,2] Here wederive that known result but instead using a more geometric argument viaspectral projection on a polyhedral cone (subsuming the proof in7.1.1).In so doing, we demonstrate how nonconvex Problem 1 is transformed to aconvex optimization:7.1.4.0.1 Proof. Solution (1118), nonconvex case.As explained in7.1.2, we may instead work with the more facile genericproblem (1125). With diagonalization of unknownB ∆ = UΥU T ∈ S N−1 (1136)given desired affine dimension 0 ≤ ρ ≤ N −1 and diagonalizableA ∆ = QΛQ T ∈ S N−1 (1137)having eigenvalues in Λ arranged in nonincreasing order, by (40) the genericproblem is equivalent tominimize ‖B − A‖ 2B∈S N−1Fsubject to rankB ≤ ρB ≽ 0≡minimize ‖Υ − R T ΛR‖ 2 FR , Υsubject to rank Υ ≤ ρ (1138)Υ ≽ 0R −1 = R T
7.1. FIRST PREVALENT PROBLEM: 453whereR ∆ = Q T U ∈ R N−1×N−1 (1139)in U on the set of orthogonal matrices is a linear bijection. We proposesolving (1138) by instead solving the problem sequence:minimize ‖Υ − R T ΛR‖ 2 FΥsubject to rank Υ ≤ ρΥ ≽ 0minimize ‖Υ ⋆ − R T ΛR‖ 2 FRsubject to R −1 = R T(a)(b)(1140)Problem (1140a) is equivalent to: (1) orthogonal projection of R T ΛRon an N − 1-dimensional subspace of isometrically isomorphic R N(N−1)/2containing δ(Υ)∈ R N−1+ , (2) nonincreasingly ordering the[result, (3) uniqueRρ]+minimum-distance projection of the ordered result on . (E.9.5)0Projection on that N−1-dimensional subspace amounts to zeroing R T ΛR atall entries off the main diagonal; thus, the equivalent sequence leading witha spectral projection:minimize ‖δ(Υ) − π ( δ(R T ΛR) ) ‖ 2Υ [ Rρ]+subject to δ(Υ) ∈0minimize ‖Υ ⋆ − R T ΛR‖ 2 FRsubject to R −1 = R T(a)(b)(1141)Because any permutation matrix is an orthogonal matrix, it is alwaysfeasible that δ(R T ΛR)∈ R N−1 be arranged in nonincreasing order; hence, thepermutation operator π . Unique minimum-distance projection of vectorπ ( δ(R T ΛR) ) [ Rρ]+on the ρ-dimensional subset of nonnegative orthant0
- Page 401 and 402: 6.5. EDM DEFINITION IN 11 T 401and
- Page 403 and 404: 6.5. EDM DEFINITION IN 11 T 403then
- Page 405 and 406: 6.5. EDM DEFINITION IN 11 T 4056.5.
- Page 407 and 408: 6.5. EDM DEFINITION IN 11 T 407D =
- Page 409 and 410: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 411 and 412: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 413 and 414: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 415 and 416: 6.7. VECTORIZATION & PROJECTION INT
- Page 417 and 418: 6.7. VECTORIZATION & PROJECTION INT
- Page 419 and 420: 6.8. DUAL EDM CONE 419When the Fins
- Page 421 and 422: 6.8. DUAL EDM CONE 421Proof. First,
- Page 423 and 424: 6.8. DUAL EDM CONE 423EDM 2 = S 2 h
- Page 425 and 426: 6.8. DUAL EDM CONE 425whose veracit
- Page 427 and 428: 6.8. DUAL EDM CONE 4276.8.1.3.1 Exe
- Page 429 and 430: 6.8. DUAL EDM CONE 429has dual affi
- Page 431 and 432: 6.8. DUAL EDM CONE 4316.8.1.7 Schoe
- Page 433 and 434: 6.9. THEOREM OF THE ALTERNATIVE 433
- Page 435 and 436: 6.10. POSTSCRIPT 435When D is an ED
- Page 437 and 438: Chapter 7Proximity problemsIn summa
- Page 439 and 440: In contrast, order of projection on
- Page 441 and 442: 441HS N h0EDM NK = S N h ∩ R N×N
- Page 443 and 444: 4437.0.3 Problem approachProblems t
- Page 445 and 446: 7.1. FIRST PREVALENT PROBLEM: 445fi
- Page 447 and 448: 7.1. FIRST PREVALENT PROBLEM: 4477.
- Page 449 and 450: 7.1. FIRST PREVALENT PROBLEM: 449di
- Page 451: 7.1. FIRST PREVALENT PROBLEM: 4517.
- Page 455 and 456: 7.1. FIRST PREVALENT PROBLEM: 455Th
- Page 457 and 458: 7.2. SECOND PREVALENT PROBLEM: 457O
- Page 459 and 460: 7.2. SECOND PREVALENT PROBLEM: 459S
- Page 461 and 462: 7.2. SECOND PREVALENT PROBLEM: 461r
- Page 463 and 464: 7.2. SECOND PREVALENT PROBLEM: 463c
- Page 465 and 466: 7.2. SECOND PREVALENT PROBLEM: 4657
- Page 467 and 468: 7.3. THIRD PREVALENT PROBLEM: 467fo
- Page 469 and 470: 7.3. THIRD PREVALENT PROBLEM: 469a
- Page 471 and 472: 7.3. THIRD PREVALENT PROBLEM: 4717.
- Page 473 and 474: 7.3. THIRD PREVALENT PROBLEM: 4737.
- Page 475 and 476: 7.3. THIRD PREVALENT PROBLEM: 475Ou
- Page 478 and 479: 478 CHAPTER 7. PROXIMITY PROBLEMSth
- Page 480 and 481: 480 APPENDIX A. LINEAR ALGEBRAA.1.1
- Page 482 and 483: 482 APPENDIX A. LINEAR ALGEBRAA.1.2
- Page 484 and 485: 484 APPENDIX A. LINEAR ALGEBRAonly
- Page 486 and 487: 486 APPENDIX A. LINEAR ALGEBRA(AB)
- Page 488 and 489: 488 APPENDIX A. LINEAR ALGEBRAA.3.1
- Page 490 and 491: 490 APPENDIX A. LINEAR ALGEBRAFor A
- Page 492 and 493: 492 APPENDIX A. LINEAR ALGEBRADiago
- Page 494 and 495: 494 APPENDIX A. LINEAR ALGEBRAFor A
- Page 496 and 497: 496 APPENDIX A. LINEAR ALGEBRAA.3.1
- Page 498 and 499: 498 APPENDIX A. LINEAR ALGEBRAA.4 S
- Page 500 and 501: 500 APPENDIX A. LINEAR ALGEBRAA.4.0
452 CHAPTER 7. PROXIMITY PROBLEMS7.1.3.1 Orthant is best spectral cone for Problem 1This means unique minimum-distance projection of γ on the nearestspectral member of the rank ρ subset is tantamount to presorting γ intononincreasing order. Only then does unique spectral projection on a subsetK ρ M+of the monotone nonnegative cone become equivalent to unique spectralprojection on a subset R ρ + of the nonnegative orthant (which is simpler);in other words, unique minimum-distance projection of sorted γ on thenonnegative orthant in a ρ-dimensional subspace of R N is indistinguishablefrom its projection on the subset K ρ M+of the monotone nonnegative cone inthat same subspace.7.1.4 Closest-EDM Problem 1, “nonconvex” caseTrosset’s proof of solution (1118), for projection on a rank ρ subset of thepositive semidefinite cone S N−1+ , was algebraic in nature. [262,2] Here wederive that known result but instead using a more geometric argument viaspectral projection on a polyhedral cone (subsuming the proof in7.1.1).In so doing, we demonstrate how nonconvex Problem 1 is transformed to aconvex optimization:7.1.4.0.1 Proof. Solution (1118), nonconvex case.As explained in7.1.2, we may instead work with the more facile genericproblem (1125). With diagonalization of unknownB ∆ = UΥU T ∈ S N−1 (1136)given desired affine dimension 0 ≤ ρ ≤ N −1 and diagonalizableA ∆ = QΛQ T ∈ S N−1 (1137)having eigenvalues in Λ arranged in nonincreasing order, by (40) the genericproblem is equivalent tominimize ‖B − A‖ 2B∈S N−1Fsubject to rankB ≤ ρB ≽ 0≡minimize ‖Υ − R T ΛR‖ 2 FR , Υsubject to rank Υ ≤ ρ (1138)Υ ≽ 0R −1 = R T