v2007.09.13 - Convex Optimization
v2007.09.13 - Convex Optimization v2007.09.13 - Convex Optimization
450 CHAPTER 7. PROXIMITY PROBLEMSof an ordered vector of eigenvalues (in diagonal matrix Λ) on a subset of themonotone nonnegative cone (2.13.9.4.1)K M+ = {υ | υ 1 ≥ υ 2 ≥ · · · ≥ υ N−1 ≥ 0} ⊆ R N−1+ (370)Of interest, momentarily, is only the smallest convex subset of themonotone nonnegative cone K M+ containing every nonincreasingly orderedeigenspectrum corresponding to a rank ρ subset of the positive semidefinitecone S N−1+ ; id est,K ρ M+∆= {υ ∈ R ρ | υ 1 ≥ υ 2 ≥ · · · ≥ υ ρ ≥ 0} ⊆ R ρ + (1128)a pointed polyhedral cone, a ρ-dimensional convex subset of themonotone nonnegative cone K M+ ⊆ R N−1+ having property, for λ denotingeigenspectra,[ρ] KM+= π(λ(rank ρ subset)) ⊆ K N−1 ∆0M+= K M+ (1129)For each and every elemental eigenspectrumγ ∈ λ(rank ρ subset)⊆ R N−1+ (1130)of the rank ρ subset (ordered or unordered in λ), there is a nonlinearsurjection π(γ) onto K ρ M+ .7.1.3.0.2 Exercise. Smallest spectral cone.Prove that there is no convex subset of K M+ smaller than K ρ M+ containingevery ordered eigenspectrum corresponding to the rank ρ subset of a positivesemidefinite cone (2.9.2.1).7.1.3.0.3 Proposition. (Hardy-Littlewood-Pólya) [128,X][41,1.2] Any vectors σ and γ in R N−1 satisfy a tight inequalityπ(σ) T π(γ) ≥ σ T γ ≥ π(σ) T Ξπ(γ) (1131)where Ξ is the order-reversing permutation matrix defined in (1502),and permutator π(γ) is a nonlinear function that sorts vector γ intononincreasing order thereby providing the greatest upper bound and leastlower bound with respect to every possible sorting.⋄
7.1. FIRST PREVALENT PROBLEM: 4517.1.3.0.4 Corollary. Monotone nonnegative sort.Any given vectors σ,γ∈R N−1 satisfy a tight Euclidean distance inequality‖π(σ) − π(γ)‖ ≤ ‖σ − γ‖ (1132)where nonlinear function π(γ) sorts vector γ into nonincreasing orderthereby providing the least lower bound with respect to every possiblesorting.⋄Given γ ∈ R N−1infσ∈R N−1+‖σ−γ‖ = infσ∈R N−1+‖π(σ)−π(γ)‖ = infσ∈R N−1+‖σ−π(γ)‖ = inf ‖σ−π(γ)‖σ∈K M+Yet for γ representing an arbitrary vector of eigenvalues, because(1133)inf − γ‖0‖σ 2 ≥ inf − π(γ)‖σ∈R ρ +0‖σ 2 =σ∈R ρ +infσ∈K ρ M+0‖σ − π(γ)‖ 2 (1134)then projection of γ on the eigenspectra of a rank ρ subset can be tightenedsimply by presorting γ into nonincreasing order.Proof. Simply because π(γ) 1:ρ ≽ π(γ 1:ρ )inf − γ‖0‖σ 2 = γρ+1:N−1 T γ ρ+1:N−1 + inf ‖σ 1:ρ − γ 1:ρ ‖ 2σ∈R N−1+= γ T γ + inf σ1:ρσ T 1:ρ − 2σ1:ργ T 1:ρσ∈R ρ +inf − γ‖0‖σ 2 ≥ infσ∈R ρ +σ∈R N−1+σ1:ρσ T 1:ρ − 2σ T (1135)1:ρπ(γ) 1:ρσ∈R N−1+− π(γ)‖σ∈R ρ +0‖σ 2≥ γ T γ + inf
- Page 399 and 400: 6.4. A GEOMETRY OF COMPLETION 399Fi
- Page 401 and 402: 6.5. EDM DEFINITION IN 11 T 401and
- Page 403 and 404: 6.5. EDM DEFINITION IN 11 T 403then
- Page 405 and 406: 6.5. EDM DEFINITION IN 11 T 4056.5.
- Page 407 and 408: 6.5. EDM DEFINITION IN 11 T 407D =
- Page 409 and 410: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 411 and 412: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 413 and 414: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 415 and 416: 6.7. VECTORIZATION & PROJECTION INT
- Page 417 and 418: 6.7. VECTORIZATION & PROJECTION INT
- Page 419 and 420: 6.8. DUAL EDM CONE 419When the Fins
- Page 421 and 422: 6.8. DUAL EDM CONE 421Proof. First,
- Page 423 and 424: 6.8. DUAL EDM CONE 423EDM 2 = S 2 h
- Page 425 and 426: 6.8. DUAL EDM CONE 425whose veracit
- Page 427 and 428: 6.8. DUAL EDM CONE 4276.8.1.3.1 Exe
- Page 429 and 430: 6.8. DUAL EDM CONE 429has dual affi
- Page 431 and 432: 6.8. DUAL EDM CONE 4316.8.1.7 Schoe
- Page 433 and 434: 6.9. THEOREM OF THE ALTERNATIVE 433
- Page 435 and 436: 6.10. POSTSCRIPT 435When D is an ED
- Page 437 and 438: Chapter 7Proximity problemsIn summa
- Page 439 and 440: In contrast, order of projection on
- Page 441 and 442: 441HS N h0EDM NK = S N h ∩ R N×N
- Page 443 and 444: 4437.0.3 Problem approachProblems t
- Page 445 and 446: 7.1. FIRST PREVALENT PROBLEM: 445fi
- Page 447 and 448: 7.1. FIRST PREVALENT PROBLEM: 4477.
- Page 449: 7.1. FIRST PREVALENT PROBLEM: 449di
- Page 453 and 454: 7.1. FIRST PREVALENT PROBLEM: 453wh
- Page 455 and 456: 7.1. FIRST PREVALENT PROBLEM: 455Th
- Page 457 and 458: 7.2. SECOND PREVALENT PROBLEM: 457O
- Page 459 and 460: 7.2. SECOND PREVALENT PROBLEM: 459S
- Page 461 and 462: 7.2. SECOND PREVALENT PROBLEM: 461r
- Page 463 and 464: 7.2. SECOND PREVALENT PROBLEM: 463c
- Page 465 and 466: 7.2. SECOND PREVALENT PROBLEM: 4657
- Page 467 and 468: 7.3. THIRD PREVALENT PROBLEM: 467fo
- Page 469 and 470: 7.3. THIRD PREVALENT PROBLEM: 469a
- Page 471 and 472: 7.3. THIRD PREVALENT PROBLEM: 4717.
- Page 473 and 474: 7.3. THIRD PREVALENT PROBLEM: 4737.
- Page 475 and 476: 7.3. THIRD PREVALENT PROBLEM: 475Ou
- Page 478 and 479: 478 CHAPTER 7. PROXIMITY PROBLEMSth
- Page 480 and 481: 480 APPENDIX A. LINEAR ALGEBRAA.1.1
- Page 482 and 483: 482 APPENDIX A. LINEAR ALGEBRAA.1.2
- Page 484 and 485: 484 APPENDIX A. LINEAR ALGEBRAonly
- Page 486 and 487: 486 APPENDIX A. LINEAR ALGEBRA(AB)
- Page 488 and 489: 488 APPENDIX A. LINEAR ALGEBRAA.3.1
- Page 490 and 491: 490 APPENDIX A. LINEAR ALGEBRAFor A
- Page 492 and 493: 492 APPENDIX A. LINEAR ALGEBRADiago
- Page 494 and 495: 494 APPENDIX A. LINEAR ALGEBRAFor A
- Page 496 and 497: 496 APPENDIX A. LINEAR ALGEBRAA.3.1
- Page 498 and 499: 498 APPENDIX A. LINEAR ALGEBRAA.4 S
450 CHAPTER 7. PROXIMITY PROBLEMSof an ordered vector of eigenvalues (in diagonal matrix Λ) on a subset of themonotone nonnegative cone (2.13.9.4.1)K M+ = {υ | υ 1 ≥ υ 2 ≥ · · · ≥ υ N−1 ≥ 0} ⊆ R N−1+ (370)Of interest, momentarily, is only the smallest convex subset of themonotone nonnegative cone K M+ containing every nonincreasingly orderedeigenspectrum corresponding to a rank ρ subset of the positive semidefinitecone S N−1+ ; id est,K ρ M+∆= {υ ∈ R ρ | υ 1 ≥ υ 2 ≥ · · · ≥ υ ρ ≥ 0} ⊆ R ρ + (1128)a pointed polyhedral cone, a ρ-dimensional convex subset of themonotone nonnegative cone K M+ ⊆ R N−1+ having property, for λ denotingeigenspectra,[ρ] KM+= π(λ(rank ρ subset)) ⊆ K N−1 ∆0M+= K M+ (1129)For each and every elemental eigenspectrumγ ∈ λ(rank ρ subset)⊆ R N−1+ (1130)of the rank ρ subset (ordered or unordered in λ), there is a nonlinearsurjection π(γ) onto K ρ M+ .7.1.3.0.2 Exercise. Smallest spectral cone.Prove that there is no convex subset of K M+ smaller than K ρ M+ containingevery ordered eigenspectrum corresponding to the rank ρ subset of a positivesemidefinite cone (2.9.2.1).7.1.3.0.3 Proposition. (Hardy-Littlewood-Pólya) [128,X][41,1.2] Any vectors σ and γ in R N−1 satisfy a tight inequalityπ(σ) T π(γ) ≥ σ T γ ≥ π(σ) T Ξπ(γ) (1131)where Ξ is the order-reversing permutation matrix defined in (1502),and permutator π(γ) is a nonlinear function that sorts vector γ intononincreasing order thereby providing the greatest upper bound and leastlower bound with respect to every possible sorting.⋄