v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
552 CHAPTER 7. PROXIMITY PROBLEMSThis is best understood referring to Figure 152: Suppose nonnegativeinput H is demanded, and then the problem realization correctly projectsits input first on S N h and then directly on C = EDM N . That demandfor nonnegativity effectively requires imposition of K on input H prior tooptimization so as to obtain correct order of projection (on S N h first). Yetsuch an imposition prior to projection on EDM N generally introduces anelbow into the path of projection (illustrated in Figure 153) caused bythe technique itself; that being, a particular proximity problem realizationrequiring nonnegative input.Any procedure for imposition of nonnegativity on input H can only beincorrect in this circumstance. There is no resolution unless input H isguaranteed nonnegative with no tinkering. Otherwise, we have no choice butto employ a different problem realization; one not demanding nonnegativeinput.7.0.2 Lower boundMost of the problems we encounter in this chapter have the general form:minimize ‖B − A‖ FBsubject to B ∈ C(1306)where A ∈ R m×n is given data. This particular objective denotes Euclideanprojection (E) of vectorized matrix A on the set C which may or may not beconvex. When C is convex, then the projection is unique minimum-distancebecause Frobenius’ norm when squared is a strictly convex function ofvariable B and because the optimal solution is the same regardless of thesquare (513). When C is a subspace, then the direction of projection isorthogonal to C .Denoting by AU A Σ A QA T and BU BΣ B QB T their full singular valuedecompositions (whose singular values are always nonincreasingly ordered(A.6)), there exists a tight lower bound on the objective over the manifoldof orthogonal matrices;‖Σ B − Σ A ‖ F ≤infU A ,U B ,Q A ,Q B‖B − A‖ F (1307)This least lower bound holds more generally for any orthogonally invariantnorm on R m×n (2.2.1) including the Frobenius and spectral norm [328,II.3].[202,7.4.51]
5537.0.3 Problem approachProblems traditionally posed in terms of point position {x i ∈ R n , i=1... N }such as∑minimize (‖x i − x j ‖ − h ij ) 2 (1308){x i }orminimize{x i }i , j ∈ I∑(‖x i − x j ‖ 2 − h ij ) 2 (1309)i , j ∈ I(where I is an abstract set of indices and h ij is given data) are everywhereconverted herein to the distance-square variable D or to Gram matrix G ;the Gram matrix acting as bridge between position and distance. (Thatconversion is performed regardless of whether known data is complete.)Then the techniques of chapter 5 or chapter 6 are applied to find relativeor absolute position. This approach is taken because we prefer introductionof rank constraints into convex problems rather than searching a googol oflocal minima in nonconvex problems like (1308) [105] (3.6.4.0.3,7.2.2.7.1)or (1309).7.0.4 Three prevalent proximity problemsThere are three statements of the closest-EDM problem prevalent in theliterature, the multiplicity due primarily to choice of projection on theEDM versus positive semidefinite (PSD) cone and vacillation between thedistance-square variable d ij versus absolute distance √ d ij . In their mostfundamental form, the three prevalent proximity problems are (1310.1),(1310.2), and (1310.3): [342] for D [d ij ] and ◦√ D [ √ d ij ](1)(3)minimize ‖−V (D − H)V ‖ 2 FDsubject to rankV DV ≤ ρD ∈ EDM Nminimize ‖D − H‖ 2 FDsubject to rankV DV ≤ ρD ∈ EDM Nminimize ‖ ◦√ D − H‖◦√ 2 FDsubject to rankV DV ≤ ρ◦√ √D ∈ EDMNminimize ‖−V ( ◦√ D − H)V ‖◦√ 2 FDsubject to rankV DV ≤ ρ◦√ √D ∈ EDMN(2)(1310)(4)
- Page 501 and 502: 6.2. POLYHEDRAL BOUNDS 501This cone
- Page 503 and 504: 6.4. EDM DEFINITION IN 11 T 503That
- Page 505 and 506: 6.4. EDM DEFINITION IN 11 T 505N(1
- Page 507 and 508: 6.4. EDM DEFINITION IN 11 T 507Then
- Page 509 and 510: 6.4. EDM DEFINITION IN 11 T 5096.4.
- Page 511 and 512: 6.5. CORRESPONDENCE TO PSD CONE S N
- Page 513 and 514: 6.5. CORRESPONDENCE TO PSD CONE S N
- Page 515 and 516: 6.5. CORRESPONDENCE TO PSD CONE S N
- Page 517 and 518: 6.6. VECTORIZATION & PROJECTION INT
- Page 519 and 520: 6.6. VECTORIZATION & PROJECTION INT
- Page 521 and 522: 6.6. VECTORIZATION & PROJECTION INT
- Page 523 and 524: 6.7. A GEOMETRY OF COMPLETION 523(b
- Page 525 and 526: 6.7. A GEOMETRY OF COMPLETION 525[3
- Page 527 and 528: 6.7. A GEOMETRY OF COMPLETION 527wh
- Page 529 and 530: 6.8. DUAL EDM CONE 529to the geomet
- Page 531 and 532: 6.8. DUAL EDM CONE 531Proof. First,
- Page 533 and 534: 6.8. DUAL EDM CONE 533EDM 2 = S 2 h
- Page 535 and 536: 6.8. DUAL EDM CONE 535therefore the
- Page 537 and 538: 6.8. DUAL EDM CONE 537Elegance of t
- Page 539 and 540: 6.8. DUAL EDM CONE 5396.8.1.5 Affin
- Page 541 and 542: 6.8. DUAL EDM CONE 5416.8.1.7 Schoe
- Page 543 and 544: 6.8. DUAL EDM CONE 5430dvec rel ∂
- Page 545 and 546: 6.10. POSTSCRIPT 5456.10 Postscript
- Page 547 and 548: Chapter 7Proximity problemsIn the
- Page 549 and 550: 549project on the subspace, then pr
- Page 551: 551HS N h0EDM NK = S N h ∩ R N×N
- Page 555 and 556: 7.1. FIRST PREVALENT PROBLEM: 555fi
- Page 557 and 558: 7.1. FIRST PREVALENT PROBLEM: 5577.
- Page 559 and 560: 7.1. FIRST PREVALENT PROBLEM: 559di
- Page 561 and 562: 7.1. FIRST PREVALENT PROBLEM: 5617.
- Page 563 and 564: 7.1. FIRST PREVALENT PROBLEM: 563wh
- Page 565 and 566: 7.1. FIRST PREVALENT PROBLEM: 565Th
- Page 567 and 568: 7.2. SECOND PREVALENT PROBLEM: 567O
- Page 569 and 570: 7.2. SECOND PREVALENT PROBLEM: 569S
- Page 571 and 572: 7.2. SECOND PREVALENT PROBLEM: 571r
- Page 573 and 574: 7.2. SECOND PREVALENT PROBLEM: 573w
- Page 575 and 576: 7.2. SECOND PREVALENT PROBLEM: 5757
- Page 577 and 578: 7.2. SECOND PREVALENT PROBLEM: 577a
- Page 579 and 580: 7.3. THIRD PREVALENT PROBLEM: 579is
- Page 581 and 582: 7.3. THIRD PREVALENT PROBLEM: 581We
- Page 583 and 584: 7.3. THIRD PREVALENT PROBLEM: 583su
- Page 585 and 586: 7.3. THIRD PREVALENT PROBLEM: 585Gi
- Page 587 and 588: 7.3. THIRD PREVALENT PROBLEM: 587Op
- Page 589 and 590: 7.4. CONCLUSION 589filtering, multi
- Page 591 and 592: Appendix ALinear algebraA.1 Main-di
- Page 593 and 594: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 595 and 596: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 597 and 598: A.2. SEMIDEFINITENESS: DOMAIN OF TE
- Page 599 and 600: A.3. PROPER STATEMENTS 599(AB) T
- Page 601 and 602: A.3. PROPER STATEMENTS 601A.3.1Semi
5537.0.3 Problem approachProblems traditionally posed in terms of point position {x i ∈ R n , i=1... N }such as∑minimize (‖x i − x j ‖ − h ij ) 2 (1308){x i }orminimize{x i }i , j ∈ I∑(‖x i − x j ‖ 2 − h ij ) 2 (1309)i , j ∈ I(where I is an abstract set of indices and h ij is given data) are everywhereconverted herein to the distance-square variable D or to Gram matrix G ;the Gram matrix acting as bridge between position and distance. (Thatconversion is performed regardless of whether known data is complete.)Then the techniques of chapter 5 or chapter 6 are applied to find relativeor absolute position. This approach is taken because we prefer introductionof rank constraints into convex problems rather than searching a googol oflocal minima in nonconvex problems like (1308) [105] (3.6.4.0.3,7.2.2.7.1)or (1309).7.0.4 Three prevalent proximity problemsThere are three statements of the closest-EDM problem prevalent in theliterature, the multiplicity due primarily to choice of projection on theEDM versus positive semidefinite (PSD) cone and vacillation between thedistance-square variable d ij versus absolute distance √ d ij . In their mostfundamental form, the three prevalent proximity problems are (1310.1),(1310.2), and (1310.3): [342] for D [d ij ] and ◦√ D [ √ d ij ](1)(3)minimize ‖−V (D − H)V ‖ 2 FDsubject to rankV DV ≤ ρD ∈ EDM Nminimize ‖D − H‖ 2 FDsubject to rankV DV ≤ ρD ∈ EDM Nminimize ‖ ◦√ D − H‖◦√ 2 FDsubject to rankV DV ≤ ρ◦√ √D ∈ EDMNminimize ‖−V ( ◦√ D − H)V ‖◦√ 2 FDsubject to rankV DV ≤ ρ◦√ √D ∈ EDMN(2)(1310)(4)