v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
526 CHAPTER 6. CONE OF DISTANCE MATRICES(a)(b)Figure 146: (a) Trefoil knot in R 3 from Weinberger & Saul [372].(b) Topological transformation algorithm employing 4 nearest neighbors andN = 539 samples reduces affine dimension of knot to r=2. Choosing instead2 nearest neighbors would make this embedding more circular.
6.7. A GEOMETRY OF COMPLETION 527where ďij denotes a given fixed distance-square. The unfurling algorithm canbe expressed as an optimization problem; constrained total distance-squaremaximization:maximize 〈−V , D〉Dsubject to 〈D , e i e T j + e j e T i 〉 1 = 2 ďij ∀(i,j)∈ I(1245)rank(V DV ) = 2D ∈ EDM Nwhere e i ∈ R N is the i th member of the standard basis, where set I indexesthe given distance-square data like that in (1244), where V ∈ R N×N is thegeometric centering matrix (B.4.1), and where〈−V , D〉 = tr(−V DV ) = 2 trG = 1 ∑d ij (915)Nwhere G is the Gram matrix producing D assuming G1 = 0.If the (rank) constraint on affine dimension is ignored, then problem(1245) becomes convex, a corresponding solution D ⋆ can be found, and anearest rank-2 solution is then had by ordered eigenvalue decompositionof −V D ⋆ V followed by spectral projection (7.1.3) oni,j[R2+0]⊂ R N . Thistwo-step process is necessarily suboptimal. Yet because the decompositionfor the trefoil knot reveals only two dominant eigenvalues, the spectralprojection is nearly benign. Such a reconstruction of point position (5.12)utilizing 4 nearest neighbors is drawn in Figure 146b; a low-dimensionalembedding of the trefoil knot.This problem (1245) can, of course, be written equivalently in terms ofGram matrix G , facilitated by (921); videlicet, for Φ ij as in (889)maximize 〈I , G〉G∈S N csubject to 〈G , Φ ij 〉 = ďijrankG = 2G ≽ 0∀(i,j)∈ I(1246)The advantage to converting EDM to Gram is: Gram matrix G is a bridgebetween point list X and EDM D ; constraints on any or all of thesethree variables may now be introduced. (Example 5.4.2.3.5) Confinement
- Page 475 and 476: 5.11. EDM INDEFINITENESS 475holds o
- Page 477 and 478: 5.12. LIST RECONSTRUCTION 477where
- Page 479 and 480: 5.12. LIST RECONSTRUCTION 479(a)(c)
- Page 481 and 482: 5.13. RECONSTRUCTION EXAMPLES 481Wi
- Page 483 and 484: 5.13. RECONSTRUCTION EXAMPLES 483d
- Page 485 and 486: 5.13. RECONSTRUCTION EXAMPLES 485Th
- Page 487 and 488: 5.14. FIFTH PROPERTY OF EUCLIDEAN M
- Page 489 and 490: 5.14. FIFTH PROPERTY OF EUCLIDEAN M
- Page 491 and 492: 5.14. FIFTH PROPERTY OF EUCLIDEAN M
- Page 493 and 494: 5.14. FIFTH PROPERTY OF EUCLIDEAN M
- Page 495 and 496: 5.14. FIFTH PROPERTY OF EUCLIDEAN M
- Page 497 and 498: Chapter 6Cone of distance matricesF
- Page 499 and 500: 6.1. DEFINING EDM CONE 4996.1 Defin
- Page 501 and 502: 6.2. POLYHEDRAL BOUNDS 501This cone
- Page 503 and 504: 6.4. EDM DEFINITION IN 11 T 503That
- Page 505 and 506: 6.4. EDM DEFINITION IN 11 T 505N(1
- Page 507 and 508: 6.4. EDM DEFINITION IN 11 T 507Then
- Page 509 and 510: 6.4. EDM DEFINITION IN 11 T 5096.4.
- Page 511 and 512: 6.5. CORRESPONDENCE TO PSD CONE S N
- Page 513 and 514: 6.5. CORRESPONDENCE TO PSD CONE S N
- Page 515 and 516: 6.5. CORRESPONDENCE TO PSD CONE S N
- Page 517 and 518: 6.6. VECTORIZATION & PROJECTION INT
- Page 519 and 520: 6.6. VECTORIZATION & PROJECTION INT
- Page 521 and 522: 6.6. VECTORIZATION & PROJECTION INT
- Page 523 and 524: 6.7. A GEOMETRY OF COMPLETION 523(b
- Page 525: 6.7. A GEOMETRY OF COMPLETION 525[3
- Page 529 and 530: 6.8. DUAL EDM CONE 529to the geomet
- Page 531 and 532: 6.8. DUAL EDM CONE 531Proof. First,
- Page 533 and 534: 6.8. DUAL EDM CONE 533EDM 2 = S 2 h
- Page 535 and 536: 6.8. DUAL EDM CONE 535therefore the
- Page 537 and 538: 6.8. DUAL EDM CONE 537Elegance of t
- Page 539 and 540: 6.8. DUAL EDM CONE 5396.8.1.5 Affin
- Page 541 and 542: 6.8. DUAL EDM CONE 5416.8.1.7 Schoe
- Page 543 and 544: 6.8. DUAL EDM CONE 5430dvec rel ∂
- Page 545 and 546: 6.10. POSTSCRIPT 5456.10 Postscript
- Page 547 and 548: Chapter 7Proximity problemsIn the
- Page 549 and 550: 549project on the subspace, then pr
- Page 551 and 552: 551HS N h0EDM NK = S N h ∩ R N×N
- Page 553 and 554: 5537.0.3 Problem approachProblems t
- Page 555 and 556: 7.1. FIRST PREVALENT PROBLEM: 555fi
- Page 557 and 558: 7.1. FIRST PREVALENT PROBLEM: 5577.
- Page 559 and 560: 7.1. FIRST PREVALENT PROBLEM: 559di
- Page 561 and 562: 7.1. FIRST PREVALENT PROBLEM: 5617.
- Page 563 and 564: 7.1. FIRST PREVALENT PROBLEM: 563wh
- Page 565 and 566: 7.1. FIRST PREVALENT PROBLEM: 565Th
- Page 567 and 568: 7.2. SECOND PREVALENT PROBLEM: 567O
- Page 569 and 570: 7.2. SECOND PREVALENT PROBLEM: 569S
- Page 571 and 572: 7.2. SECOND PREVALENT PROBLEM: 571r
- Page 573 and 574: 7.2. SECOND PREVALENT PROBLEM: 573w
- Page 575 and 576: 7.2. SECOND PREVALENT PROBLEM: 5757
6.7. A GEOMETRY OF COMPLETION 527where ďij denotes a given fixed distance-square. The unfurling algorithm canbe expressed as an optimization problem; constrained total distance-squaremaximization:maximize 〈−V , D〉Dsubject to 〈D , e i e T j + e j e T i 〉 1 = 2 ďij ∀(i,j)∈ I(1245)rank(V DV ) = 2D ∈ EDM Nwhere e i ∈ R N is the i th member of the standard basis, where set I indexesthe given distance-square data like that in (1244), where V ∈ R N×N is thegeometric centering matrix (B.4.1), and where〈−V , D〉 = tr(−V DV ) = 2 trG = 1 ∑d ij (915)Nwhere G is the Gram matrix producing D assuming G1 = 0.If the (rank) constraint on affine dimension is ignored, then problem(1245) becomes convex, a corresponding solution D ⋆ can be found, and anearest rank-2 solution is then had by ordered eigenvalue decompositionof −V D ⋆ V followed by spectral projection (7.1.3) oni,j[R2+0]⊂ R N . Thistwo-step process is necessarily suboptimal. Yet because the decompositionfor the trefoil knot reveals only two dominant eigenvalues, the spectralprojection is nearly benign. Such a reconstruction of point position (5.12)utilizing 4 nearest neighbors is drawn in Figure 146b; a low-dimensionalembedding of the trefoil knot.This problem (1245) can, of course, be written equivalently in terms ofGram matrix G , facilitated by (921); videlicet, for Φ ij as in (889)maximize 〈I , G〉G∈S N csubject to 〈G , Φ ij 〉 = ďijrankG = 2G ≽ 0∀(i,j)∈ I(1246)The advantage to converting EDM to Gram is: Gram matrix G is a bridgebetween point list X and EDM D ; constraints on any or all of thesethree variables may now be introduced. (Example 5.4.2.3.5) Confinement