v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
766 APPENDIX E. PROJECTIONC ∞C 1C 2K ⊥ C 1 (0)K ⊥ C 2 (0)K ⊥ C ∞(0)Figure 176: Rough sketch of normal cone to set C ⊂ R 2 as C wanders towardinfinity. A point at which a normal cone is determined, here the origin, neednot belong to the set. Normal cone to C 1 is a ray. But as C moves outward,normal cone approaches a halfspace.closest to any point belonging to the translated normal cone KC ⊥ (a) + a ; e.g.,Theorem E.4.0.0.1. The normal cone to convex cone K at the originK ⊥ K(0) = −K ∗ (2089)is the negative dual cone. Any point belonging to −K ∗ , projected on K ,projects on the origin. More generally, [109,4.5]K ⊥ K(a) = −(K − a) ∗ (2090)K ⊥ K(a∈ K) = −K ∗ ∩ a ⊥ (2091)The normal cone to ⋂ C k at Pb in Figure 168 is ray {ξ(b −Pb) | ξ ≥0}illustrated in Figure 174. Applying Dykstra’s algorithm to that example,convergence to the desired result is achieved in two iterations as illustrated inFigure 173. Yet applying Dykstra’s algorithm to the example in Figure 167does not improve rate of convergence, unfortunately, because the givenpoint b and all the alternating projections already belong to the translatednormal cone at the vertex of intersection.
E.10. ALTERNATING PROJECTION 767E.10.3.3speculationDykstra’s algorithm always converges at least as quickly as classicalalternating projection, never slower [109], and it succeeds where alternatingprojection fails. Rate of convergence is wholly dependent on particulargeometry of a given problem. From these few examples we surmise, uniqueminimum-distance projection on blunt (not sharp or acute, informally)full-dimensional polyhedral cones may be found by Dykstra’s algorithm infew iterations. But total number of alternating projections, constitutingthose iterations, can never be less than number of convex sets.
- Page 715 and 716: E.4. ALGEBRA OF PROJECTION ON AFFIN
- Page 717 and 718: E.5. PROJECTION EXAMPLES 717a ∗ 2
- Page 719 and 720: E.5. PROJECTION EXAMPLES 719where Y
- Page 721 and 722: E.5. PROJECTION EXAMPLES 721(B.4.2)
- Page 723 and 724: E.6. VECTORIZATION INTERPRETATION,
- Page 725 and 726: E.6. VECTORIZATION INTERPRETATION,
- Page 727 and 728: E.6. VECTORIZATION INTERPRETATION,
- Page 729 and 730: E.7. PROJECTION ON MATRIX SUBSPACES
- Page 731 and 732: E.7. PROJECTION ON MATRIX SUBSPACES
- Page 733 and 734: E.8. RANGE/ROWSPACE INTERPRETATION
- Page 735 and 736: E.9. PROJECTION ON CONVEX SET 735As
- Page 737 and 738: E.9. PROJECTION ON CONVEX SET 737Wi
- Page 739 and 740: E.9. PROJECTION ON CONVEX SET 739R(
- Page 741 and 742: E.9. PROJECTION ON CONVEX SET 741E.
- Page 743 and 744: E.9. PROJECTION ON CONVEX SET 743E.
- Page 745 and 746: E.9. PROJECTION ON CONVEX SET 745Un
- Page 747 and 748: E.9. PROJECTION ON CONVEX SET 747ac
- Page 749 and 750: E.10. ALTERNATING PROJECTION 749bC
- Page 751 and 752: E.10. ALTERNATING PROJECTION 7510
- Page 753 and 754: E.10. ALTERNATING PROJECTION 753E.1
- Page 755 and 756: E.10. ALTERNATING PROJECTION 755y 2
- Page 757 and 758: E.10. ALTERNATING PROJECTION 757Def
- Page 759 and 760: E.10. ALTERNATING PROJECTION 759Dis
- Page 761 and 762: E.10. ALTERNATING PROJECTION 761mat
- Page 763 and 764: E.10. ALTERNATING PROJECTION 763K
- Page 765: E.10. ALTERNATING PROJECTION 765E.1
- Page 769 and 770: Appendix FNotation and a few defini
- Page 771 and 772: 771A ij or A(i, j) , ij th entry of
- Page 773 and 774: 773⊞orthogonal vector sum of sets
- Page 775 and 776: 775x +vector x whose negative entri
- Page 777 and 778: 777X point list ((76) having cardin
- Page 779 and 780: 779SDPSVDSNRdBEDMS n 1S n hS n⊥hS
- Page 781 and 782: 781vectorentrycubixquartixfeasible
- Page 783 and 784: 783Oorder of magnitude information
- Page 785 and 786: 785cofmatrix of cofactors correspon
- Page 787 and 788: Bibliography[1] Edwin A. Abbott. Fl
- Page 789 and 790: BIBLIOGRAPHY 789[23] Dror Baron, Mi
- Page 791 and 792: BIBLIOGRAPHY 791[49] Leonard M. Blu
- Page 793 and 794: BIBLIOGRAPHY 793[74] Yves Chabrilla
- Page 795 and 796: BIBLIOGRAPHY 795[102] Etienne de Kl
- Page 797 and 798: BIBLIOGRAPHY 797[129] Carl Eckart a
- Page 799 and 800: BIBLIOGRAPHY 799[154] James Gleik.
- Page 801 and 802: BIBLIOGRAPHY 801[182] Johan Håstad
- Page 803 and 804: BIBLIOGRAPHY 803[212] Viren Jain an
- Page 805 and 806: BIBLIOGRAPHY 805[237] Monique Laure
- Page 807 and 808: BIBLIOGRAPHY 807[265] Sunderarajan
- Page 809 and 810: BIBLIOGRAPHY 809Notes in Computer S
- Page 811 and 812: BIBLIOGRAPHY 811[319] Anthony Man-C
- Page 813 and 814: BIBLIOGRAPHY 813[346] Pham Dinh Tao
- Page 815 and 816: BIBLIOGRAPHY 815[375] Bernard Widro
E.10. ALTERNATING PROJECTION 767E.10.3.3speculationDykstra’s algorithm always converges at least as quickly as classicalalternating projection, never slower [109], and it succeeds where alternatingprojection fails. Rate of convergence is wholly dependent on particulargeometry of a given problem. From these few examples we surmise, uniqueminimum-distance projection on blunt (not sharp or acute, informally)full-dimensional polyhedral cones may be found by Dykstra’s algorithm infew iterations. But total number of alternating projections, constitutingthose iterations, can never be less than number of convex sets.