v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
744 APPENDIX E. PROJECTIONTo project a matrix on nonnegative orthant R m×n+ , simply clip allnegative entries to 0. Likewise, projection on nonpositive orthant R m×n−sees all positive entries clipped to 0. Projection on other orthants isequally simple with appropriate clipping.Projecting on hyperplane, halfspace, slab:E.5.0.0.8.Projection of y ∈ R n on Euclidean ball B = {x∈ R n | ‖x − a‖ ≤ c} :for y ≠ a , P B y = (y − a) + a .c‖y−a‖Clipping in excess of |1| each entry of point x∈ R n is equivalent tounique minimum-distance projection of x on a hypercube centered atthe origin. (conferE.10.3.2)Projection of x∈ R n on a (rectangular) hyperbox: [61,8.1.1]C = {y ∈ R n | l ≼ y ≼ u, l ≺ u} (2041)⎧⎨ l k , x k ≤ l kP(x) k=0...n = x k , l k ≤ x k ≤ u k (2042)⎩u k , x k ≥ u kOrthogonal projection of x on a Cartesian subspace, whose basis issome given subset of the Cartesian axes, zeroes entries correspondingto the remaining (complementary) axes.Projection of x on set of all cardinality-k vectors {y | cardy ≤k} keepsk entries of greatest magnitude and clips to 0 those remaining.Unique minimum-distance projection of H ∈ S n on positive semidefinitecone S n + in Euclidean/Frobenius sense is accomplished by eigenvaluedecomposition (diagonalization) followed by clipping all negativeeigenvalues to 0.Unique minimum-distance projection on generally nonconvex subset ofall matrices belonging to S n + having rank not exceeding ρ (2.9.2.1)is accomplished by clipping all negative eigenvalues to 0 and zeroingsmallest nonnegative eigenvalues keeping only ρ largest. (7.1.2)
E.9. PROJECTION ON CONVEX SET 745Unique minimum-distance projection, in Euclidean/Frobenius sense,of H ∈ R m×n on generally nonconvex subset of all m ×n matrices ofrank no greater than k is singular value decomposition (A.6) of Hhaving all singular values beyond k th zeroed. This is also a solution toprojection in sense of spectral norm. [328, p.79, p.208]Projection on monotone nonnegative cone K M+ ⊂ R n in less than onecycle (in sense of alternating projectionsE.10): [Wıκımization].Fast projection on a simplicial cone: [Wıκımization].Projection on closed convex cone K of any point x∈−K ∗ , belonging topolar cone, is equivalent to projection on origin. (E.9.2)P S N+ ∩ S N c= P S N+P S N c(1264)P RN×N+ ∩ S N h= P RN×NP + S Nh(7.0.1.1)P RN×N+ ∩ S= P N RN×N+P S N(E.9.5)E.9.4.0.1 Exercise. Projection on spectral norm ball.Find the unique minimum-distance projection on the convex set of allm ×n matrices whose largest singular value does not exceed 1 ; id est, on{X ∈ R m×n | ‖X‖ 2 ≤ 1} the spectral norm ball (2.3.2.0.5). E.9.4.1notesProjection on Lorentz (second-order) cone: [61, exer.8.3c].Deutsch [112] provides an algorithm for projection on polyhedral cones.Youla [392,2.5] lists eleven “useful projections”, of square-integrableuni- and bivariate real functions on various convex sets, in closed form.Unique minimum-distance projection on an ellipsoid: Example 4.6.0.0.1.Numerical algorithms for projection on the nonnegative simplex and1-norm ball are in [126].E.9.5Projection on convex set in subspaceSuppose a convex set C is contained in some subspace R n . Then uniqueminimum-distance projection of any point in R n ⊕ R n⊥ on C can be
- Page 693 and 694: D.2. TABLES OF GRADIENTS AND DERIVA
- Page 695 and 696: D.2. TABLES OF GRADIENTS AND DERIVA
- Page 697 and 698: D.2. TABLES OF GRADIENTS AND DERIVA
- Page 699 and 700: Appendix EProjectionFor any A∈ R
- Page 701 and 702: 701U T = U † for orthonormal (inc
- Page 703 and 704: E.1. IDEMPOTENT MATRICES 703where A
- Page 705 and 706: E.1. IDEMPOTENT MATRICES 705order,
- Page 707 and 708: E.1. IDEMPOTENT MATRICES 707are lin
- Page 709 and 710: E.3. SYMMETRIC IDEMPOTENT MATRICES
- Page 711 and 712: E.3. SYMMETRIC IDEMPOTENT MATRICES
- Page 713 and 714: E.3. SYMMETRIC IDEMPOTENT MATRICES
- Page 715 and 716: E.4. ALGEBRA OF PROJECTION ON AFFIN
- Page 717 and 718: E.5. PROJECTION EXAMPLES 717a ∗ 2
- Page 719 and 720: E.5. PROJECTION EXAMPLES 719where Y
- Page 721 and 722: E.5. PROJECTION EXAMPLES 721(B.4.2)
- Page 723 and 724: E.6. VECTORIZATION INTERPRETATION,
- Page 725 and 726: E.6. VECTORIZATION INTERPRETATION,
- Page 727 and 728: E.6. VECTORIZATION INTERPRETATION,
- Page 729 and 730: E.7. PROJECTION ON MATRIX SUBSPACES
- Page 731 and 732: E.7. PROJECTION ON MATRIX SUBSPACES
- Page 733 and 734: E.8. RANGE/ROWSPACE INTERPRETATION
- Page 735 and 736: E.9. PROJECTION ON CONVEX SET 735As
- Page 737 and 738: E.9. PROJECTION ON CONVEX SET 737Wi
- Page 739 and 740: E.9. PROJECTION ON CONVEX SET 739R(
- Page 741 and 742: E.9. PROJECTION ON CONVEX SET 741E.
- Page 743: E.9. PROJECTION ON CONVEX SET 743E.
- Page 747 and 748: E.9. PROJECTION ON CONVEX SET 747ac
- Page 749 and 750: E.10. ALTERNATING PROJECTION 749bC
- Page 751 and 752: E.10. ALTERNATING PROJECTION 7510
- Page 753 and 754: E.10. ALTERNATING PROJECTION 753E.1
- Page 755 and 756: E.10. ALTERNATING PROJECTION 755y 2
- Page 757 and 758: E.10. ALTERNATING PROJECTION 757Def
- Page 759 and 760: E.10. ALTERNATING PROJECTION 759Dis
- Page 761 and 762: E.10. ALTERNATING PROJECTION 761mat
- Page 763 and 764: E.10. ALTERNATING PROJECTION 763K
- Page 765 and 766: E.10. ALTERNATING PROJECTION 765E.1
- Page 767 and 768: E.10. ALTERNATING PROJECTION 767E.1
- Page 769 and 770: Appendix FNotation and a few defini
- Page 771 and 772: 771A ij or A(i, j) , ij th entry of
- Page 773 and 774: 773⊞orthogonal vector sum of sets
- Page 775 and 776: 775x +vector x whose negative entri
- Page 777 and 778: 777X point list ((76) having cardin
- Page 779 and 780: 779SDPSVDSNRdBEDMS n 1S n hS n⊥hS
- Page 781 and 782: 781vectorentrycubixquartixfeasible
- Page 783 and 784: 783Oorder of magnitude information
- Page 785 and 786: 785cofmatrix of cofactors correspon
- Page 787 and 788: Bibliography[1] Edwin A. Abbott. Fl
- Page 789 and 790: BIBLIOGRAPHY 789[23] Dror Baron, Mi
- Page 791 and 792: BIBLIOGRAPHY 791[49] Leonard M. Blu
- Page 793 and 794: BIBLIOGRAPHY 793[74] Yves Chabrilla
744 APPENDIX E. PROJECTIONTo project a matrix on nonnegative orthant R m×n+ , simply clip allnegative entries to 0. Likewise, projection on nonpositive orthant R m×n−sees all positive entries clipped to 0. Projection on other orthants isequally simple with appropriate clipping.Projecting on hyperplane, halfspace, slab:E.5.0.0.8.Projection of y ∈ R n on Euclidean ball B = {x∈ R n | ‖x − a‖ ≤ c} :for y ≠ a , P B y = (y − a) + a .c‖y−a‖Clipping in excess of |1| each entry of point x∈ R n is equivalent tounique minimum-distance projection of x on a hypercube centered atthe origin. (conferE.10.3.2)Projection of x∈ R n on a (rectangular) hyperbox: [61,8.1.1]C = {y ∈ R n | l ≼ y ≼ u, l ≺ u} (2041)⎧⎨ l k , x k ≤ l kP(x) k=0...n = x k , l k ≤ x k ≤ u k (2042)⎩u k , x k ≥ u kOrthogonal projection of x on a Cartesian subspace, whose basis issome given subset of the Cartesian axes, zeroes entries correspondingto the remaining (complementary) axes.Projection of x on set of all cardinality-k vectors {y | cardy ≤k} keepsk entries of greatest magnitude and clips to 0 those remaining.Unique minimum-distance projection of H ∈ S n on positive semidefinitecone S n + in Euclidean/Frobenius sense is accomplished by eigenvaluedecomposition (diagonalization) followed by clipping all negativeeigenvalues to 0.Unique minimum-distance projection on generally nonconvex subset ofall matrices belonging to S n + having rank not exceeding ρ (2.9.2.1)is accomplished by clipping all negative eigenvalues to 0 and zeroingsmallest nonnegative eigenvalues keeping only ρ largest. (7.1.2)