v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
678 APPENDIX E. PROJECTION Projection on cone K is P K x = (I − 1 τ 2a⋆ a ⋆T )x (1894) whereas projection on the polar cone −K ∗ is (E.9.2.2.1) P K ◦x = x − P K x = 1 τ 2a⋆ a ⋆T x (1895) Negating vector a , this maximization problem (1892) becomes a minimization (the same problem) and the polar cone becomes the dual cone: E.9.2 ‖x − P K x‖ = − 1 τ minimize a T x a subject to ‖a‖ ≤ τ (1896) a ∈ K ∗ Projection on cone When convex set C conditions: is a cone, there is a finer statement of optimality E.9.2.0.1 Theorem. Unique projection on cone. [173,A.3.2] Let K ⊆ R n be a closed convex cone, and K ∗ its dual (2.13.1). Then Px is the unique minimum-distance projection of x∈ R n on K if and only if Px ∈ K , 〈Px − x, Px〉 = 0, Px − x ∈ K ∗ (1897) In words, Px is the unique minimum-distance projection of x on K if and only if 1) projection Px lies in K 2) direction Px−x is orthogonal to the projection Px 3) direction Px−x lies in the dual cone K ∗ . As the theorem is stated, it admits projection on K having empty interior; id est, on convex cones in a proper subspace of R n . ⋄
E.9. PROJECTION ON CONVEX SET 679 Projection on K of any point x∈−K ∗ , belonging to the negative dual cone, is the origin. By (1897): the set of all points reaching the origin, when projecting on K , constitutes the negative dual cone; a.k.a, the polar cone E.9.2.1 K ◦ = −K ∗ = {x∈ R n | Px = 0} (1898) Relation to subspace projection Conditions 1 and 2 of the theorem are common with orthogonal projection on a subspace R(P ) : Condition 1 is the most basic requirement; namely, Px∈ R(P ) , the projection belongs to the subspace. Invoking perpendicularity condition (1783), we recall the second requirement for projection on a subspace: Px − x ⊥ R(P ) or Px − x ∈ R(P ) ⊥ (1899) which corresponds to condition 2. Yet condition 3 is a generalization of subspace projection; id est, for unique minimum-distance projection on a closed convex cone K , polar cone −K ∗ plays the role R(P ) ⊥ plays for subspace projection (P R x = x − P R ⊥ x). Indeed, −K ∗ is the algebraic complement in the orthogonal vector sum (p.708) [232] [173,A.3.2.5] K ⊞ −K ∗ = R n ⇔ cone K is closed and convex (1900) Also, given unique minimum-distance projection Px on K satisfying Theorem E.9.2.0.1, then by projection on the algebraic complement via I −P inE.2 we have −K ∗ = {x − Px | x∈ R n } = {x∈ R n | Px = 0} (1901) consequent to Moreau (1904). Recalling any subspace is a closed convex cone E.16 K = R(P ) ⇔ −K ∗ = R(P ) ⊥ (1902) meaning, when a cone is a subspace R(P ) , then the dual cone becomes its orthogonal complement R(P ) ⊥ . [53,2.6.1] In this circumstance, condition 3 becomes coincident with condition 2. The properties of projection on cones following inE.9.2.2 further generalize to subspaces by: (4) K = R(P ) ⇔ −K = R(P ) (1903) E.16 but a proper subspace is not a proper cone (2.7.2.2.1).
- Page 627 and 628: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 629 and 630: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 631 and 632: D.2. TABLES OF GRADIENTS AND DERIVA
- Page 633 and 634: D.2. TABLES OF GRADIENTS AND DERIVA
- Page 635 and 636: D.2. TABLES OF GRADIENTS AND DERIVA
- Page 637 and 638: D.2. TABLES OF GRADIENTS AND DERIVA
- Page 639 and 640: Appendix E Projection For any A∈
- Page 641 and 642: 641 U T = U † for orthonormal (in
- Page 643 and 644: E.1. IDEMPOTENT MATRICES 643 where
- Page 645 and 646: E.1. IDEMPOTENT MATRICES 645 order,
- Page 647 and 648: E.1. IDEMPOTENT MATRICES 647 When t
- Page 649 and 650: E.3. SYMMETRIC IDEMPOTENT MATRICES
- Page 651 and 652: E.3. SYMMETRIC IDEMPOTENT MATRICES
- Page 653 and 654: E.3. SYMMETRIC IDEMPOTENT MATRICES
- Page 655 and 656: E.5. PROJECTION EXAMPLES 655 E.4.0.
- Page 657 and 658: E.5. PROJECTION EXAMPLES 657 a ∗
- Page 659 and 660: E.5. PROJECTION EXAMPLES 659 E.5.0.
- Page 661 and 662: E.6. VECTORIZATION INTERPRETATION,
- Page 663 and 664: E.6. VECTORIZATION INTERPRETATION,
- Page 665 and 666: E.6. VECTORIZATION INTERPRETATION,
- Page 667 and 668: E.6. VECTORIZATION INTERPRETATION,
- Page 669 and 670: E.7. ON VECTORIZED MATRICES OF HIGH
- Page 671 and 672: E.7. ON VECTORIZED MATRICES OF HIGH
- Page 673 and 674: E.8. RANGE/ROWSPACE INTERPRETATION
- Page 675 and 676: E.9. PROJECTION ON CONVEX SET 675 A
- Page 677: E.9. PROJECTION ON CONVEX SET 677 W
- Page 681 and 682: E.9. PROJECTION ON CONVEX SET 681 E
- Page 683 and 684: E.9. PROJECTION ON CONVEX SET 683 T
- Page 685 and 686: E.9. PROJECTION ON CONVEX SET 685
- Page 687 and 688: E.10. ALTERNATING PROJECTION 687 E.
- Page 689 and 690: E.10. ALTERNATING PROJECTION 689 b
- Page 691 and 692: E.10. ALTERNATING PROJECTION 691 a
- Page 693 and 694: E.10. ALTERNATING PROJECTION 693 (a
- Page 695 and 696: E.10. ALTERNATING PROJECTION 695 wh
- Page 697 and 698: E.10. ALTERNATING PROJECTION 697 E.
- Page 699 and 700: E.10. ALTERNATING PROJECTION 699 10
- Page 701 and 702: E.10. ALTERNATING PROJECTION 701 E.
- Page 703 and 704: E.10. ALTERNATING PROJECTION 703 E
- Page 705 and 706: Appendix F Notation and a few defin
- Page 707 and 708: 707 a.i. c.i. l.i. w.r.t affinely i
- Page 709 and 710: 709 is or ← → t → 0 + as in
- Page 711 and 712: 711 ∑ π(γ) Ξ Π ∏ ψ(Z) D D
- Page 713 and 714: 713 R m×n Euclidean vector space o
- Page 715 and 716: 715 H − H + ∂H ∂H ∂H −
- Page 717 and 718: 717 O O sort-index matrix order of
- Page 719 and 720: (x,y) angle between vectors x and y
- Page 721 and 722: Bibliography [1] Suliman Al-Homidan
- Page 723 and 724: BIBLIOGRAPHY 723 [24] Alexander I.
- Page 725 and 726: BIBLIOGRAPHY 725 [52] Stephen Boyd,
- Page 727 and 728: BIBLIOGRAPHY 727 [78] Frank Critchl
678 APPENDIX E. PROJECTION<br />
Projection on cone K is<br />
P K x = (I − 1<br />
τ 2a⋆ a ⋆T )x (1894)<br />
whereas projection on the polar cone −K ∗ is (E.9.2.2.1)<br />
P K ◦x = x − P K x = 1<br />
τ 2a⋆ a ⋆T x (1895)<br />
Negating vector a , this maximization problem (1892) becomes a<br />
minimization (the same problem) and the polar cone becomes the dual cone:<br />
E.9.2<br />
‖x − P K x‖ = − 1 τ minimize a T x<br />
a<br />
subject to ‖a‖ ≤ τ (1896)<br />
a ∈ K ∗<br />
Projection on cone<br />
When convex set C<br />
conditions:<br />
is a cone, there is a finer statement of optimality<br />
E.9.2.0.1 Theorem. Unique projection on cone. [173,A.3.2]<br />
Let K ⊆ R n be a closed convex cone, and K ∗ its dual (2.13.1). Then Px is<br />
the unique minimum-distance projection of x∈ R n on K if and only if<br />
Px ∈ K , 〈Px − x, Px〉 = 0, Px − x ∈ K ∗ (1897)<br />
In words, Px is the unique minimum-distance projection of x on K if<br />
and only if<br />
1) projection Px lies in K<br />
2) direction Px−x is orthogonal to the projection Px<br />
3) direction Px−x lies in the dual cone K ∗ .<br />
As the theorem is stated, it admits projection on K having empty interior;<br />
id est, on convex cones in a proper subspace of R n .<br />
⋄