v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

678 APPENDIX E. PROJECTION Projection on cone K is P K x = (I − 1 τ 2a⋆ a ⋆T )x (1894) whereas projection on the polar cone −K ∗ is (E.9.2.2.1) P K ◦x = x − P K x = 1 τ 2a⋆ a ⋆T x (1895) Negating vector a , this maximization problem (1892) becomes a minimization (the same problem) and the polar cone becomes the dual cone: E.9.2 ‖x − P K x‖ = − 1 τ minimize a T x a subject to ‖a‖ ≤ τ (1896) a ∈ K ∗ Projection on cone When convex set C conditions: is a cone, there is a finer statement of optimality E.9.2.0.1 Theorem. Unique projection on cone. [173,A.3.2] Let K ⊆ R n be a closed convex cone, and K ∗ its dual (2.13.1). Then Px is the unique minimum-distance projection of x∈ R n on K if and only if Px ∈ K , 〈Px − x, Px〉 = 0, Px − x ∈ K ∗ (1897) In words, Px is the unique minimum-distance projection of x on K if and only if 1) projection Px lies in K 2) direction Px−x is orthogonal to the projection Px 3) direction Px−x lies in the dual cone K ∗ . As the theorem is stated, it admits projection on K having empty interior; id est, on convex cones in a proper subspace of R n . ⋄

E.9. PROJECTION ON CONVEX SET 679 Projection on K of any point x∈−K ∗ , belonging to the negative dual cone, is the origin. By (1897): the set of all points reaching the origin, when projecting on K , constitutes the negative dual cone; a.k.a, the polar cone E.9.2.1 K ◦ = −K ∗ = {x∈ R n | Px = 0} (1898) Relation to subspace projection Conditions 1 and 2 of the theorem are common with orthogonal projection on a subspace R(P ) : Condition 1 is the most basic requirement; namely, Px∈ R(P ) , the projection belongs to the subspace. Invoking perpendicularity condition (1783), we recall the second requirement for projection on a subspace: Px − x ⊥ R(P ) or Px − x ∈ R(P ) ⊥ (1899) which corresponds to condition 2. Yet condition 3 is a generalization of subspace projection; id est, for unique minimum-distance projection on a closed convex cone K , polar cone −K ∗ plays the role R(P ) ⊥ plays for subspace projection (P R x = x − P R ⊥ x). Indeed, −K ∗ is the algebraic complement in the orthogonal vector sum (p.708) [232] [173,A.3.2.5] K ⊞ −K ∗ = R n ⇔ cone K is closed and convex (1900) Also, given unique minimum-distance projection Px on K satisfying Theorem E.9.2.0.1, then by projection on the algebraic complement via I −P inE.2 we have −K ∗ = {x − Px | x∈ R n } = {x∈ R n | Px = 0} (1901) consequent to Moreau (1904). Recalling any subspace is a closed convex cone E.16 K = R(P ) ⇔ −K ∗ = R(P ) ⊥ (1902) meaning, when a cone is a subspace R(P ) , then the dual cone becomes its orthogonal complement R(P ) ⊥ . [53,2.6.1] In this circumstance, condition 3 becomes coincident with condition 2. The properties of projection on cones following inE.9.2.2 further generalize to subspaces by: (4) K = R(P ) ⇔ −K = R(P ) (1903) E.16 but a proper subspace is not a proper cone (2.7.2.2.1).

678 APPENDIX E. PROJECTION<br />

Projection on cone K is<br />

P K x = (I − 1<br />

τ 2a⋆ a ⋆T )x (1894)<br />

whereas projection on the polar cone −K ∗ is (E.9.2.2.1)<br />

P K ◦x = x − P K x = 1<br />

τ 2a⋆ a ⋆T x (1895)<br />

Negating vector a , this maximization problem (1892) becomes a<br />

minimization (the same problem) and the polar cone becomes the dual cone:<br />

E.9.2<br />

‖x − P K x‖ = − 1 τ minimize a T x<br />

a<br />

subject to ‖a‖ ≤ τ (1896)<br />

a ∈ K ∗<br />

Projection on cone<br />

When convex set C<br />

conditions:<br />

is a cone, there is a finer statement of optimality<br />

E.9.2.0.1 Theorem. Unique projection on cone. [173,A.3.2]<br />

Let K ⊆ R n be a closed convex cone, and K ∗ its dual (2.13.1). Then Px is<br />

the unique minimum-distance projection of x∈ R n on K if and only if<br />

Px ∈ K , 〈Px − x, Px〉 = 0, Px − x ∈ K ∗ (1897)<br />

In words, Px is the unique minimum-distance projection of x on K if<br />

and only if<br />

1) projection Px lies in K<br />

2) direction Px−x is orthogonal to the projection Px<br />

3) direction Px−x lies in the dual cone K ∗ .<br />

As the theorem is stated, it admits projection on K having empty interior;<br />

id est, on convex cones in a proper subspace of R n .<br />

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!