v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

688 APPENDIX E. PROJECTION b C 2 ∂K ⊥ C 1 ∩ C 2 (Pb) + Pb C 1 Figure 142: First several alternating projections (1935) in von Neumann-style projection of point b converging on closest point Pb in intersection of two closed convex sets in R 2 ; C 1 and C 2 are partially drawn in vicinity of their intersection. The pointed normal cone K ⊥ (1964) is translated to Pb , the unique minimum-distance projection of b on intersection. For this particular example, it is possible to start anywhere in a large neighborhood of b and still converge to Pb . The alternating projections are themselves robust with respect to some significant amount of noise because they belong to translated normal cone. number of steps; we find, in fact, the closest point. E.10.0.1.1 Theorem. Kronecker projector. [284,2.7] Given any projection matrices P 1 and P 2 (subspace projectors), then P 1 ⊗ P 2 and P 1 ⊗ I (1925) are projection matrices. The product preserves symmetry if present. ⋄ E.10.0.2 noncommutative projectors Typically, one considers the method of alternating projection when projectors do not commute; id est, when P 1 P 2 ≠P 2 P 1 . The iconic example for noncommutative projectors illustrated in Figure 142 shows the iterates converging to the closest point in the intersection of two arbitrary convex sets. Yet simple examples like Figure 143 reveal that noncommutative alternating projection does not

E.10. ALTERNATING PROJECTION 689 b H 1 H 2 P 2 b H 1 ∩ H 2 Pb P 1 P 2 b Figure 143: The sets {C k } in this example comprise two halfspaces H 1 and H 2 . The von Neumann-style alternating projection in R 2 quickly converges to P 1 P 2 b (feasibility). The unique minimum-distance projection on the intersection is, of course, Pb . always yield the closest point, although we shall show it always yields some point in the intersection or a point that attains the distance between two convex sets. Alternating projection is also known as successive projection [152] [149] [55], cyclic projection [123] [224,3.2], successive approximation [69], or projection on convex sets [282] [283,6.4]. It is traced back to von Neumann (1933) [322] and later Wiener [328] who showed that higher iterates of a product of two orthogonal projections on subspaces converge at each point in the ambient space to the unique minimum-distance projection on the intersection of the two subspaces. More precisely, if R 1 and R 2 are closed subspaces of a Euclidean space and P 1 and P 2 respectively denote orthogonal projection on R 1 and R 2 , then for each vector b in that space, lim (P 1P 2 ) i b = P R1 ∩ R 2 b (1926) i→∞ Deutsch [92, thm.9.8, thm.9.35] shows rate of convergence for subspaces to be geometric [342,1.4.4]; bounded above by κ 2i+1 ‖b‖ , i=0, 1, 2..., where

688 APPENDIX E. PROJECTION<br />

b<br />

C 2<br />

∂K ⊥ C 1 ∩ C 2<br />

(Pb) + Pb<br />

C 1<br />

Figure 142: First several alternating projections (1935) in<br />

von Neumann-style projection of point b converging on closest point Pb<br />

in intersection of two closed convex sets in R 2 ; C 1 and C 2 are partially<br />

drawn in vicinity of their intersection. The pointed normal cone K ⊥ (1964)<br />

is translated to Pb , the unique minimum-distance projection of b on<br />

intersection. For this particular example, it is possible to start anywhere<br />

in a large neighborhood of b and still converge to Pb . The alternating<br />

projections are themselves robust with respect to some significant amount<br />

of noise because they belong to translated normal cone.<br />

number of steps; we find, in fact, the closest point.<br />

E.10.0.1.1 Theorem. Kronecker projector. [284,2.7]<br />

Given any projection matrices P 1 and P 2 (subspace projectors), then<br />

P 1 ⊗ P 2 and P 1 ⊗ I (1925)<br />

are projection matrices. The product preserves symmetry if present. ⋄<br />

E.10.0.2<br />

noncommutative projectors<br />

Typically, one considers the method of alternating projection when projectors<br />

do not commute; id est, when P 1 P 2 ≠P 2 P 1 .<br />

The iconic example for noncommutative projectors illustrated in<br />

Figure 142 shows the iterates converging to the closest point in the<br />

intersection of two arbitrary convex sets. Yet simple examples like<br />

Figure 143 reveal that noncommutative alternating projection does not

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!