v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

192 CHAPTER 2. CONVEX GEOMETRY 2.13.11.1 conic coordinate computation The foregoing proof of the conic coordinates theorem is not constructive; it establishes existence of dual extreme directions {Γj ∗ } that will reconstruct a point x from its coordinates t ⋆ (x) via (435), but does not prescribe the index set I . There are at least two computational methods for specifying {Γj(i) ∗ } : one is combinatorial but sure to succeed, the other is a geometric method that searches for a minimum of a nonconvex function. We describe the latter: Convex problem (P) (P) maximize t t∈R subject to x − tv ∈ K minimize λ T x λ∈R n subject to λ T v = 1 λ ∈ K ∗ (D) (436) is equivalent to definition (432) whereas convex problem (D) is its dual; 2.75 meaning, primal and dual optimal objectives are equal t ⋆ = λ ⋆T x assuming Slater’s condition (p.256) is satisfied. Under this assumption of strong duality, λ ⋆T (x − t ⋆ v)= t ⋆ (1 − λ ⋆T v)=0; which implies, the primal problem is equivalent to minimize λ ⋆T (x − tv) t∈R (P) (437) subject to x − tv ∈ K while the dual problem is equivalent to minimize λ T (x − t ⋆ v) λ∈R n subject to λ T v = 1 (D) (438) λ ∈ K ∗ Instead given coordinates t ⋆ (x) and a description of cone K , we propose inversion by alternating solution of primal and dual problems 2.75 Form the Lagrangian associated with primal problem (P): L(t, λ) = t + λ T (x − tv) = λ T x + t(1 − λ T v) , λ ≽ K ∗ 0 sup L(t, λ) = λ T x , 1 − λ T v = 0 t

2.13. DUAL CONE & GENERALIZED INEQUALITY 193 N∑ minimize Γ ∗T x∈R n i (x − t ⋆ iΓ i ) i=1 subject to x − t ⋆ iΓ i ∈ K , i=1... N (439) N∑ minimize Γ ∗T Γ ∗ i (x ⋆ − t ⋆ iΓ i ) i ∈Rn i=1 subject to Γ ∗T i Γ i = 1 , Γ ∗ i ∈ K ∗ , i=1... N i=1... N (440) where dual extreme directions Γ ∗ i are initialized arbitrarily and ultimately ascertained by the alternation. Convex problems (439) and (440) are iterated until convergence which is guaranteed by virtue of a monotonically nonincreasing real sequence of objective values. Convergence can be fast. The mapping t ⋆ (x) is uniquely inverted when the necessarily nonnegative objective vanishes; id est, when Γ ∗T i (x ⋆ − t ⋆ iΓ i )=0 ∀i. Here, a zero objective can occur only at the true solution x . But this global optimality condition cannot be guaranteed by the alternation because the common objective function, when regarded in both primal x and dual Γ ∗ i variables simultaneously, is generally neither quasiconvex or monotonic. Conversely, a nonzero objective at convergence is a certificate that inversion was not performed properly. A nonzero objective indicates that the global minimum of a multimodal objective function could not be found by this alternation. That is a flaw in this particular iterative algorithm for inversion; not in theory. 2.76 A numerical remedy is to reinitialize the Γ ∗ i to different values. 2.76 The Proof 2.13.11.0.5 that suitable dual extreme directions {Γj ∗ } always exist means that a global optimization algorithm would always find the zero objective of alternation (439) (440); hence, the unique inversion x. But such an algorithm can be combinatorial.

192 CHAPTER 2. CONVEX GEOMETRY<br />

2.13.11.1 conic coordinate computation<br />

The foregoing proof of the conic coordinates theorem is not constructive; it<br />

establishes existence of dual extreme directions {Γj ∗ } that will reconstruct<br />

a point x from its coordinates t ⋆ (x) via (435), but does not prescribe the<br />

index set I . There are at least two computational methods for specifying<br />

{Γj(i) ∗ } : one is combinatorial but sure to succeed, the other is a geometric<br />

method that searches for a minimum of a nonconvex function. We describe<br />

the latter:<br />

<strong>Convex</strong> problem (P)<br />

(P)<br />

maximize t<br />

t∈R<br />

subject to x − tv ∈ K<br />

minimize λ T x<br />

λ∈R n<br />

subject to λ T v = 1<br />

λ ∈ K ∗ (D) (436)<br />

is equivalent to definition (432) whereas convex problem (D) is its dual; 2.75<br />

meaning, primal and dual optimal objectives are equal t ⋆ = λ ⋆T x assuming<br />

Slater’s condition (p.256) is satisfied. Under this assumption of strong<br />

duality, λ ⋆T (x − t ⋆ v)= t ⋆ (1 − λ ⋆T v)=0; which implies, the primal problem<br />

is equivalent to<br />

minimize λ ⋆T (x − tv)<br />

t∈R<br />

(P) (437)<br />

subject to x − tv ∈ K<br />

while the dual problem is equivalent to<br />

minimize λ T (x − t ⋆ v)<br />

λ∈R n<br />

subject to λ T v = 1 (D) (438)<br />

λ ∈ K ∗<br />

Instead given coordinates t ⋆ (x) and a description of cone K , we propose<br />

inversion by alternating solution of primal and dual problems<br />

2.75 Form the Lagrangian associated with primal problem (P):<br />

L(t, λ) = t + λ T (x − tv) = λ T x + t(1 − λ T v) ,<br />

λ ≽<br />

K ∗ 0<br />

sup L(t, λ) = λ T x , 1 − λ T v = 0<br />

t

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!