v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
192 CHAPTER 2. CONVEX GEOMETRY 2.13.11.1 conic coordinate computation The foregoing proof of the conic coordinates theorem is not constructive; it establishes existence of dual extreme directions {Γj ∗ } that will reconstruct a point x from its coordinates t ⋆ (x) via (435), but does not prescribe the index set I . There are at least two computational methods for specifying {Γj(i) ∗ } : one is combinatorial but sure to succeed, the other is a geometric method that searches for a minimum of a nonconvex function. We describe the latter: Convex problem (P) (P) maximize t t∈R subject to x − tv ∈ K minimize λ T x λ∈R n subject to λ T v = 1 λ ∈ K ∗ (D) (436) is equivalent to definition (432) whereas convex problem (D) is its dual; 2.75 meaning, primal and dual optimal objectives are equal t ⋆ = λ ⋆T x assuming Slater’s condition (p.256) is satisfied. Under this assumption of strong duality, λ ⋆T (x − t ⋆ v)= t ⋆ (1 − λ ⋆T v)=0; which implies, the primal problem is equivalent to minimize λ ⋆T (x − tv) t∈R (P) (437) subject to x − tv ∈ K while the dual problem is equivalent to minimize λ T (x − t ⋆ v) λ∈R n subject to λ T v = 1 (D) (438) λ ∈ K ∗ Instead given coordinates t ⋆ (x) and a description of cone K , we propose inversion by alternating solution of primal and dual problems 2.75 Form the Lagrangian associated with primal problem (P): L(t, λ) = t + λ T (x − tv) = λ T x + t(1 − λ T v) , λ ≽ K ∗ 0 sup L(t, λ) = λ T x , 1 − λ T v = 0 t
2.13. DUAL CONE & GENERALIZED INEQUALITY 193 N∑ minimize Γ ∗T x∈R n i (x − t ⋆ iΓ i ) i=1 subject to x − t ⋆ iΓ i ∈ K , i=1... N (439) N∑ minimize Γ ∗T Γ ∗ i (x ⋆ − t ⋆ iΓ i ) i ∈Rn i=1 subject to Γ ∗T i Γ i = 1 , Γ ∗ i ∈ K ∗ , i=1... N i=1... N (440) where dual extreme directions Γ ∗ i are initialized arbitrarily and ultimately ascertained by the alternation. Convex problems (439) and (440) are iterated until convergence which is guaranteed by virtue of a monotonically nonincreasing real sequence of objective values. Convergence can be fast. The mapping t ⋆ (x) is uniquely inverted when the necessarily nonnegative objective vanishes; id est, when Γ ∗T i (x ⋆ − t ⋆ iΓ i )=0 ∀i. Here, a zero objective can occur only at the true solution x . But this global optimality condition cannot be guaranteed by the alternation because the common objective function, when regarded in both primal x and dual Γ ∗ i variables simultaneously, is generally neither quasiconvex or monotonic. Conversely, a nonzero objective at convergence is a certificate that inversion was not performed properly. A nonzero objective indicates that the global minimum of a multimodal objective function could not be found by this alternation. That is a flaw in this particular iterative algorithm for inversion; not in theory. 2.76 A numerical remedy is to reinitialize the Γ ∗ i to different values. 2.76 The Proof 2.13.11.0.5 that suitable dual extreme directions {Γj ∗ } always exist means that a global optimization algorithm would always find the zero objective of alternation (439) (440); hence, the unique inversion x. But such an algorithm can be combinatorial.
- Page 141 and 142: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 143 and 144: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 145 and 146: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 147 and 148: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 149 and 150: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 151 and 152: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 153 and 154: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 155 and 156: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 157 and 158: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 159 and 160: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 161 and 162: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 163 and 164: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 165 and 166: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 167 and 168: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 169 and 170: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 171 and 172: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 173 and 174: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 175 and 176: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 177 and 178: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 179 and 180: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 181 and 182: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 183 and 184: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 185 and 186: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 187 and 188: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 189 and 190: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 191: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 195 and 196: Chapter 3 Geometry of convex functi
- Page 197 and 198: 3.1. CONVEX FUNCTION 197 f 1 (x) f
- Page 199 and 200: 3.1. CONVEX FUNCTION 199 3.1.3 norm
- Page 201 and 202: 3.1. CONVEX FUNCTION 201 A B 1 Figu
- Page 203 and 204: 3.1. CONVEX FUNCTION 203 k/m 1 0.9
- Page 205 and 206: k∑ i=1 3.1. CONVEX FUNCTION 205 S
- Page 207 and 208: 3.1. CONVEX FUNCTION 207 rather x >
- Page 209 and 210: 3.1. CONVEX FUNCTION 209 rather ] x
- Page 211 and 212: 3.1. CONVEX FUNCTION 211 3.1.6.0.2
- Page 213 and 214: 3.1. CONVEX FUNCTION 213 q(x) f(x)
- Page 215 and 216: 3.1. CONVEX FUNCTION 215 3.1.7.0.2
- Page 217 and 218: 3.1. CONVEX FUNCTION 217 We learned
- Page 219 and 220: 3.1. CONVEX FUNCTION 219 Since opti
- Page 221 and 222: 3.1. CONVEX FUNCTION 221 2 1.5 1 0.
- Page 223 and 224: 3.1. CONVEX FUNCTION 223 Setting th
- Page 225 and 226: 3.1. CONVEX FUNCTION 225 Similarly,
- Page 227 and 228: 3.1. CONVEX FUNCTION 227 For vector
- Page 229 and 230: 3.1. CONVEX FUNCTION 229 This means
- Page 231 and 232: 3.1. CONVEX FUNCTION 231 f(Y ) −
- Page 233 and 234: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 235 and 236: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 237 and 238: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 239 and 240: 3.3. QUASICONVEX 239 exponential al
- Page 241 and 242: 3.3. QUASICONVEX 241 Unlike convex
192 CHAPTER 2. CONVEX GEOMETRY<br />
2.13.11.1 conic coordinate computation<br />
The foregoing proof of the conic coordinates theorem is not constructive; it<br />
establishes existence of dual extreme directions {Γj ∗ } that will reconstruct<br />
a point x from its coordinates t ⋆ (x) via (435), but does not prescribe the<br />
index set I . There are at least two computational methods for specifying<br />
{Γj(i) ∗ } : one is combinatorial but sure to succeed, the other is a geometric<br />
method that searches for a minimum of a nonconvex function. We describe<br />
the latter:<br />
<strong>Convex</strong> problem (P)<br />
(P)<br />
maximize t<br />
t∈R<br />
subject to x − tv ∈ K<br />
minimize λ T x<br />
λ∈R n<br />
subject to λ T v = 1<br />
λ ∈ K ∗ (D) (436)<br />
is equivalent to definition (432) whereas convex problem (D) is its dual; 2.75<br />
meaning, primal and dual optimal objectives are equal t ⋆ = λ ⋆T x assuming<br />
Slater’s condition (p.256) is satisfied. Under this assumption of strong<br />
duality, λ ⋆T (x − t ⋆ v)= t ⋆ (1 − λ ⋆T v)=0; which implies, the primal problem<br />
is equivalent to<br />
minimize λ ⋆T (x − tv)<br />
t∈R<br />
(P) (437)<br />
subject to x − tv ∈ K<br />
while the dual problem is equivalent to<br />
minimize λ T (x − t ⋆ v)<br />
λ∈R n<br />
subject to λ T v = 1 (D) (438)<br />
λ ∈ K ∗<br />
Instead given coordinates t ⋆ (x) and a description of cone K , we propose<br />
inversion by alternating solution of primal and dual problems<br />
2.75 Form the Lagrangian associated with primal problem (P):<br />
L(t, λ) = t + λ T (x − tv) = λ T x + t(1 − λ T v) ,<br />
λ ≽<br />
K ∗ 0<br />
sup L(t, λ) = λ T x , 1 − λ T v = 0<br />
t