v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
272 CHAPTER 4. SEMIDEFINITE PROGRAMMING (t ⋆ i) −1 = max {ψ(Z i )λ(Z i ) j , j =1... ρ} (649) When Z i is indefinite, the direction of perturbation (determined by ψ(Z i )) is arbitrary. We may take an early exit from the Procedure were Z i to become 0 or were rank [ svec R T iA 1 R i svec R T iA 2 R i · · · svec R T iA m R i ] = ρ(ρ + 1)/2 (650) which characterizes the rank ρ of any [sic] extreme point in A ∩ S n + . [206,2.4] [207] Proof. Assuming the form of every perturbation matrix is indeed (643), then by (646) svec Z i ⊥ [ svec(R T iA 1 R i ) svec(R T iA 2 R i ) · · · svec(R T iA m R i ) ] (651) By orthogonal complement we have rank [ svec(R T iA 1 R i ) · · · svec(R T iA m R i ) ] ⊥ + rank [ svec(R T iA 1 R i ) · · · svec(R T iA m R i ) ] = ρ(ρ + 1)/2 (652) When Z i can only be 0, then the perturbation is null because an extreme point has been found; thus [ svec(R T i A 1 R i ) · · · svec(R T iA m R i ) ] ⊥ = 0 (653) from which the stated result (650) directly follows.
4.3. RANK REDUCTION 273 4.3.3 Optimality of perturbed X ⋆ We show that the optimal objective value is unaltered by perturbation (643); id est, i∑ 〈C , X ⋆ + t j B j 〉 = 〈C , X ⋆ 〉 (654) j=1 Proof. From Corollary 4.2.3.0.1 we have the necessary and sufficient relationship between optimal primal and dual solutions under the assumption of existence of a relatively interior feasible point: S ⋆ X ⋆ = S ⋆ R 1 R T 1 = X ⋆ S ⋆ = R 1 R T 1 S ⋆ = 0 (655) This means R(R 1 ) ⊆ N(S ⋆ ) and R(S ⋆ ) ⊆ N(R T 1 ). From (644) and (647) we get the sequence: X ⋆ = R 1 R1 T X ⋆ + t 1 B 1 = R 2 R2 T = R 1 (I − t 1 ψ(Z 1 )Z 1 )R1 T X ⋆ + t 1 B 1 + t 2 B 2 = R 3 R3 T = R 2 (I − t 2 ψ(Z 2 )Z 2 )R2 T = R 1 (I − t 1 ψ(Z 1 )Z 1 )(I − t 2 ψ(Z 2 )Z 2 )R1 T . ( ) ∑ X ⋆ + i i∏ t j B j = R 1 (I − t j ψ(Z j )Z j ) R1 T (656) j=1 j=1 Substituting C = svec −1 (A T y ⋆ ) + S ⋆ from (584), ( ) ∑ 〈C , X ⋆ + i i∏ t j B j 〉 = 〈svec −1 (A T y ⋆ ) + S ⋆ , R 1 (I − t j ψ(Z j )Z j ) j=1 〈 〉 m∑ = yk ⋆A ∑ k , X ⋆ + i t j B j k=1 j=1 j=1 〈 m 〉 ∑ = yk ⋆A k + S ⋆ , X ⋆ = 〈C , X ⋆ 〉 (657) k=1 R T 1 〉 because 〈B i , A j 〉=0 ∀i, j by design (640).
- Page 221 and 222: 3.1. CONVEX FUNCTION 221 2 1.5 1 0.
- Page 223 and 224: 3.1. CONVEX FUNCTION 223 Setting th
- Page 225 and 226: 3.1. CONVEX FUNCTION 225 Similarly,
- Page 227 and 228: 3.1. CONVEX FUNCTION 227 For vector
- Page 229 and 230: 3.1. CONVEX FUNCTION 229 This means
- Page 231 and 232: 3.1. CONVEX FUNCTION 231 f(Y ) −
- Page 233 and 234: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 235 and 236: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 237 and 238: 3.2. MATRIX-VALUED CONVEX FUNCTION
- Page 239 and 240: 3.3. QUASICONVEX 239 exponential al
- Page 241 and 242: 3.3. QUASICONVEX 241 Unlike convex
- Page 243 and 244: 3.4. SALIENT PROPERTIES 243 6. (af
- Page 245 and 246: Chapter 4 Semidefinite programming
- Page 247 and 248: 4.1. CONIC PROBLEM 247 where K is a
- Page 249 and 250: 4.1. CONIC PROBLEM 249 4.1.1.2 Redu
- Page 251 and 252: 4.1. CONIC PROBLEM 251 In any SDP f
- Page 253 and 254: 4.1. CONIC PROBLEM 253 Proposition
- Page 255 and 256: 4.2. FRAMEWORK 255 sets are closed
- Page 257 and 258: 4.2. FRAMEWORK 257 4.2.1.1.3 Exampl
- Page 259 and 260: 4.2. FRAMEWORK 259 4.2.2 Duals The
- Page 261 and 262: 4.2. FRAMEWORK 261 When equality is
- Page 263 and 264: 4.2. FRAMEWORK 263 The pseudoinvers
- Page 265 and 266: 4.2. FRAMEWORK 265 For the data giv
- Page 267 and 268: 4.2. FRAMEWORK 267 minimizes an aff
- Page 269 and 270: 4.3. RANK REDUCTION 269 whose rank
- Page 271: 4.3. RANK REDUCTION 271 and where m
- Page 275 and 276: 4.3. RANK REDUCTION 275 Initialize:
- Page 277 and 278: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 279 and 280: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 281 and 282: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 283 and 284: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 285 and 286: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 287 and 288: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 289 and 290: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 291 and 292: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 293 and 294: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 295 and 296: 4.5. CONSTRAINING CARDINALITY 295 m
- Page 297 and 298: 4.5. CONSTRAINING CARDINALITY 297 m
- Page 299 and 300: 4.5. CONSTRAINING CARDINALITY 299 a
- Page 301 and 302: 4.5. CONSTRAINING CARDINALITY 301 f
- Page 303 and 304: 4.5. CONSTRAINING CARDINALITY 303 n
- Page 305 and 306: 4.5. CONSTRAINING CARDINALITY 305 W
- Page 307 and 308: 4.5. CONSTRAINING CARDINALITY 307 t
- Page 309 and 310: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 311 and 312: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 313 and 314: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 315 and 316: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 317 and 318: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 319 and 320: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 321 and 322: 4.6. CARDINALITY AND RANK CONSTRAIN
4.3. RANK REDUCTION 273<br />
4.3.3 Optimality of perturbed X ⋆<br />
We show that the optimal objective value is unaltered by perturbation (643);<br />
id est,<br />
i∑<br />
〈C , X ⋆ + t j B j 〉 = 〈C , X ⋆ 〉 (654)<br />
j=1<br />
Proof. From Corollary 4.2.3.0.1 we have the necessary and sufficient<br />
relationship between optimal primal and dual solutions under the assumption<br />
of existence of a relatively interior feasible point:<br />
S ⋆ X ⋆ = S ⋆ R 1 R T 1 = X ⋆ S ⋆ = R 1 R T 1 S ⋆ = 0 (655)<br />
This means R(R 1 ) ⊆ N(S ⋆ ) and R(S ⋆ ) ⊆ N(R T 1 ). From (644) and (647)<br />
we get the sequence:<br />
X ⋆ = R 1 R1<br />
T<br />
X ⋆ + t 1 B 1 = R 2 R2 T = R 1 (I − t 1 ψ(Z 1 )Z 1 )R1<br />
T<br />
X ⋆ + t 1 B 1 + t 2 B 2 = R 3 R3 T = R 2 (I − t 2 ψ(Z 2 )Z 2 )R2 T = R 1 (I − t 1 ψ(Z 1 )Z 1 )(I − t 2 ψ(Z 2 )Z 2 )R1<br />
T<br />
.<br />
(<br />
)<br />
∑<br />
X ⋆ + i i∏<br />
t j B j = R 1 (I − t j ψ(Z j )Z j ) R1 T (656)<br />
j=1<br />
j=1<br />
Substituting C = svec −1 (A T y ⋆ ) + S ⋆ from (584),<br />
(<br />
)<br />
∑<br />
〈C , X ⋆ + i i∏<br />
t j B j 〉 =<br />
〈svec −1 (A T y ⋆ ) + S ⋆ , R 1 (I − t j ψ(Z j )Z j )<br />
j=1<br />
〈<br />
〉<br />
m∑<br />
= yk ⋆A ∑<br />
k , X ⋆ + i t j B j<br />
k=1<br />
j=1<br />
j=1<br />
〈 m<br />
〉<br />
∑<br />
= yk ⋆A k + S ⋆ , X ⋆ = 〈C , X ⋆ 〉 (657)<br />
k=1<br />
R T 1<br />
〉<br />
because 〈B i , A j 〉=0 ∀i, j by design (640).