v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
354 CHAPTER 4. SEMIDEFINITE PROGRAMMINGThis is transformed to an equivalent convex problem by moving the rankconstraint to the objective: We iterate solution ofwithminimize 〈G , Y 〉X∈S N , x∈R Nsubject to Ax = b[X CxG =x T C T 1trX = 1minimizeY ∈ S N+1 〈G ⋆ , Y 〉subject to 0 ≼ Y ≼ ItrY = N]≽ 0(782)(783)until convergence. Direction matrix Y ∈ S N+1 , initially 0, regulates rank.(1700a) Singular value decomposition G ⋆ = UΣQ T ∈ S N+1+ (A.6) provides anew direction matrix Y = U(:, 2:N+1)U(:, 2:N+1) T that optimally solves(783) at each iteration. An optimal solution to (779) is thereby found in afew iterations, making convex problem (782) its equivalent.It remains possible for the iteration to stall; were a rank-1 G matrix notfound. In that case, the current search direction is momentarily reversedwith an added randomized element:Y = −U(:,2:N+1) ∗ (U(:,2:N+1) ′ + randn(N,1) ∗U(:,1) ′ ) (784)in Matlab notation. This heuristic is quite effective for problem (779) whichis exceptionally easy to solve by convex iteration.When b /∈R(A) then problem (779) must be restated as a projection:minimize ‖Ax − b‖x∈R Nsubject to ‖Cx‖ = 1(785)This is a projection of point b on an ellipsoid boundary because any affinetransformation of an ellipsoid remains an ellipsoid. Problem (782) in turnbecomesminimize 〈G , Y 〉 + ‖Ax − b‖X∈S N , x∈R N[ ]X Cxsubject to G =x T C T ≽ 0 (786)1trX = 1
4.6. CARDINALITY AND RANK CONSTRAINT EXAMPLES 355We iterate this with calculation (783) of direction matrix Y as before untila rank-1 G matrix is found.4.6.0.0.2 Example. Procrustes problem. [52]Example 4.6.0.0.1 is extensible. An orthonormal matrix Q∈ R n×p ischaracterized Q T Q = I . Consider the particular case Q = [x y ]∈ R n×2 asvariable to a Procrustes problem (C.3): given A∈ R m×n and B ∈ R m×2minimize ‖AQ − B‖ FQ∈R n×2subject to Q T Q = I(787)which is nonconvex. By vectorizing matrix Q we can make the assignment:⎡ ⎤ ⎡ ⎤ ⎡ ⎤x [ x T y T 1] X Z x xx T xy T xG = ⎣ y ⎦ = ⎣ Z T Y y ⎦⎣yx T yy T y ⎦∈ S 2n+1 (788)1x T y T 1 x T y T 1Now orthonormal Procrustes problem (787) can be equivalently restated:minimizeX , Y ∈ S , Z , x , y‖A[x y ] − B‖ F⎡X Z⎤xsubject to G = ⎣ Z T Y y ⎦(≽ 0)x T y T 1rankG = 1trX = 1trY = 1trZ = 0(789)To solve this, we form the convex problem sequence:minimizeX , Y , Z , x , y‖A[x y ] −B‖ F + 〈G , W 〉⎡X Z⎤xsubject to G = ⎣ Z T Y y ⎦ ≽ 0x T y T 1trX = 1trY = 1trZ = 0(790)
- Page 303 and 304: 4.3. RANK REDUCTION 303(t ⋆ i)
- Page 305 and 306: 4.3. RANK REDUCTION 3054.3.3.0.1 Ex
- Page 307 and 308: 4.3. RANK REDUCTION 3074.3.3.0.2 Ex
- Page 309 and 310: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 311 and 312: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 313 and 314: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 315 and 316: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 317 and 318: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 319 and 320: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 321 and 322: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 323 and 324: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 325 and 326: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 327 and 328: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 329 and 330: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 331 and 332: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 333 and 334: 4.5. CONSTRAINING CARDINALITY 333mi
- Page 335 and 336: 4.5. CONSTRAINING CARDINALITY 3350R
- Page 337 and 338: 4.5. CONSTRAINING CARDINALITY 337it
- Page 339 and 340: 4.5. CONSTRAINING CARDINALITY 339m/
- Page 341 and 342: 4.5. CONSTRAINING CARDINALITY 341we
- Page 343 and 344: 4.5. CONSTRAINING CARDINALITY 343fl
- Page 345 and 346: 4.5. CONSTRAINING CARDINALITY 345We
- Page 347 and 348: 4.5. CONSTRAINING CARDINALITY 3474.
- Page 349 and 350: 4.5. CONSTRAINING CARDINALITY 349R
- Page 351 and 352: 4.5. CONSTRAINING CARDINALITY 351pe
- Page 353: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 357 and 358: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 359 and 360: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 361 and 362: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 363 and 364: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 365 and 366: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 367 and 368: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 369 and 370: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 371 and 372: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 373 and 374: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 375 and 376: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 377 and 378: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 379 and 380: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 381 and 382: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 383 and 384: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 385 and 386: 4.7. CONSTRAINING RANK OF INDEFINIT
- Page 387 and 388: 4.7. CONSTRAINING RANK OF INDEFINIT
- Page 389 and 390: 4.7. CONSTRAINING RANK OF INDEFINIT
- Page 391 and 392: 4.8. CONVEX ITERATION RANK-1 391whi
- Page 393 and 394: 4.8. CONVEX ITERATION RANK-1 393the
- Page 395 and 396: Chapter 5Euclidean Distance MatrixT
- Page 397 and 398: 5.2. FIRST METRIC PROPERTIES 397to
- Page 399 and 400: 5.3. ∃ FIFTH EUCLIDEAN METRIC PRO
- Page 401 and 402: 5.3. ∃ FIFTH EUCLIDEAN METRIC PRO
- Page 403 and 404: 5.4. EDM DEFINITION 403The collecti
4.6. CARDINALITY AND RANK CONSTRAINT EXAMPLES 355We iterate this with calculation (783) of direction matrix Y as before untila rank-1 G matrix is found.4.6.0.0.2 Example. Procrustes problem. [52]Example 4.6.0.0.1 is extensible. An orthonormal matrix Q∈ R n×p ischaracterized Q T Q = I . Consider the particular case Q = [x y ]∈ R n×2 asvariable to a Procrustes problem (C.3): given A∈ R m×n and B ∈ R m×2minimize ‖AQ − B‖ FQ∈R n×2subject to Q T Q = I(787)which is nonconvex. By vectorizing matrix Q we can make the assignment:⎡ ⎤ ⎡ ⎤ ⎡ ⎤x [ x T y T 1] X Z x xx T xy T xG = ⎣ y ⎦ = ⎣ Z T Y y ⎦⎣yx T yy T y ⎦∈ S 2n+1 (788)1x T y T 1 x T y T 1Now orthonormal Procrustes problem (787) can be equivalently restated:minimizeX , Y ∈ S , Z , x , y‖A[x y ] − B‖ F⎡X Z⎤xsubject to G = ⎣ Z T Y y ⎦(≽ 0)x T y T 1rankG = 1trX = 1trY = 1trZ = 0(789)To solve this, we form the convex problem sequence:minimizeX , Y , Z , x , y‖A[x y ] −B‖ F + 〈G , W 〉⎡X Z⎤xsubject to G = ⎣ Z T Y y ⎦ ≽ 0x T y T 1trX = 1trY = 1trZ = 0(790)