v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
368 CHAPTER 4. SEMIDEFINITE PROGRAMMINGTo transform max cut to its convex equivalent, first defineX = xx T ∈ S n (830)then max cut (822) becomesmaximize1X∈ S n 4〈X , δ(A1) − A〉subject to δ(X) = 1(X ≽ 0)rankX = 1(826)whose rank constraint can be regularized as inmaximize1X∈ S n 4subject to δ(X) = 1X ≽ 0〈X , δ(A1) − A〉 − w〈X , W 〉(827)where w ≈1000 is a nonnegative fixed weight, and W is a direction matrixdetermined fromn∑λ(X ⋆ ) ii=2= minimizeW ∈ S n 〈X ⋆ , W 〉subject to 0 ≼ W ≼ ItrW = n − 1(1700a)which has an optimal solution that is known in closed form. These twoproblems (827) and (1700a) are iterated until convergence as defined onpage 309.Because convex problem statement (827) is so elegant, it is numericallysolvable for large binary vectors within reasonable time. 4.41 To test ourconvex iterative method, we compare an optimal convex result to anactual solution of the max cut problem found by performing a brute forcecombinatorial search of (822) 4.42 for a tight upper bound. Search-time limitsbinary vector lengths to 24 bits (about five days CPU time). 98% accuracy,4.41 We solved for a length-250 binary vector in only a few minutes and convex iterationson a 2006 vintage laptop Core 2 CPU (Intel T7400@2.16GHz, 666MHz FSB).4.42 more computationally intensive than the proposed convex iteration by many ordersof magnitude. Solving max cut by searching over all binary vectors of length 100, forexample, would occupy a contemporary supercomputer for a million years.
4.6. CARDINALITY AND RANK CONSTRAINT EXAMPLES 369actually obtained, is independent of binary vector length (12, 13, 20, 24)when averaged over more than 231 problem instances including planar,randomized, and toroidal graphs. 4.43 When failure occurred, large andsmall errors were manifest. That same 98% average accuracy is presumedmaintained when binary vector length is further increased. A Matlabprogram is provided on Wıκımization.4.6.0.0.11 Example. Cardinality/rank problem.d’Aspremont, El Ghaoui, Jordan, & Lanckriet [95] propose approximating apositive semidefinite matrix A∈ S N + by a rank-one matrix having constrainton cardinality c : for 0 < c < Nminimize ‖A − zz T ‖ Fzsubject to cardz ≤ c(828)which, they explain, is a hard problem equivalent tomaximize x T Axxsubject to ‖x‖ = 1card x ≤ c(829)where z √ λx and where optimal solution x ⋆ is a principal eigenvector(1694) (A.5) of A and λ = x ⋆T Ax ⋆ is the principal eigenvalue [159, p.331]when c is true cardinality of that eigenvector. This is principal componentanalysis with a cardinality constraint which controls solution sparsity. Definethe matrix variableX xx T ∈ S N (830)whose desired rank is 1, and whose desired diagonal cardinalitycardδ(X) ≡ cardx (831)4.43 Existence of a polynomial-time approximation to max cut with accuracy provablybetter than 94.11% would refute NP-hardness; which Håstad believes to be highly unlikely.[181, thm.8.2] [182]
- Page 317 and 318: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 319 and 320: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 321 and 322: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 323 and 324: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 325 and 326: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 327 and 328: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 329 and 330: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 331 and 332: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 333 and 334: 4.5. CONSTRAINING CARDINALITY 333mi
- Page 335 and 336: 4.5. CONSTRAINING CARDINALITY 3350R
- Page 337 and 338: 4.5. CONSTRAINING CARDINALITY 337it
- Page 339 and 340: 4.5. CONSTRAINING CARDINALITY 339m/
- Page 341 and 342: 4.5. CONSTRAINING CARDINALITY 341we
- Page 343 and 344: 4.5. CONSTRAINING CARDINALITY 343fl
- Page 345 and 346: 4.5. CONSTRAINING CARDINALITY 345We
- Page 347 and 348: 4.5. CONSTRAINING CARDINALITY 3474.
- Page 349 and 350: 4.5. CONSTRAINING CARDINALITY 349R
- Page 351 and 352: 4.5. CONSTRAINING CARDINALITY 351pe
- Page 353 and 354: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 355 and 356: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 357 and 358: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 359 and 360: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 361 and 362: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 363 and 364: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 365 and 366: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 367: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 371 and 372: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 373 and 374: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 375 and 376: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 377 and 378: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 379 and 380: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 381 and 382: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 383 and 384: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 385 and 386: 4.7. CONSTRAINING RANK OF INDEFINIT
- Page 387 and 388: 4.7. CONSTRAINING RANK OF INDEFINIT
- Page 389 and 390: 4.7. CONSTRAINING RANK OF INDEFINIT
- Page 391 and 392: 4.8. CONVEX ITERATION RANK-1 391whi
- Page 393 and 394: 4.8. CONVEX ITERATION RANK-1 393the
- Page 395 and 396: Chapter 5Euclidean Distance MatrixT
- Page 397 and 398: 5.2. FIRST METRIC PROPERTIES 397to
- Page 399 and 400: 5.3. ∃ FIFTH EUCLIDEAN METRIC PRO
- Page 401 and 402: 5.3. ∃ FIFTH EUCLIDEAN METRIC PRO
- Page 403 and 404: 5.4. EDM DEFINITION 403The collecti
- Page 405 and 406: 5.4. EDM DEFINITION 4055.4.2 Gram-f
- Page 407 and 408: 5.4. EDM DEFINITION 407We provide a
- Page 409 and 410: 5.4. EDM DEFINITION 4095.4.2.3.1 Ex
- Page 411 and 412: 5.4. EDM DEFINITION 411is the fact:
- Page 413 and 414: 5.4. EDM DEFINITION 413Figure 120:
- Page 415 and 416: 5.4. EDM DEFINITION 415is found fro
- Page 417 and 418: 5.4. EDM DEFINITION 417one less dim
368 CHAPTER 4. SEMIDEFINITE PROGRAMMINGTo transform max cut to its convex equivalent, first defineX = xx T ∈ S n (830)then max cut (822) becomesmaximize1X∈ S n 4〈X , δ(A1) − A〉subject to δ(X) = 1(X ≽ 0)rankX = 1(826)whose rank constraint can be regularized as inmaximize1X∈ S n 4subject to δ(X) = 1X ≽ 0〈X , δ(A1) − A〉 − w〈X , W 〉(827)where w ≈1000 is a nonnegative fixed weight, and W is a direction matrixdetermined fromn∑λ(X ⋆ ) ii=2= minimizeW ∈ S n 〈X ⋆ , W 〉subject to 0 ≼ W ≼ ItrW = n − 1(1700a)which has an optimal solution that is known in closed form. These twoproblems (827) and (1700a) are iterated until convergence as defined onpage 309.Because convex problem statement (827) is so elegant, it is numericallysolvable for large binary vectors within reasonable time. 4.41 To test ourconvex iterative method, we compare an optimal convex result to anactual solution of the max cut problem found by performing a brute forcecombinatorial search of (822) 4.42 for a tight upper bound. Search-time limitsbinary vector lengths to 24 bits (about five days CPU time). 98% accuracy,4.41 We solved for a length-250 binary vector in only a few minutes and convex iterationson a 2006 vintage laptop Core 2 CPU (Intel T7400@2.16GHz, 666MHz FSB).4.42 more computationally intensive than the proposed convex iteration by many ordersof magnitude. Solving max cut by searching over all binary vectors of length 100, forexample, would occupy a contemporary supercomputer for a million years.