v2010.10.26 - Convex Optimization

v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
12.07.2015 Views

570 CHAPTER 7. PROXIMITY PROBLEMSConfinement of G to the geometric center subspace provides numericalstability and no loss of generality (confer (1246)); implicit constraint G1 = 0is otherwise unnecessary.To include constraints on the list X ∈ R n×N , we would first rewrite (1360)minimize − tr(V (D(G) − 2Y )V )G∈S N c , Y ∈ SN h , X∈ Rn×N [ ]〈Φij , G〉 y ijsubject to≽ 0 ,y ijh 2 ij[ ] I XX T ≽ 0GX ∈ CN ≥ j > i = 1... N −1(1361)and then add the constraints, realized here in abstract membership to someconvex set C . This problem realization includes a convex relaxation of thenonconvex constraint G = X T X and, if desired, more constraints on G couldbe added. This technique is discussed in5.4.2.3.5.7.2.2 Minimization of affine dimension in Problem 2When desired affine dimension ρ is diminished, the rank function becomesreinserted into problem (1355) that is then rendered difficult to solve becausefeasible set {D , Y } loses convexity in S N h × R N×N . Indeed, the rank functionis quasiconcave (3.8) on the positive semidefinite cone; (2.9.2.9.2) id est,its sublevel sets are not convex.7.2.2.1 Rank minimization heuristicA remedy developed in [262] [135] [136] [134] introduces convex envelope ofthe quasiconcave rank function: (Figure 154)7.2.2.1.1 Definition. Convex envelope. [198]Convex envelope cenv f of a function f : C →R is defined to be the largestconvex function g such that g ≤ f on convex domain C ⊆ R n . 7.16 △7.16 Provided f ≢+∞ and there exists an affine function h ≤f on R n , then the convexenvelope is equal to the convex conjugate (the Legendre-Fenchel transform) of the convexconjugate of f ; id est, the conjugate-conjugate function f ∗∗ . [199,E.1]

7.2. SECOND PREVALENT PROBLEM: 571rankXgcenv rankXFigure 154: Abstraction of convex envelope of rank function. Rank is aquasiconcave function on positive semidefinite cone, but its convex envelopeis the largest convex function whose epigraph contains it. Vertical barlabelled g measures a trace/rank gap; id est, rank found always exceedsestimate; large decline in trace required here for only small decrease in rank.

570 CHAPTER 7. PROXIMITY PROBLEMSConfinement of G to the geometric center subspace provides numericalstability and no loss of generality (confer (1246)); implicit constraint G1 = 0is otherwise unnecessary.To include constraints on the list X ∈ R n×N , we would first rewrite (1360)minimize − tr(V (D(G) − 2Y )V )G∈S N c , Y ∈ SN h , X∈ Rn×N [ ]〈Φij , G〉 y ijsubject to≽ 0 ,y ijh 2 ij[ ] I XX T ≽ 0GX ∈ CN ≥ j > i = 1... N −1(1361)and then add the constraints, realized here in abstract membership to someconvex set C . This problem realization includes a convex relaxation of thenonconvex constraint G = X T X and, if desired, more constraints on G couldbe added. This technique is discussed in5.4.2.3.5.7.2.2 Minimization of affine dimension in Problem 2When desired affine dimension ρ is diminished, the rank function becomesreinserted into problem (1355) that is then rendered difficult to solve becausefeasible set {D , Y } loses convexity in S N h × R N×N . Indeed, the rank functionis quasiconcave (3.8) on the positive semidefinite cone; (2.9.2.9.2) id est,its sublevel sets are not convex.7.2.2.1 Rank minimization heuristicA remedy developed in [262] [135] [136] [134] introduces convex envelope ofthe quasiconcave rank function: (Figure 154)7.2.2.1.1 Definition. <strong>Convex</strong> envelope. [198]<strong>Convex</strong> envelope cenv f of a function f : C →R is defined to be the largestconvex function g such that g ≤ f on convex domain C ⊆ R n . 7.16 △7.16 Provided f ≢+∞ and there exists an affine function h ≤f on R n , then the convexenvelope is equal to the convex conjugate (the Legendre-Fenchel transform) of the convexconjugate of f ; id est, the conjugate-conjugate function f ∗∗ . [199,E.1]

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!