v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

278 CHAPTER 4. SEMIDEFINITE PROGRAMMING N∑ λ(G ⋆ ) i i=n+1 = minimize W ∈ S N 〈G ⋆ , W 〉 subject to 0 ≼ W ≼ I trW = N − n (1581a) whose feasible set is a Fantope (2.3.2.0.1), and where G ⋆ is an optimal solution to problem (670) given some iterate W . The idea is to iterate solution of (670) and (1581a) until convergence as defined in4.4.1.2. 4.22 Optimal matrix W ⋆ is defined as any direction matrix yielding optimal solution G ⋆ of rank n or less to then convex equivalent (670) of feasibility problem (669); id est, any direction matrix for which the last N − n nonincreasingly ordered eigenvalues λ of G ⋆ are zero: (p.599) N∑ λ(G ⋆ ) i = 〈G ⋆ , W ⋆ 〉 = ∆ 0 (671) i=n+1 We emphasize that convex problem (670) is not a relaxation of the rank-constrained feasibility problem (669); at convergence, convex iteration (670) (1581a) makes it instead an equivalent problem. 4.23 4.4.1.1 direction interpretation We make no assumption regarding uniqueness of direction matrix W . The feasible set of direction matrices in (1581a) is the convex hull of outer product of all rank-(N − n) orthonormal matrices; videlicet, conv { UU T | U ∈ R N×N−n , U T U = I } = { A∈ S N | I ≽ A ≽ 0, 〈I , A 〉= N − n } (82) Set {UU T | U ∈ R N×N−n , U T U = I} comprises the extreme points of this Fantope (82). An optimal solution W to (1581a), that is an extreme point, is known in closed form (p.599). By (205), that particular direction (−W) can be regarded as pointing toward positive semidefinite rank-n matrices that 4.22 The proposed iteration is not an alternating projection. (confer Figure 140) 4.23 Terminology equivalent problem meaning, optimal solution to one problem can be derived from optimal solution to another. Terminology same problem means: optimal solution set for one problem is identical to the optimal solution set of another (without transformation).

4.4. RANK-CONSTRAINED SEMIDEFINITE PROGRAM 279 are simultaneously diagonalizable with G ⋆ . When W = I , as in the trace heuristic for example, then −W points directly at the origin (the rank-0 PSD matrix). Inner product of an optimization variable with the direction matrix W is therefore a generalization of the trace heuristic (7.2.2.1); −W is instead trained toward the boundary of the positive semidefinite cone. 4.4.1.2 convergence We study convergence to ascertain conditions under which a direction matrix will reveal a feasible G matrix of rank n or less in semidefinite program (670). Denote by W ⋆ a particular optimal direction matrix from semidefinite program (1581a) such that (671) holds. Then we define global convergence of the iteration (670) (1581a) to correspond with this vanishing vector inner-product (671) of optimal solutions. Because this iterative technique for constraining rank is not a projection method, it can find a rank-n solution G ⋆ ((671) will be satisfied) only if at least one exists in the feasible set of program (670). 4.4.1.2.1 Proof. Suppose 〈G ⋆ , W 〉= τ is satisfied for some nonnegative constant τ after any particular iteration (670) (1581a) of the two minimization problems. Once a particular value of τ is achieved, it can never be exceeded by subsequent iterations because existence of feasible G and W having that vector inner-product τ has been established simultaneously in each problem. Because the infimum of vector inner-product of two positive semidefinite matrix variables is zero, the nonincreasing sequence of iterations is thus bounded below hence convergent because any bounded monotonic sequence in R is convergent. [222,1.2] [37,1.1] Local convergence to some τ is thereby established. When a rank-n feasible solution to (670) exists, it remains to be shown under what conditions 〈G ⋆ , W ⋆ 〉=0 (671) is achieved by iterative solution of semidefinite programs (670) and (1581a). 4.24 Then pair (G ⋆ , W ⋆ ) becomes a fixed point of iteration. A nonexistent feasible rank-n solution would mean certain failure to converge by definition (671) but, as proved, convex iteration always converges locally if not globally. Now, an application: 4.24 The case of affine constraints C is considered in [260].

278 CHAPTER 4. SEMIDEFINITE PROGRAMMING<br />

N∑<br />

λ(G ⋆ ) i<br />

i=n+1<br />

= minimize<br />

W ∈ S N 〈G ⋆ , W 〉<br />

subject to 0 ≼ W ≼ I<br />

trW = N − n<br />

(1581a)<br />

whose feasible set is a Fantope (2.3.2.0.1), and where G ⋆ is an optimal<br />

solution to problem (670) given some iterate W . The idea is to iterate<br />

solution of (670) and (1581a) until convergence as defined in4.4.1.2. 4.22<br />

Optimal matrix W ⋆ is defined as any direction matrix yielding optimal<br />

solution G ⋆ of rank n or less to then convex equivalent (670) of feasibility<br />

problem (669); id est, any direction matrix for which the last N − n<br />

nonincreasingly ordered eigenvalues λ of G ⋆ are zero: (p.599)<br />

N∑<br />

λ(G ⋆ ) i = 〈G ⋆ , W ⋆ 〉 = ∆ 0 (671)<br />

i=n+1<br />

We emphasize that convex problem (670) is not a relaxation of the<br />

rank-constrained feasibility problem (669); at convergence, convex iteration<br />

(670) (1581a) makes it instead an equivalent problem. 4.23<br />

4.4.1.1 direction interpretation<br />

We make no assumption regarding uniqueness of direction matrix W . The<br />

feasible set of direction matrices in (1581a) is the convex hull of outer product<br />

of all rank-(N − n) orthonormal matrices; videlicet,<br />

conv { UU T | U ∈ R N×N−n , U T U = I } = { A∈ S N | I ≽ A ≽ 0, 〈I , A 〉= N − n } (82)<br />

Set {UU T | U ∈ R N×N−n , U T U = I} comprises the extreme points of this<br />

Fantope (82). An optimal solution W to (1581a), that is an extreme point,<br />

is known in closed form (p.599). By (205), that particular direction (−W)<br />

can be regarded as pointing toward positive semidefinite rank-n matrices that<br />

4.22 The proposed iteration is not an alternating projection. (confer Figure 140)<br />

4.23 Terminology equivalent problem meaning, optimal solution to one problem can be<br />

derived from optimal solution to another. Terminology same problem means: optimal<br />

solution set for one problem is identical to the optimal solution set of another (without<br />

transformation).

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!