v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

254 CHAPTER 4. SEMIDEFINITE PROGRAMMING with an equal number of twos and zeros along the main diagonal. Indeed, optimal solution (595) is a terminal solution along the central path taken by the interior-point method as implemented in [342,2.5.3]; it is also a solution of highest rank among all optimal solutions to (594). Clearly, rank of this primal optimal solution exceeds by far a rank-1 solution predicted by upper bound (245). 4.1.1.5 Later developments This rational example (594) indicates the need for a more generally applicable and simple algorithm to identify an optimal solution X ⋆ satisfying Barvinok’s Proposition 2.9.3.0.1. We will review such an algorithm in4.3, but first we provide more background. 4.2 Framework 4.2.1 Feasible sets Denote by C and C ∗ the convex sets of primal and dual points respectively satisfying the primal and dual constraints in (584), each assumed nonempty; ⎧ ⎡ ⎤ ⎫ ⎨ 〈A 1 , X〉 ⎬ C = ⎩ X ∈ Sn + | ⎣ . ⎦= b ⎭ = A ∩ Sn + 〈A m , X〉 (596) { } m∑ C ∗ = S ∈ S n + , y = [y i ]∈ R m | y i A i + S = C These are the primal feasible set and dual feasible set. Geometrically, primal feasible A ∩ S n + represents an intersection of the positive semidefinite cone S n + with an affine subset A of the subspace of symmetric matrices S n in isometrically isomorphic R n(n+1)/2 . The affine subset has dimension n(n+1)/2 −m when the A i are linearly independent. Dual feasible set C ∗ is the Cartesian product of the positive semidefinite cone with its inverse image (2.1.9.0.1) under affine transformation C − ∑ y i A i . 4.6 Both feasible 4.6 The inequality C − ∑ y i A i ≽0 follows directly from (584D) (2.9.0.1.1) and is known as a linear matrix inequality. (2.13.5.1.1) Because ∑ y i A i ≼C , matrix S is known as a slack variable (a term borrowed from linear programming [82]) since its inclusion raises this inequality to equality. i=1

4.2. FRAMEWORK 255 sets are closed and convex, and the objective functions on a Euclidean vector space are linear. Hence, convex optimization problems (584P) and (584D). 4.2.1.1 A ∩ S n + emptiness determination via Farkas’ lemma 4.2.1.1.1 Lemma. Semidefinite Farkas’ lemma. Given an arbitrary set {A i ∈ S n , i=1... m} and a vector b = [b i ]∈ R m , define the affine subset A = {X ∈ S n | 〈A i , X〉 = b i , i=1... m} (587) Primal feasible set A ∩ S n + is nonempty if and only if y T b ≥ 0 holds for each and every vector y = [y i ]∈ R m ∑ such that m y i A i ≽ 0. Equivalently, primal feasible set A ∩ S n + is nonempty if and only if y T b ≥ 0 holds for each and every norm-1 vector ‖y‖= 1 such that m∑ y i A i ≽ 0. ⋄ i=1 Semidefinite Farkas’ lemma follows directly from a membership relation (2.13.2.0.1) and the closed convex cones from linear matrix inequality example 2.13.5.1.1; given convex cone K and its dual where i=1 K = {A svec X | X ≽ 0} (337) m∑ K ∗ = {y | y j A j ≽ 0} (343) ⎡ A = ⎣ j=1 then we have membership relation and equivalents ⎤ svec(A 1 ) T . ⎦ ∈ R m×n(n+1)/2 (585) svec(A m ) T b ∈ K ⇔ 〈y,b〉 ≥ 0 ∀y ∈ K ∗ (288) b ∈ K ⇔ ∃X ≽ 0 A svec X = b ⇔ A ∩ S n + ≠ ∅ (597) b ∈ K ⇔ 〈y,b〉 ≥ 0 ∀y ∈ K ∗ ⇔ A ∩ S n + ≠ ∅ (598)

4.2. FRAMEWORK 255<br />

sets are closed and convex, and the objective functions on a Euclidean vector<br />

space are linear. Hence, convex optimization problems (584P) and (584D).<br />

4.2.1.1 A ∩ S n + emptiness determination via Farkas’ lemma<br />

4.2.1.1.1 Lemma. Semidefinite Farkas’ lemma.<br />

Given an arbitrary set {A i ∈ S n , i=1... m} and a vector b = [b i ]∈ R m ,<br />

define the affine subset<br />

A = {X ∈ S n | 〈A i , X〉 = b i , i=1... m} (587)<br />

Primal feasible set A ∩ S n + is nonempty if and only if y T b ≥ 0 holds for<br />

each and every vector y = [y i ]∈ R m ∑<br />

such that m y i A i ≽ 0.<br />

Equivalently, primal feasible set A ∩ S n + is nonempty if and only<br />

if y T b ≥ 0 holds for each and every norm-1 vector ‖y‖= 1 such that<br />

m∑<br />

y i A i ≽ 0.<br />

⋄<br />

i=1<br />

Semidefinite Farkas’ lemma follows directly from a membership relation<br />

(2.13.2.0.1) and the closed convex cones from linear matrix inequality<br />

example 2.13.5.1.1; given convex cone K and its dual<br />

where<br />

i=1<br />

K = {A svec X | X ≽ 0} (337)<br />

m∑<br />

K ∗ = {y | y j A j ≽ 0} (343)<br />

⎡<br />

A = ⎣<br />

j=1<br />

then we have membership relation<br />

and equivalents<br />

⎤<br />

svec(A 1 ) T<br />

. ⎦ ∈ R m×n(n+1)/2 (585)<br />

svec(A m ) T<br />

b ∈ K ⇔ 〈y,b〉 ≥ 0 ∀y ∈ K ∗ (288)<br />

b ∈ K ⇔ ∃X ≽ 0 A svec X = b ⇔ A ∩ S n + ≠ ∅ (597)<br />

b ∈ K ⇔ 〈y,b〉 ≥ 0 ∀y ∈ K ∗ ⇔ A ∩ S n + ≠ ∅ (598)

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!