v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

184 CHAPTER 2. CONVEX GEOMETRY 2.13.10.1.2 Example. Optimality conditions for conic problem. Consider a convex optimization problem having real differentiable convex objective function f(x) : R n →R defined on domain R n minimize f(x) x subject to x ∈ K (407) The feasible set is a pointed polyhedral cone K possessing a linearly independent set of generators and whose subspace membership is made explicit by fat full-rank matrix C ∈ R p×n ; id est, we are given the halfspace-description K = {x | Ax ≽ 0, Cx = 0} ⊆ R n (259a) where A∈ R m×n . The vertex-description of this cone, assuming (ÂZ)† skinny-or-square full-rank, is K = {Z(ÂZ)† b | b ≽ 0} (398) where Â∈ Rm−l×n , l is the number of conically dependent rows in AZ (2.10) that must be removed, and Z ∈ R n×n−rank C holds basis N(C) columnar. From optimality condition (319), because ∇f(x ⋆ ) T (Z(ÂZ)† b − x ⋆ )≥ 0 ∀b ≽ 0 (408) −∇f(x ⋆ ) T Z(ÂZ)† (b − b ⋆ )≤ 0 ∀b ≽ 0 (409) x ⋆ ∆ = Z(ÂZ)† b ⋆ ∈ K (410) From membership relation (404) and Example 2.13.10.1.1 〈−(Z T Â T ) † Z T ∇f(x ⋆ ), b − b ⋆ 〉 ≤ 0 for all b ∈ R m−l + ⇔ (411) −(Z T Â T ) † Z T ∇f(x ⋆ ) ∈ −R m−l + ∩ b ⋆⊥ Then the equivalent necessary and sufficient conditions for optimality of the conic problem (407) with pointed polyhedral feasible set K are: (confer (326))

2.13. DUAL CONE & GENERALIZED INEQUALITY 185 (Z T Â T ) † Z T ∇f(x ⋆ ) ≽ R m−l + 0, b ⋆ ≽ R m−l + 0, ∇f(x ⋆ ) T Z(ÂZ)† b ⋆ = 0 (412) When K = R n + , in particular, then C =0, A=Z =I ∈ S n ; id est, minimize f(x) x subject to x ≽ 0 (413) The necessary and sufficient conditions become (confer [53,4.2.3]) R n + ∇f(x ⋆ ) ≽ 0, x ⋆ ≽ 0, ∇f(x ⋆ ) T x ⋆ = 0 (414) R n + R n + 2.13.10.1.3 Example. Linear complementarity. [235] [269] Given matrix A ∈ R n×n and vector q ∈ R n , the complementarity problem is a feasibility problem: find w , z subject to w ≽ 0 z ≽ 0 w T z = 0 w = q + Az (415) Volumes have been written about this problem, most notably by Cottle [76]. The problem is not convex if both vectors w and z are variable. But if one of them is fixed, then the problem becomes convex with a very simple geometric interpretation: Define the affine subset A ∆ = {y ∈ R n | Ay=w − q} (416) For w T z to vanish, there must be a complementary relationship between the nonzero entries of vectors w and z ; id est, w i z i =0 ∀i. Given w ≽0, then z belongs to the convex set of feasible solutions: z ∈ −K ⊥ R n + (w ∈ Rn +) ∩ A = R n + ∩ w ⊥ ∩ A (417) where KR ⊥ (w) is the normal cone to n Rn + + at w (406). If this intersection is nonempty, then the problem is solvable.

2.13. DUAL CONE & GENERALIZED INEQUALITY 185<br />

(Z T Â T ) † Z T ∇f(x ⋆ ) ≽<br />

R m−l<br />

+<br />

0, b ⋆ ≽<br />

R m−l<br />

+<br />

0, ∇f(x ⋆ ) T Z(ÂZ)† b ⋆ = 0 (412)<br />

When K = R n + , in particular, then C =0, A=Z =I ∈ S n ; id est,<br />

minimize f(x)<br />

x<br />

subject to x ≽ 0 (413)<br />

The necessary and sufficient conditions become (confer [53,4.2.3])<br />

R n +<br />

∇f(x ⋆ ) ≽ 0, x ⋆ ≽ 0, ∇f(x ⋆ ) T x ⋆ = 0 (414)<br />

R n +<br />

R n +<br />

<br />

2.13.10.1.3 Example. Linear complementarity. [235] [269]<br />

Given matrix A ∈ R n×n and vector q ∈ R n , the complementarity problem is<br />

a feasibility problem:<br />

find w , z<br />

subject to w ≽ 0<br />

z ≽ 0<br />

w T z = 0<br />

w = q + Az<br />

(415)<br />

Volumes have been written about this problem, most notably by Cottle [76].<br />

The problem is not convex if both vectors w and z are variable. But if one of<br />

them is fixed, then the problem becomes convex with a very simple geometric<br />

interpretation: Define the affine subset<br />

A ∆ = {y ∈ R n | Ay=w − q} (416)<br />

For w T z to vanish, there must be a complementary relationship between the<br />

nonzero entries of vectors w and z ; id est, w i z i =0 ∀i. Given w ≽0, then<br />

z belongs to the convex set of feasible solutions:<br />

z ∈ −K ⊥ R n + (w ∈ Rn +) ∩ A = R n + ∩ w ⊥ ∩ A (417)<br />

where KR ⊥ (w) is the normal cone to n Rn + + at w (406). If this intersection is<br />

nonempty, then the problem is solvable.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!