v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

34 CHAPTER 2. CONVEX GEOMETRY 2.1 Convex set A set C is convex iff for all Y, Z ∈ C and 0≤µ≤1 µY + (1 − µ)Z ∈ C (1) Under that defining condition on µ , the linear sum in (1) is called a convex combination of Y and Z . If Y and Z are points in real finite-dimensional Euclidean vector space R n or R m×n (matrices), then (1) represents the closed line segment joining them. All line segments are thereby convex sets. Apparent from the definition, a convex set is a connected set. [222,3.4,3.5] [37, p.2] A convex set can, but does not necessarily, contain the origin. An ellipsoid centered at x = a (Figure 12, p.38), given matrix C ∈ R m×n {x∈ R n | ‖C(x − a)‖ 2 = (x − a) T C T C(x − a) ≤ 1} (2) is a good icon for a convex set. 2.1.1 subspace A nonempty subset of real Euclidean vector space R n is called a subspace (formally defined in2.5) if every vector 2.1 of the form αx + βy , for α,β∈R , is in the subset whenever vectors x and y are. [215,2.3] A subspace is a convex set containing the origin 0, by definition. [266, p.4] Any subspace is therefore open in the sense that it contains no boundary, but closed in the sense [222,2] It is not difficult to show R n + R n = R n (3) R n = −R n (4) as is true for any subspace R , because x∈ R n ⇔ −x∈ R n . The intersection of an arbitrary collection of subspaces remains a subspace. Any subspace not constituting the entire ambient vector space R n is a proper subspace; e.g., 2.2 any line through the origin in two-dimensional Euclidean space R 2 . The vector space R n is itself a conventional subspace, inclusively, [197,2.1] although not proper. 2.1 A vector is assumed, throughout, to be a column vector. 2.2 We substitute the abbreviation e.g. in place of the Latin exempli gratia.

2.1. CONVEX SET 35 2.1.2 linear independence Arbitrary given vectors in Euclidean space {Γ i ∈ R n , i=1... N} are linearly independent (l.i.) if and only if, for all ζ ∈ R N Γ 1 ζ 1 + · · · + Γ N−1 ζ N−1 + Γ N ζ N = 0 (5) has only the trivial solution ζ = 0 ; in other words, iff no vector from the given set can be expressed as a linear combination of those remaining. 2.1.2.1 preservation Linear transformation preserves linear dependence. [197, p.86] Conversely, linear independence can be preserved under linear transformation. Given matrix Y = [y 1 y 2 · · · y N ]∈ R N×N , consider the mapping T(Γ) : R n×N → R n×N ∆ = ΓY (6) whose domain is the set of all matrices Γ∈ R n×N holding a linearly independent set columnar. Linear independence of {Γy i ∈ R n , i=1... N} demands, by definition, there exist no nontrivial solution ζ ∈ R N to Γy 1 ζ i + · · · + Γy N−1 ζ N−1 + Γy N ζ N = 0 (7) By factoring out Γ , we see that triviality is ensured by linear independence of {y i ∈ R N }. 2.1.3 Orthant: name given to a closed convex set that is the higher-dimensional generalization of quadrant from the classical Cartesian partition of R 2 . The most common is the nonnegative orthant R n + or R n×n + (analogue to quadrant I) to which membership denotes nonnegative vector- or matrix-entries respectively; e.g., R n + ∆ = {x∈ R n | x i ≥ 0 ∀i} (8) The nonpositive orthant R n − or R n×n − (analogue to quadrant III) denotes negative and 0 entries. Orthant convexity 2.3 is easily verified by definition (1). 2.3 All orthants are self-dual simplicial cones. (2.13.5.1,2.12.3.1.1)

34 CHAPTER 2. CONVEX GEOMETRY<br />

2.1 <strong>Convex</strong> set<br />

A set C is convex iff for all Y, Z ∈ C and 0≤µ≤1<br />

µY + (1 − µ)Z ∈ C (1)<br />

Under that defining condition on µ , the linear sum in (1) is called a convex<br />

combination of Y and Z . If Y and Z are points in real finite-dimensional<br />

Euclidean vector space R n or R m×n (matrices), then (1) represents the<br />

closed line segment joining them. All line segments are thereby convex sets.<br />

Apparent from the definition, a convex set is a connected set. [222,3.4,3.5]<br />

[37, p.2] A convex set can, but does not necessarily, contain the origin.<br />

An ellipsoid centered at x = a (Figure 12, p.38), given matrix C ∈ R m×n<br />

{x∈ R n | ‖C(x − a)‖ 2 = (x − a) T C T C(x − a) ≤ 1} (2)<br />

is a good icon for a convex set.<br />

2.1.1 subspace<br />

A nonempty subset of real Euclidean vector space R n is called a subspace<br />

(formally defined in2.5) if every vector 2.1 of the form αx + βy , for<br />

α,β∈R , is in the subset whenever vectors x and y are. [215,2.3] A<br />

subspace is a convex set containing the origin 0, by definition. [266, p.4]<br />

Any subspace is therefore open in the sense that it contains no boundary,<br />

but closed in the sense [222,2]<br />

It is not difficult to show<br />

R n + R n = R n (3)<br />

R n = −R n (4)<br />

as is true for any subspace R , because x∈ R n ⇔ −x∈ R n .<br />

The intersection of an arbitrary collection of subspaces remains a<br />

subspace. Any subspace not constituting the entire ambient vector space R n<br />

is a proper subspace; e.g., 2.2 any line through the origin in two-dimensional<br />

Euclidean space R 2 . The vector space R n is itself a conventional subspace,<br />

inclusively, [197,2.1] although not proper.<br />

2.1 A vector is assumed, throughout, to be a column vector.<br />

2.2 We substitute the abbreviation e.g. in place of the Latin exempli gratia.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!