v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
34 CHAPTER 2. CONVEX GEOMETRY 2.1 Convex set A set C is convex iff for all Y, Z ∈ C and 0≤µ≤1 µY + (1 − µ)Z ∈ C (1) Under that defining condition on µ , the linear sum in (1) is called a convex combination of Y and Z . If Y and Z are points in real finite-dimensional Euclidean vector space R n or R m×n (matrices), then (1) represents the closed line segment joining them. All line segments are thereby convex sets. Apparent from the definition, a convex set is a connected set. [222,3.4,3.5] [37, p.2] A convex set can, but does not necessarily, contain the origin. An ellipsoid centered at x = a (Figure 12, p.38), given matrix C ∈ R m×n {x∈ R n | ‖C(x − a)‖ 2 = (x − a) T C T C(x − a) ≤ 1} (2) is a good icon for a convex set. 2.1.1 subspace A nonempty subset of real Euclidean vector space R n is called a subspace (formally defined in2.5) if every vector 2.1 of the form αx + βy , for α,β∈R , is in the subset whenever vectors x and y are. [215,2.3] A subspace is a convex set containing the origin 0, by definition. [266, p.4] Any subspace is therefore open in the sense that it contains no boundary, but closed in the sense [222,2] It is not difficult to show R n + R n = R n (3) R n = −R n (4) as is true for any subspace R , because x∈ R n ⇔ −x∈ R n . The intersection of an arbitrary collection of subspaces remains a subspace. Any subspace not constituting the entire ambient vector space R n is a proper subspace; e.g., 2.2 any line through the origin in two-dimensional Euclidean space R 2 . The vector space R n is itself a conventional subspace, inclusively, [197,2.1] although not proper. 2.1 A vector is assumed, throughout, to be a column vector. 2.2 We substitute the abbreviation e.g. in place of the Latin exempli gratia.
2.1. CONVEX SET 35 2.1.2 linear independence Arbitrary given vectors in Euclidean space {Γ i ∈ R n , i=1... N} are linearly independent (l.i.) if and only if, for all ζ ∈ R N Γ 1 ζ 1 + · · · + Γ N−1 ζ N−1 + Γ N ζ N = 0 (5) has only the trivial solution ζ = 0 ; in other words, iff no vector from the given set can be expressed as a linear combination of those remaining. 2.1.2.1 preservation Linear transformation preserves linear dependence. [197, p.86] Conversely, linear independence can be preserved under linear transformation. Given matrix Y = [y 1 y 2 · · · y N ]∈ R N×N , consider the mapping T(Γ) : R n×N → R n×N ∆ = ΓY (6) whose domain is the set of all matrices Γ∈ R n×N holding a linearly independent set columnar. Linear independence of {Γy i ∈ R n , i=1... N} demands, by definition, there exist no nontrivial solution ζ ∈ R N to Γy 1 ζ i + · · · + Γy N−1 ζ N−1 + Γy N ζ N = 0 (7) By factoring out Γ , we see that triviality is ensured by linear independence of {y i ∈ R N }. 2.1.3 Orthant: name given to a closed convex set that is the higher-dimensional generalization of quadrant from the classical Cartesian partition of R 2 . The most common is the nonnegative orthant R n + or R n×n + (analogue to quadrant I) to which membership denotes nonnegative vector- or matrix-entries respectively; e.g., R n + ∆ = {x∈ R n | x i ≥ 0 ∀i} (8) The nonpositive orthant R n − or R n×n − (analogue to quadrant III) denotes negative and 0 entries. Orthant convexity 2.3 is easily verified by definition (1). 2.3 All orthants are self-dual simplicial cones. (2.13.5.1,2.12.3.1.1)
- Page 1 and 2: DATTORRO CONVEX OPTIMIZATION & EUCL
- Page 3 and 4: Convex Optimization & Euclidean Dis
- Page 5 and 6: for Jennie Columba ♦ Antonio ♦
- Page 7 and 8: Prelude The constant demands of my
- Page 9 and 10: Convex Optimization & Euclidean Dis
- Page 11 and 12: CONVEX OPTIMIZATION & EUCLIDEAN DIS
- Page 13 and 14: List of Figures 1 Overview 19 1 Ori
- Page 15 and 16: LIST OF FIGURES 15 3 Geometry of co
- Page 17 and 18: LIST OF FIGURES 17 126 Decomposing
- Page 19 and 20: Chapter 1 Overview Convex Optimizat
- Page 21 and 22: ˇx 4 ˇx 3 ˇx 2 Figure 2: Applica
- Page 23 and 24: 23 Figure 4: This coarsely discreti
- Page 25 and 26: ases (biorthogonal expansion). We e
- Page 27 and 28: 27 Figure 7: These bees construct a
- Page 29 and 30: that establish its membership to th
- Page 31 and 32: 31 appendices Provided so as to be
- Page 33: Chapter 2 Convex geometry Convexity
- Page 37 and 38: 2.1. CONVEX SET 37 2.1.6 empty set
- Page 39 and 40: 2.1. CONVEX SET 39 2.1.7.1 Line int
- Page 41 and 42: 2.1. CONVEX SET 41 (a) R 2 (b) R 3
- Page 43 and 44: 2.1. CONVEX SET 43 This theorem in
- Page 45 and 46: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 47 and 48: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 49 and 50: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 51 and 52: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 53 and 54: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 55 and 56: 2.3. HULLS 55 Figure 16: Convex hul
- Page 57 and 58: 2.3. HULLS 57 The affine hull of tw
- Page 59 and 60: 2.3. HULLS 59 2.3.2 Convex hull The
- Page 61 and 62: 2.3. HULLS 61 In case k = N , the F
- Page 63 and 64: 2.3. HULLS 63 2.3.2.0.3 Exercise. C
- Page 65 and 66: 2.3. HULLS 65 Figure 20: A simplici
- Page 67 and 68: 2.4. HALFSPACE, HYPERPLANE 67 H + a
- Page 69 and 70: 2.4. HALFSPACE, HYPERPLANE 69 1 1
- Page 71 and 72: 2.4. HALFSPACE, HYPERPLANE 71 Recal
- Page 73 and 74: 2.4. HALFSPACE, HYPERPLANE 73 C H
- Page 75 and 76: 2.4. HALFSPACE, HYPERPLANE 75 2.4.2
- Page 77 and 78: 2.4. HALFSPACE, HYPERPLANE 77 (conf
- Page 79 and 80: 2.5. SUBSPACE REPRESENTATIONS 79 Ra
- Page 81 and 82: 2.5. SUBSPACE REPRESENTATIONS 81 If
- Page 83 and 84: 2.6. EXTREME, EXPOSED 83 2.6 Extrem
34 CHAPTER 2. CONVEX GEOMETRY<br />
2.1 <strong>Convex</strong> set<br />
A set C is convex iff for all Y, Z ∈ C and 0≤µ≤1<br />
µY + (1 − µ)Z ∈ C (1)<br />
Under that defining condition on µ , the linear sum in (1) is called a convex<br />
combination of Y and Z . If Y and Z are points in real finite-dimensional<br />
Euclidean vector space R n or R m×n (matrices), then (1) represents the<br />
closed line segment joining them. All line segments are thereby convex sets.<br />
Apparent from the definition, a convex set is a connected set. [222,3.4,3.5]<br />
[37, p.2] A convex set can, but does not necessarily, contain the origin.<br />
An ellipsoid centered at x = a (Figure 12, p.38), given matrix C ∈ R m×n<br />
{x∈ R n | ‖C(x − a)‖ 2 = (x − a) T C T C(x − a) ≤ 1} (2)<br />
is a good icon for a convex set.<br />
2.1.1 subspace<br />
A nonempty subset of real Euclidean vector space R n is called a subspace<br />
(formally defined in2.5) if every vector 2.1 of the form αx + βy , for<br />
α,β∈R , is in the subset whenever vectors x and y are. [215,2.3] A<br />
subspace is a convex set containing the origin 0, by definition. [266, p.4]<br />
Any subspace is therefore open in the sense that it contains no boundary,<br />
but closed in the sense [222,2]<br />
It is not difficult to show<br />
R n + R n = R n (3)<br />
R n = −R n (4)<br />
as is true for any subspace R , because x∈ R n ⇔ −x∈ R n .<br />
The intersection of an arbitrary collection of subspaces remains a<br />
subspace. Any subspace not constituting the entire ambient vector space R n<br />
is a proper subspace; e.g., 2.2 any line through the origin in two-dimensional<br />
Euclidean space R 2 . The vector space R n is itself a conventional subspace,<br />
inclusively, [197,2.1] although not proper.<br />
2.1 A vector is assumed, throughout, to be a column vector.<br />
2.2 We substitute the abbreviation e.g. in place of the Latin exempli gratia.