v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
68 CHAPTER 2. CONVEX GEOMETRY 2.4.1.1.1 Theorem. Halfspaces. [173,A.4.2(b)] [37,2.4] A closed convex set in R n is equivalent to the intersection of all halfspaces that contain it. ⋄ Intersection of multiple halfspaces in R n may be represented using a matrix constant A ⋂ H i− = {y | A T y ≼ b} = {y | A T (y − y p ) ≼ 0} (101) i ⋂ H i+ = {y | A T y ≽ b} = {y | A T (y − y p ) ≽ 0} (102) i where b is now a vector, and the i th column of A is normal to a hyperplane ∂H i partially bounding H i . By the halfspaces theorem, intersections like this can describe interesting convex Euclidean bodies such as polyhedra and cones, giving rise to the term halfspace-description. 2.4.2 Hyperplane ∂H representations Every hyperplane ∂H is an affine set parallel to an (n −1)-dimensional subspace of R n ; it is itself a subspace if and only if it contains the origin. dim∂H = n − 1 (103) so a hyperplane is a point in R , a line in R 2 , a plane in R 3 , and so on. Every hyperplane can be described as the intersection of complementary halfspaces; [266,19] ∂H = H − ∩ H + = {y | a T y ≤ b , a T y ≥ b} = {y | a T y = b} (104) a halfspace-description. Assuming normal a∈ R n to be nonzero, then any hyperplane in R n can be described as the solution set to vector equation a T y = b (illustrated in Figure 21 and Figure 22 for R 2 ) ∂H ∆ = {y | a T y = b} = {y | a T (y−y p ) = 0} = {Zξ+y p | ξ ∈ R n−1 } ⊂ R n (105) All solutions y constituting the hyperplane are offset from the nullspace of a T by the same constant vector y p ∈ R n that is any particular solution to a T y=b ; id est, y = Zξ + y p (106)
2.4. HALFSPACE, HYPERPLANE 69 1 1 −1 −1 1 [ 1 a = 1 ] (a) [ −1 b = −1 ] −1 −1 1 (b) {y | a T y=1} {y | b T y=−1} {y | a T y=−1} {y | b T y=1} (c) [ −1 c = 1 ] −1 1 −1 1 −1 1 −1 [ 1 d = −1 1 ] (d) {y | c T y=1} {y | c T y=−1} {y | d T y=−1} {y | d T y=1} [ 1 e = 0 ] −1 1 (e) {y | e T y=−1} {y | e T y=1} Figure 22: (a)-(d) Hyperplanes in R 2 (truncated). Movement in normal direction increases vector inner-product. This visual concept is exploited to attain analytical solution of linear programs; e.g., Example 2.4.2.6.2, Exercise 2.5.1.2.2, Example 3.1.6.0.2, [53, exer.4.8-exer.4.20]. Each graph is also interpretable as a contour plot of a real affine function of two variables as in Figure 63. (e) Ratio |β|/‖α‖ from {x | α T x = β} represents radius of hypersphere about 0 supported by hyperplane whose normal is α .
- Page 17 and 18: LIST OF FIGURES 17 126 Decomposing
- Page 19 and 20: Chapter 1 Overview Convex Optimizat
- Page 21 and 22: ˇx 4 ˇx 3 ˇx 2 Figure 2: Applica
- Page 23 and 24: 23 Figure 4: This coarsely discreti
- Page 25 and 26: ases (biorthogonal expansion). We e
- Page 27 and 28: 27 Figure 7: These bees construct a
- Page 29 and 30: that establish its membership to th
- Page 31 and 32: 31 appendices Provided so as to be
- Page 33 and 34: Chapter 2 Convex geometry Convexity
- Page 35 and 36: 2.1. CONVEX SET 35 2.1.2 linear ind
- Page 37 and 38: 2.1. CONVEX SET 37 2.1.6 empty set
- Page 39 and 40: 2.1. CONVEX SET 39 2.1.7.1 Line int
- Page 41 and 42: 2.1. CONVEX SET 41 (a) R 2 (b) R 3
- Page 43 and 44: 2.1. CONVEX SET 43 This theorem in
- Page 45 and 46: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 47 and 48: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 49 and 50: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 51 and 52: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 53 and 54: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 55 and 56: 2.3. HULLS 55 Figure 16: Convex hul
- Page 57 and 58: 2.3. HULLS 57 The affine hull of tw
- Page 59 and 60: 2.3. HULLS 59 2.3.2 Convex hull The
- Page 61 and 62: 2.3. HULLS 61 In case k = N , the F
- Page 63 and 64: 2.3. HULLS 63 2.3.2.0.3 Exercise. C
- Page 65 and 66: 2.3. HULLS 65 Figure 20: A simplici
- Page 67: 2.4. HALFSPACE, HYPERPLANE 67 H + a
- Page 71 and 72: 2.4. HALFSPACE, HYPERPLANE 71 Recal
- Page 73 and 74: 2.4. HALFSPACE, HYPERPLANE 73 C H
- Page 75 and 76: 2.4. HALFSPACE, HYPERPLANE 75 2.4.2
- Page 77 and 78: 2.4. HALFSPACE, HYPERPLANE 77 (conf
- Page 79 and 80: 2.5. SUBSPACE REPRESENTATIONS 79 Ra
- Page 81 and 82: 2.5. SUBSPACE REPRESENTATIONS 81 If
- Page 83 and 84: 2.6. EXTREME, EXPOSED 83 2.6 Extrem
- Page 85 and 86: 2.6. EXTREME, EXPOSED 85 A B C D Fi
- Page 87 and 88: 2.7. CONES 87 2.6.1.3.1 Definition.
- Page 89 and 90: 2.7. CONES 89 0 Figure 30: Boundary
- Page 91 and 92: 2.7. CONES 91 2.7.2 Convex cone We
- Page 93 and 94: 2.7. CONES 93 Then a pointed closed
- Page 95 and 96: 2.7. CONES 95 A pointed closed conv
- Page 97 and 98: 2.8. CONE BOUNDARY 97 So the ray th
- Page 99 and 100: 2.8. CONE BOUNDARY 99 2.8.1.1 extre
- Page 101 and 102: 2.8. CONE BOUNDARY 101 2.8.2 Expose
- Page 103 and 104: 2.8. CONE BOUNDARY 103 From Theorem
- Page 105 and 106: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 107 and 108: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 109 and 110: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 111 and 112: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 113 and 114: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 115 and 116: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 117 and 118: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
68 CHAPTER 2. CONVEX GEOMETRY<br />
2.4.1.1.1 Theorem. Halfspaces. [173,A.4.2(b)] [37,2.4]<br />
A closed convex set in R n is equivalent to the intersection of all halfspaces<br />
that contain it.<br />
⋄<br />
Intersection of multiple halfspaces in R n may be represented using a<br />
matrix constant A<br />
⋂<br />
H i−<br />
= {y | A T y ≼ b} = {y | A T (y − y p ) ≼ 0} (101)<br />
i<br />
⋂<br />
H i+<br />
= {y | A T y ≽ b} = {y | A T (y − y p ) ≽ 0} (102)<br />
i<br />
where b is now a vector, and the i th column of A is normal to a hyperplane<br />
∂H i partially bounding H i . By the halfspaces theorem, intersections like<br />
this can describe interesting convex Euclidean bodies such as polyhedra and<br />
cones, giving rise to the term halfspace-description.<br />
2.4.2 Hyperplane ∂H representations<br />
Every hyperplane ∂H is an affine set parallel to an (n −1)-dimensional<br />
subspace of R n ; it is itself a subspace if and only if it contains the origin.<br />
dim∂H = n − 1 (103)<br />
so a hyperplane is a point in R , a line in R 2 , a plane in R 3 , and so on.<br />
Every hyperplane can be described as the intersection of complementary<br />
halfspaces; [266,19]<br />
∂H = H − ∩ H + = {y | a T y ≤ b , a T y ≥ b} = {y | a T y = b} (104)<br />
a halfspace-description. Assuming normal a∈ R n to be nonzero, then any<br />
hyperplane in R n can be described as the solution set to vector equation<br />
a T y = b (illustrated in Figure 21 and Figure 22 for R 2 )<br />
∂H ∆ = {y | a T y = b} = {y | a T (y−y p ) = 0} = {Zξ+y p | ξ ∈ R n−1 } ⊂ R n (105)<br />
All solutions y constituting the hyperplane are offset from the nullspace of<br />
a T by the same constant vector y p ∈ R n that is any particular solution to<br />
a T y=b ; id est,<br />
y = Zξ + y p (106)