v2007.09.13 - Convex Optimization
v2007.09.13 - Convex Optimization v2007.09.13 - Convex Optimization
148 CHAPTER 2. CONVEX GEOMETRYBy alternative is meant: these two systems are incompatible; one system isfeasible while the other is not.2.13.2.1.1 Example. Theorem of the alternative for linear inequality.Myriad alternative systems of linear inequality can be explained in terms ofpointed closed convex cones and their duals.Beginning from the simplest Cartesian dual generalized inequalities (277)(with respect to the nonnegative orthant R m + ),y ≽ 0 ⇔ x T y ≥ 0 for all x ≽ 0 (293)Given A∈ R n×m , we make vector substitution A T y ← yA T y ≽ 0 ⇔ x T A T y ≥ 0 for all x ≽ 0 (294)Introducing a new vector by calculating b ∆ = Ax we getA T y ≽ 0 ⇔ b T y ≥ 0, b = Ax for all x ≽ 0 (295)By complementing sense of the scalar inequality:A T y ≽ 0or in the alternativeb T y < 0, ∃ b = Ax, x ≽ 0(296)If one system has a solution, then the other does not; define aconvex cone K={y ∆ | A T y ≽0} , then y ∈ K or in the alternative y /∈ K .Scalar inequality b T y
2.13. DUAL CONE & GENERALIZED INEQUALITY 149For another example, from membership relation (275) with affinetransformation of dual variable we may write: Given A∈ R n×m and b∈R nb − Ay ∈ K ∗ ⇔ x T (b − Ay)≥ 0 ∀x ∈ K (300)A T x=0, b − Ay ∈ K ∗ ⇒ x T b ≥ 0 ∀x ∈ K (301)From membership relation (300), conversely, suppose we allow any y ∈ R m .Then because −x T Ay is unbounded below, x T (b −Ay)≥0 implies A T x=0:for y ∈ R mIn toto,A T x=0, b − Ay ∈ K ∗ ⇐ x T (b − Ay)≥ 0 ∀x ∈ K (302)b − Ay ∈ K ∗ ⇔ x T b ≥ 0, A T x=0 ∀x ∈ K (303)Vector x belongs to cone K but is also constrained to lie in a subspaceof R n specified by an intersection of hyperplanes through the origin{x∈ R n |A T x=0}. From this, alternative systems of generalized inequalitywith respect to pointed closed convex cones K and K ∗Ay ≼K ∗or in the alternativeb(304)x T b < 0, A T x=0, x ≽K0derived from (303) simply by taking the complementary sense of theinequality in x T b . These two systems are alternatives; if one system hasa solution, then the other does not. 2.48 [228, p.201]By invoking a strict membership relation between proper cones (282),we can construct a more exotic alternative strengthened by demand for aninterior point;2.48 If solutions at ±∞ are disallowed, then the alternative systems become insteadmutually exclusive with respect to nonpolyhedral cones. Simultaneous infeasibility ofthe two systems is not precluded by mutual exclusivity; called a weak alternative.Ye provides an example illustrating simultaneous [ ] infeasibility[ with respect ] to the positivesemidefinite cone: x∈ S 2 1 00 1, y ∈ R , A = , and b = where x0 01 0T b means〈x , b〉 . A better strategy than disallowing solutions at ±∞ is to demand an interiorpoint as in (306) or Lemma 4.2.1.1.2. Then question of simultaneous infeasibility is moot.
- Page 98 and 99: 98 CHAPTER 2. CONVEX GEOMETRYThe po
- Page 100 and 101: 100 CHAPTER 2. CONVEX GEOMETRY2.9.0
- Page 102 and 103: 102 CHAPTER 2. CONVEX GEOMETRYwhere
- Page 104 and 105: 104 CHAPTER 2. CONVEX GEOMETRY√2
- Page 106 and 107: 106 CHAPTER 2. CONVEX GEOMETRYwhich
- Page 108 and 109: 108 CHAPTER 2. CONVEX GEOMETRY2.9.2
- Page 110: 110 CHAPTER 2. CONVEX GEOMETRYA con
- Page 115 and 116: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 117 and 118: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 119 and 120: 2.9. POSITIVE SEMIDEFINITE (PSD) CO
- Page 121 and 122: 2.10. CONIC INDEPENDENCE (C.I.) 121
- Page 123 and 124: 2.10. CONIC INDEPENDENCE (C.I.) 123
- Page 125 and 126: 2.10. CONIC INDEPENDENCE (C.I.) 125
- Page 127 and 128: 2.12. CONVEX POLYHEDRA 127It follow
- Page 129 and 130: 2.12. CONVEX POLYHEDRA 129Coefficie
- Page 131 and 132: 2.12. CONVEX POLYHEDRA 1312.12.3 Un
- Page 133 and 134: 2.12. CONVEX POLYHEDRA 133
- Page 135 and 136: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 137 and 138: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 139 and 140: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 141 and 142: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 143 and 144: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 145 and 146: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 147: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 151 and 152: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 153 and 154: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 155 and 156: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 157 and 158: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 159 and 160: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 161 and 162: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 163 and 164: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 165 and 166: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 167 and 168: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 169 and 170: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 171 and 172: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 173 and 174: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 175 and 176: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 177 and 178: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 179 and 180: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 181 and 182: 2.13. DUAL CONE & GENERALIZED INEQU
- Page 183 and 184: Chapter 3Geometry of convex functio
- Page 185 and 186: 3.1. CONVEX FUNCTION 185f 1 (x)f 2
- Page 187 and 188: 3.1. CONVEX FUNCTION 1873.1.3 norm
- Page 189 and 190: 3.1. CONVEX FUNCTION 189where the n
- Page 191 and 192: 3.1. CONVEX FUNCTION 191where k ∈
- Page 193 and 194: 3.1. CONVEX FUNCTION 193f(z)Az 2z 1
- Page 195 and 196: 3.1. CONVEX FUNCTION 195{a T z 1 +
- Page 197 and 198: 3.1. CONVEX FUNCTION 197When an epi
2.13. DUAL CONE & GENERALIZED INEQUALITY 149For another example, from membership relation (275) with affinetransformation of dual variable we may write: Given A∈ R n×m and b∈R nb − Ay ∈ K ∗ ⇔ x T (b − Ay)≥ 0 ∀x ∈ K (300)A T x=0, b − Ay ∈ K ∗ ⇒ x T b ≥ 0 ∀x ∈ K (301)From membership relation (300), conversely, suppose we allow any y ∈ R m .Then because −x T Ay is unbounded below, x T (b −Ay)≥0 implies A T x=0:for y ∈ R mIn toto,A T x=0, b − Ay ∈ K ∗ ⇐ x T (b − Ay)≥ 0 ∀x ∈ K (302)b − Ay ∈ K ∗ ⇔ x T b ≥ 0, A T x=0 ∀x ∈ K (303)Vector x belongs to cone K but is also constrained to lie in a subspaceof R n specified by an intersection of hyperplanes through the origin{x∈ R n |A T x=0}. From this, alternative systems of generalized inequalitywith respect to pointed closed convex cones K and K ∗Ay ≼K ∗or in the alternativeb(304)x T b < 0, A T x=0, x ≽K0derived from (303) simply by taking the complementary sense of theinequality in x T b . These two systems are alternatives; if one system hasa solution, then the other does not. 2.48 [228, p.201]By invoking a strict membership relation between proper cones (282),we can construct a more exotic alternative strengthened by demand for aninterior point;2.48 If solutions at ±∞ are disallowed, then the alternative systems become insteadmutually exclusive with respect to nonpolyhedral cones. Simultaneous infeasibility ofthe two systems is not precluded by mutual exclusivity; called a weak alternative.Ye provides an example illustrating simultaneous [ ] infeasibility[ with respect ] to the positivesemidefinite cone: x∈ S 2 1 00 1, y ∈ R , A = , and b = where x0 01 0T b means〈x , b〉 . A better strategy than disallowing solutions at ±∞ is to demand an interiorpoint as in (306) or Lemma 4.2.1.1.2. Then question of simultaneous infeasibility is moot.