Chapter 3 Geometry of convex functions - Meboo Publishing ...

More documents

Recommendations

Info

246 CHAPTER 3. GEOMETRY OF CONVEX FUNCTIONS 3.7.1 monotonic function A real function of real argument is called monotonic when it is exclusively nonincreasing or nondecreasing over the whole of its domain. A real differentiable function of real argument is monotonic when its first derivative (not necessarily continuous) maintains sign over the function domain. 3.7.1.0.1 Definition. Monotonicity. Multidimensional function f(X) is nondecreasing monotonic when nonincreasing monotonic when Y ≽ X ⇒ f(Y ) ≽ f(X) Y ≽ X ⇒ f(Y ) ≼ f(X) (582) ∀X,Y ∈ dom f . △ For vector-valued functions compared with respect to the nonnegative orthant, it is necessary and sufficient for each entry f i to be monotonic in the same sense. Any affine function is monotonic. tr(Y T X) is a nondecreasing monotonic function of matrix X ∈ S M when constant matrix Y is positive semidefinite, for example; which follows from a result (356) of Fejér. A convex function can be characterized by another kind of nondecreasing monotonicity of its gradient: 3.7.1.0.2 Theorem. Gradient monotonicity. [195,B.4.1.4] [53,3.1 exer.20] Given f(X) : R p×k →R a real differentiable function with matrix argument on open convex domain, the condition 〈∇f(Y ) − ∇f(X) , Y − X〉 ≥ 0 for each and every X,Y ∈ domf (583) is necessary and sufficient for convexity of f . Strict inequality and caveat distinct Y ,X provide necessary and sufficient conditions for strict convexity. ⋄
3.7. GRADIENT 247 3.7.1.0.3 Example. Composition of functions. [59,3.2.4] [195,B.2.1] Monotonic functions play a vital role determining convexity of functions constructed by transformation. Given functions g : R k → R and h : R n → R k , their composition f = g(h) : R n → R defined by f(x) = g(h(x)) , domf = {x∈ dom h | h(x)∈ domg} (584) is convex when g is convex nondecreasing monotonic and h is convex g is convex nonincreasing monotonic and h is concave and composite function f is concave when g is concave nondecreasing monotonic and h is concave g is concave nonincreasing monotonic and h is convex where ∞ (−∞) is assigned to convex (concave) g when evaluated outside its domain. For differentiable functions, these rules are consequent to (1750). Convexity (concavity) of any g is preserved when h is affine. A squared norm is convex having the same minimum because a squaring operation is convex nondecreasing monotonic on the nonnegative real line. 3.7.1.0.4 Exercise. Product and ratio of convex functions. [59, exer.3.32] In general the product or ratio of two convex functions is not convex. [225] However, there are some results that apply to functions on R [real domain]. Prove the following. 3.18 (a) If f and g are convex, both nondecreasing (or nonincreasing), and positive functions on an interval, then fg is convex. (b) If f , g are concave, positive, with one nondecreasing and the other nonincreasing, then fg is concave. (c) If f is convex, nondecreasing, and positive, and g is concave, nonincreasing, and positive, then f/g is convex. 3.18 Hint: Prove3.7.1.0.4a by verifying Jensen’s inequality ((475) at µ= 1 2 ).
Page 1 and 2: Chapter 3 Geometry of convex functi
Page 3 and 4: 3.1. CONVEX FUNCTION 213 f 1 (x) f
Page 5 and 6: 3.1. CONVEX FUNCTION 215 Rf (b) f(X
Page 7 and 8: 3.3. PRACTICAL NORM FUNCTIONS, ABSO
Page 17 and 18: 3.4. INVERTED FUNCTIONS AND ROOTS 2
Page 19 and 20: 3.5. AFFINE FUNCTION 229 3.4.1.3 po
Page 21 and 22: 3.5. AFFINE FUNCTION 231 3.5.0.0.2
Page 23 and 24: 3.6. EPIGRAPH, SUBLEVEL SET 233 q(x
Page 25 and 26: 3.6. EPIGRAPH, SUBLEVEL SET 235 To
Page 27 and 28: 3.6. EPIGRAPH, SUBLEVEL SET 237 con
Page 29 and 30: 3.6. EPIGRAPH, SUBLEVEL SET 239 3.6
Page 31 and 32: 3.7. GRADIENT 241 2 1.5 1 0.5 Y 2 0
Page 33 and 34: 3.7. GRADIENT 243 From (1749) andD.
Page 35: 3.7. GRADIENT 245 This equivalence
Page 39 and 40: 3.7. GRADIENT 249 f(Y ) [ ∇f(X)
Page 41 and 42: 3.7. GRADIENT 251 meaning, the grad
Page 43 and 44: 3.8. MATRIX-VALUED CONVEX FUNCTION
Page 49 and 50: 3.9. QUASICONVEX 259 3.8.3.0.6 Exam
Page 51 and 52: 3.9. QUASICONVEX 261 3.9.0.0.2 Defi
Page 53: 3.10. SALIENT PROPERTIES 263 7. - N

Chapter 3 Geometry of convex functions - Meboo Publishing ...

Create successful ePaper yourself

Delete template?

Save as template?