v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

228 CHAPTER 3. GEOMETRY OF CONVEX FUNCTIONS 3.1.8.1.4 Exercise. Product and ratio of convex functions. [53, exer.3.32] In general the product or ratio of two convex functions is not convex. [198] However, there are some results that apply to functions on R [real domain]. Prove the following. 3.14 (a) If f and g are convex, both nondecreasing (or nonincreasing), and positive functions on an interval, then fg is convex. (b) If f , g are concave, positive, with one nondecreasing and the other nonincreasing, then fg is concave. (c) If f is convex, nondecreasing, and positive, and g is concave, nonincreasing, and positive, then f/g is convex. 3.1.9 first-order convexity condition, real function Discretization of w ≽0 in (444) invites refocus to the real-valued function: 3.1.9.0.1 Theorem. Necessary and sufficient convexity condition. [53,3.1.3] [110,I.5.2] [342,1.2.3] [37,1.2] [286,4.2] [265,3] For real differentiable function f(X) : R p×k →R with matrix argument on open convex domain, the condition (conferD.1.7) f(Y ) ≥ f(X) + 〈∇f(X) , Y − X〉 for each and every X,Y ∈ domf (544) is necessary and sufficient for convexity of f . When f(X) : R p →R is a real differentiable convex function with vector argument on open convex domain, there is simplification of the first-order condition (544); for each and every X,Y ∈ domf f(Y ) ≥ f(X) + ∇f(X) T (Y − X) (545) From this we can find ∂H − a unique [324,5.5.4] nonvertical [173,B.1.2] hyperplane [ ](2.4), expressed in terms of function gradient, supporting epif X at : videlicet, defining f(Y /∈ domf) = ∆ ∞ [53,3.1.7] f(X) [ ] Y ∈ epif ⇔ t ≥ f(Y ) ⇒ [ ∇f(X) T −1 ]([ ] [ ]) Y X − ≤ 0 t t f(X) (546) 3.14 Hint: Prove the result in (a) by verifying Jensen’s inequality. ⋄

3.1. CONVEX FUNCTION 229 This means, for each and every point X in the domain of a real convex [ function f(X) ] , there exists a hyperplane ∂H − [ in R p × ] R having normal ∇f(X) X supporting the function epigraph at ∈ ∂H −1 f(X) − {[ ] [ ] Y R p [ ∂H − = ∈ ∇f(X) T −1 ]([ ] [ ]) } Y X − = 0 t R t f(X) (547) One such supporting hyperplane (confer Figure 25(a)) is illustrated in Figure 67 for a convex quadratic. From (545) we deduce, for each and every X,Y ∈ domf ∇f(X) T (Y − X) ≥ 0 ⇒ f(Y ) ≥ f(X) (548) meaning, the gradient at X identifies a supporting hyperplane there in R p {Y ∈ R p | ∇f(X) T (Y − X) = 0} (549) to the convex sublevel sets of convex function f (confer (496)) L f(X) f ∆ = {Y ∈ domf | f(Y ) ≤ f(X)} ⊆ R p (550) illustrated for an arbitrary real convex function in Figure 68. 3.1.10 first-order convexity condition, vector function Now consider the first-order necessary and sufficient condition for convexity of a vector-valued function: Differentiable function f(X) : R p×k →R M is convex if and only if domf is open, convex, and for each and every X,Y ∈ domf f(Y ) ≽ R M + f(X) + →Y −X df(X) = f(X) + d dt∣ f(X+ t (Y − X)) (551) t=0 →Y −X where df(X) is the directional derivative 3.15 [190] [288] of f at X in direction Y −X . This, of course, follows from the real-valued function case: by dual generalized inequalities (2.13.2.0.1), 3.15 We extend the traditional definition of directional derivative inD.1.4 so that direction may be indicated by a vector or a matrix, thereby broadening the scope of the Taylor series (D.1.7). The right-hand side of the inequality (551) is the first-order Taylor series expansion of f about X .

228 CHAPTER 3. GEOMETRY OF CONVEX FUNCTIONS<br />

3.1.8.1.4 Exercise. Product and ratio of convex functions. [53, exer.3.32]<br />

In general the product or ratio of two convex functions is not convex. [198]<br />

However, there are some results that apply to functions on R [real domain].<br />

Prove the following. 3.14<br />

(a) If f and g are convex, both nondecreasing (or nonincreasing), and<br />

positive functions on an interval, then fg is convex.<br />

(b) If f , g are concave, positive, with one nondecreasing and the other<br />

nonincreasing, then fg is concave.<br />

(c) If f is convex, nondecreasing, and positive, and g is concave,<br />

nonincreasing, and positive, then f/g is convex.<br />

<br />

3.1.9 first-order convexity condition, real function<br />

Discretization of w ≽0 in (444) invites refocus to the real-valued function:<br />

3.1.9.0.1 Theorem. Necessary and sufficient convexity condition.<br />

[53,3.1.3] [110,I.5.2] [342,1.2.3] [37,1.2] [286,4.2] [265,3] For real<br />

differentiable function f(X) : R p×k →R with matrix argument on open<br />

convex domain, the condition (conferD.1.7)<br />

f(Y ) ≥ f(X) + 〈∇f(X) , Y − X〉 for each and every X,Y ∈ domf (544)<br />

is necessary and sufficient for convexity of f .<br />

When f(X) : R p →R is a real differentiable convex function with vector<br />

argument on open convex domain, there is simplification of the first-order<br />

condition (544); for each and every X,Y ∈ domf<br />

f(Y ) ≥ f(X) + ∇f(X) T (Y − X) (545)<br />

From this we can find ∂H − a unique [324,5.5.4] nonvertical [173,B.1.2]<br />

hyperplane [ ](2.4), expressed in terms of function gradient, supporting epif<br />

X<br />

at : videlicet, defining f(Y /∈ domf) = ∆ ∞ [53,3.1.7]<br />

f(X)<br />

[ ] Y<br />

∈ epif ⇔ t ≥ f(Y ) ⇒ [ ∇f(X) T −1 ]([ ] [ ])<br />

Y X<br />

−<br />

≤ 0<br />

t<br />

t f(X)<br />

(546)<br />

3.14 Hint: Prove the result in (a) by verifying Jensen’s inequality.<br />

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!