v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
552 APPENDIX A. LINEAR ALGEBRA For A,B ∈ S n and A ≽ 0, B ≽ 0 (Example A.2.1.0.1) AB = BA ⇒ λ(AB) i =λ(A) i λ(B) i ≥ 0 ∀i ⇒ AB ≽ 0 (1381) AB = BA ⇒ λ(AB) i ≥ 0, λ(A) i λ(B) i ≥ 0 ∀i ⇔ AB ≽ 0 (1382) For A,B ∈ S n [177,4.2.13] A ≽ 0, B ≽ 0 ⇒ A ⊗ B ≽ 0 (1383) A ≻ 0, B ≻ 0 ⇒ A ⊗ B ≻ 0 (1384) and the Kronecker product is symmetric. For A,B ∈ S n [344,6.2] A ≽ 0 ⇒ trA ≥ 0 (1385) A ≽ 0, B ≽ 0 ⇒ trA trB ≥ tr(AB) ≥ 0 (1386) Because A ≽ 0, B ≽ 0 ⇒ λ(AB) = λ( √ AB √ A) ≽ 0 by (1367) and Corollary A.3.1.0.5, then we have tr(AB) ≥ 0. A ≽ 0 ⇔ tr(AB)≥ 0 ∀B ≽ 0 (335) For A,B,C ∈ S n (Löwner) A ≼ B , B ≼ C ⇒ A ≼ C A ≼ B ⇔ A + C ≼ B + C A ≼ B , A ≽ B ⇒ A = B A ≼ A (transitivity) (additivity) (antisymmetry) (reflexivity) (1387) For A,B ∈ R n×n x T Ax ≥ x T Bx ∀x ⇒ trA ≥ trB (1388) Proof. x T Ax≥x T Bx ∀x ⇔ λ((A −B) + (A −B) T )/2 ≽ 0 ⇒ tr(A+A T −(B+B T ))/2 = tr(A −B)≥0. There is no converse.
A.3. PROPER STATEMENTS 553 For A,B ∈ S n [344,6.2, prob.1] (Theorem A.3.1.0.4) A ≽ B ⇒ trA ≥ trB (1389) A ≽ B ⇒ δ(A) ≽ δ(B) (1390) There is no converse, and restriction to the positive semidefinite cone does not improve the situation. The all-strict versions hold. From [344,6.2] A ≽ B ≽ 0 ⇒ rankA ≥ rankB (1391) A ≽ B ≽ 0 ⇒ detA ≥ detB ≥ 0 (1392) A ≻ B ≽ 0 ⇒ detA > detB ≥ 0 (1393) For A,B ∈ int S n + [31,4.2] [176,7.7.4] For A,B ∈ S n [344,6.2] A ≽ B ⇔ A −1 ≼ B −1 (1394) A ≽ B ≽ 0 ⇒ √ A ≽ √ B (1395) For A,B ∈ S n and AB = BA [344,6.2, prob.3] A ≽ B ≽ 0 ⇒ A k ≽ B k , k=1, 2,... (1396) A.3.1.0.1 Theorem. Positive semidefinite ordering of eigenvalues. For A,B∈ R M×M , place the eigenvalues of each symmetrized matrix into the respective vectors λ ( 1 (A 2 +AT ) ) , λ ( 1 (B 2 +BT ) ) ∈ R M . Then, [287,6] x T Ax ≥ 0 ∀x ⇔ λ ( A +A T) ≽ 0 (1397) x T Ax > 0 ∀x ≠ 0 ⇔ λ ( A +A T) ≻ 0 (1398) because x T (A −A T )x=0. (1335) Now arrange the entries of λ ( 1 (A 2 +AT ) ) and λ ( 1 (B 2 +BT ) ) in nonincreasing order so λ ( 1 (A 2 +AT ) ) holds the 1 largest eigenvalue of symmetrized A while λ ( 1 (B 2 +BT ) ) holds the largest 1 eigenvalue of symmetrized B , and so on. Then [176,7.7, prob.1, prob.9] for κ ∈ R x T Ax ≥ x T Bx ∀x ⇒ λ ( A +A T) ≽ λ ( B +B T) x T Ax ≥ x T Ixκ ∀x ⇔ λ ( 1 2 (A +AT ) ) ≽ κ1 (1399)
- Page 501 and 502: 501 7.0.3 Problem approach Problems
- Page 503 and 504: 7.1. FIRST PREVALENT PROBLEM: 503 f
- Page 505 and 506: 7.1. FIRST PREVALENT PROBLEM: 505 7
- Page 507 and 508: 7.1. FIRST PREVALENT PROBLEM: 507 d
- Page 509 and 510: 7.1. FIRST PREVALENT PROBLEM: 509 7
- Page 511 and 512: 7.1. FIRST PREVALENT PROBLEM: 511 w
- Page 513 and 514: 7.1. FIRST PREVALENT PROBLEM: 513 T
- Page 515 and 516: 7.2. SECOND PREVALENT PROBLEM: 515
- Page 517 and 518: 7.2. SECOND PREVALENT PROBLEM: 517
- Page 519 and 520: 7.2. SECOND PREVALENT PROBLEM: 519
- Page 521 and 522: 7.2. SECOND PREVALENT PROBLEM: 521
- Page 523 and 524: 7.2. SECOND PREVALENT PROBLEM: 523
- Page 525 and 526: 7.3. THIRD PREVALENT PROBLEM: 525 g
- Page 527 and 528: 7.3. THIRD PREVALENT PROBLEM: 527 w
- Page 529 and 530: 7.3. THIRD PREVALENT PROBLEM: 529 7
- Page 531 and 532: 7.3. THIRD PREVALENT PROBLEM: 531 7
- Page 533 and 534: 7.3. THIRD PREVALENT PROBLEM: 533 O
- Page 535 and 536: 7.4. CONCLUSION 535 The rank constr
- Page 537 and 538: Appendix A Linear algebra A.1 Main-
- Page 539 and 540: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 541 and 542: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 543 and 544: A.2. SEMIDEFINITENESS: DOMAIN OF TE
- Page 545 and 546: A.3. PROPER STATEMENTS 545 (AB) T
- Page 547 and 548: A.3. PROPER STATEMENTS 547 A.3.1 Se
- Page 549 and 550: A.3. PROPER STATEMENTS 549 For A di
- Page 551: A.3. PROPER STATEMENTS 551 Diagonal
- Page 555 and 556: A.3. PROPER STATEMENTS 555 A.3.1.0.
- Page 557 and 558: A.4. SCHUR COMPLEMENT 557 A.4 Schur
- Page 559 and 560: A.4. SCHUR COMPLEMENT 559 A.4.0.0.2
- Page 561 and 562: A.5. EIGEN DECOMPOSITION 561 When B
- Page 563 and 564: A.5. EIGEN DECOMPOSITION 563 dim N(
- Page 565 and 566: A.6. SINGULAR VALUE DECOMPOSITION,
- Page 567 and 568: A.6. SINGULAR VALUE DECOMPOSITION,
- Page 569 and 570: A.7. ZEROS 569 Given symmetric matr
- Page 571 and 572: A.7. ZEROS 571 (TRANSPOSE.) Likewis
- Page 573 and 574: A.7. ZEROS 573 For X,A∈ S M + [31
- Page 575 and 576: A.7. ZEROS 575 A.7.5.0.1 Propositio
- Page 577 and 578: Appendix B Simple matrices Mathemat
- Page 579 and 580: B.1. RANK-ONE MATRIX (DYAD) 579 R(v
- Page 581 and 582: B.1. RANK-ONE MATRIX (DYAD) 581 ran
- Page 583 and 584: B.2. DOUBLET 583 R([u v ]) R(Π)= R
- Page 585 and 586: B.3. ELEMENTARY MATRIX 585 If λ
- Page 587 and 588: B.4. AUXILIARY V -MATRICES 587 the
- Page 589 and 590: B.4. AUXILIARY V -MATRICES 589 18.
- Page 591 and 592: B.5. ORTHOGONAL MATRIX 591 B.5 Orth
- Page 593 and 594: B.5. ORTHOGONAL MATRIX 593 Figure 1
- Page 595 and 596: Appendix C Some analytical optimal
- Page 597 and 598: C.2. TRACE, SINGULAR AND EIGEN VALU
- Page 599 and 600: C.2. TRACE, SINGULAR AND EIGEN VALU
- Page 601 and 602: C.2. TRACE, SINGULAR AND EIGEN VALU
A.3. PROPER STATEMENTS 553<br />
For A,B ∈ S n [344,6.2, prob.1] (Theorem A.3.1.0.4)<br />
A ≽ B ⇒ trA ≥ trB (1389)<br />
A ≽ B ⇒ δ(A) ≽ δ(B) (1390)<br />
There is no converse, and restriction to the positive semidefinite cone<br />
does not improve the situation. The all-strict versions hold. From<br />
[344,6.2]<br />
A ≽ B ≽ 0 ⇒ rankA ≥ rankB (1391)<br />
A ≽ B ≽ 0 ⇒ detA ≥ detB ≥ 0 (1392)<br />
A ≻ B ≽ 0 ⇒ detA > detB ≥ 0 (1393)<br />
For A,B ∈ int S n + [31,4.2] [176,7.7.4]<br />
For A,B ∈ S n [344,6.2]<br />
A ≽ B ⇔ A −1 ≼ B −1 (1394)<br />
A ≽ B ≽ 0 ⇒ √ A ≽ √ B (1395)<br />
For A,B ∈ S n and AB = BA [344,6.2, prob.3]<br />
A ≽ B ≽ 0 ⇒ A k ≽ B k , k=1, 2,... (1396)<br />
A.3.1.0.1 Theorem. Positive semidefinite ordering of eigenvalues.<br />
For A,B∈ R M×M , place the eigenvalues of each symmetrized matrix into<br />
the respective vectors λ ( 1<br />
(A 2 +AT ) ) , λ ( 1<br />
(B 2 +BT ) ) ∈ R M . Then, [287,6]<br />
x T Ax ≥ 0 ∀x ⇔ λ ( A +A T) ≽ 0 (1397)<br />
x T Ax > 0 ∀x ≠ 0 ⇔ λ ( A +A T) ≻ 0 (1398)<br />
because x T (A −A T )x=0. (1335) Now arrange the entries of λ ( 1<br />
(A 2 +AT ) )<br />
and λ ( 1<br />
(B 2 +BT ) ) in nonincreasing order so λ ( 1<br />
(A 2 +AT ) ) holds the<br />
1<br />
largest eigenvalue of symmetrized A while λ ( 1<br />
(B 2 +BT ) ) holds the largest<br />
1<br />
eigenvalue of symmetrized B , and so on. Then [176,7.7, prob.1, prob.9]<br />
for κ ∈ R<br />
x T Ax ≥ x T Bx ∀x ⇒ λ ( A +A T) ≽ λ ( B +B T)<br />
x T Ax ≥ x T Ixκ ∀x ⇔ λ ( 1<br />
2 (A +AT ) ) ≽ κ1<br />
(1399)