v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
548 APPENDIX A. LINEAR ALGEBRA By similar reasoning, λ(I + µA) = 1 + λ(µA) (1355) For vector σ(A) holding the singular values of any matrix A σ(I + µA T A) = π(|1 + µσ(A T A)|) (1356) σ(µI + A T A) = π(|µ1 + σ(A T A)|) (1357) where π is the nonlinear permutation-operator sorting its vector argument into nonincreasing order. For A∈ S M and each and every ‖w‖= 1 [176,7.7, prob.9] w T Aw ≤ µ ⇔ A ≼ µI ⇔ λ(A) ≼ µ1 (1358) [176,2.5.4] (confer (37)) A is normal ⇔ ‖A‖ 2 F = λ(A) T λ(A) (1359) For A∈ R m×n A T A ≽ 0, AA T ≽ 0 (1360) because, for dimensionally compatible vector x , x T A T Ax = ‖Ax‖ 2 2 , x T AA T x = ‖A T x‖ 2 2 . For A∈ R n×n and c∈R tr(cA) = c tr(A) = c1 T λ(A) (A.1.1 no.4) For m a nonnegative integer, (1744) det(A m ) = tr(A m ) = n∏ λ(A) m i (1361) i=1 n∑ λ(A) m i (1362) i=1
A.3. PROPER STATEMENTS 549 For A diagonalizable (A.5), A = SΛS −1 , (confer [287, p.255]) rankA = rankδ(λ(A)) = rank Λ (1363) meaning, rank is equal to the number of nonzero eigenvalues in vector by the 0 eigenvalues theorem (A.7.3.0.1). (Ky Fan) For A,B∈ S n [48,1.2] (confer (1621)) λ(A) ∆ = δ(Λ) (1364) tr(AB) ≤ λ(A) T λ(B) (1365) with equality (Theobald) when A and B are simultaneously diagonalizable [176] with the same ordering of eigenvalues. For A∈ R m×n and B ∈ R n×m tr(AB) = tr(BA) (1366) and η eigenvalues of the product and commuted product are identical, including their multiplicity; [176,1.3.20] id est, λ(AB) 1:η = λ(BA) 1:η , η ∆ =min{m , n} (1367) Any eigenvalues remaining are zero. By the 0 eigenvalues theorem (A.7.3.0.1), rank(AB) = rank(BA), AB and BA diagonalizable (1368) For any compatible matrices A,B [176,0.4] min{rankA, rankB} ≥ rank(AB) (1369) For A,B ∈ S n + rankA + rankB ≥ rank(A + B) ≥ min{rankA, rankB} ≥ rank(AB) (1370) For A,B ∈ S n + linearly independent (B.1.1), rankA + rankB = rank(A + B) > min{rankA, rankB} ≥ rank(AB) (1371)
- Page 497 and 498: 497 project on the subspace, then p
- Page 499 and 500: 499 H S N h 0 EDM N K = S N h ∩ R
- Page 501 and 502: 501 7.0.3 Problem approach Problems
- Page 503 and 504: 7.1. FIRST PREVALENT PROBLEM: 503 f
- Page 505 and 506: 7.1. FIRST PREVALENT PROBLEM: 505 7
- Page 507 and 508: 7.1. FIRST PREVALENT PROBLEM: 507 d
- Page 509 and 510: 7.1. FIRST PREVALENT PROBLEM: 509 7
- Page 511 and 512: 7.1. FIRST PREVALENT PROBLEM: 511 w
- Page 513 and 514: 7.1. FIRST PREVALENT PROBLEM: 513 T
- Page 515 and 516: 7.2. SECOND PREVALENT PROBLEM: 515
- Page 517 and 518: 7.2. SECOND PREVALENT PROBLEM: 517
- Page 519 and 520: 7.2. SECOND PREVALENT PROBLEM: 519
- Page 521 and 522: 7.2. SECOND PREVALENT PROBLEM: 521
- Page 523 and 524: 7.2. SECOND PREVALENT PROBLEM: 523
- Page 525 and 526: 7.3. THIRD PREVALENT PROBLEM: 525 g
- Page 527 and 528: 7.3. THIRD PREVALENT PROBLEM: 527 w
- Page 529 and 530: 7.3. THIRD PREVALENT PROBLEM: 529 7
- Page 531 and 532: 7.3. THIRD PREVALENT PROBLEM: 531 7
- Page 533 and 534: 7.3. THIRD PREVALENT PROBLEM: 533 O
- Page 535 and 536: 7.4. CONCLUSION 535 The rank constr
- Page 537 and 538: Appendix A Linear algebra A.1 Main-
- Page 539 and 540: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 541 and 542: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 543 and 544: A.2. SEMIDEFINITENESS: DOMAIN OF TE
- Page 545 and 546: A.3. PROPER STATEMENTS 545 (AB) T
- Page 547: A.3. PROPER STATEMENTS 547 A.3.1 Se
- Page 551 and 552: A.3. PROPER STATEMENTS 551 Diagonal
- Page 553 and 554: A.3. PROPER STATEMENTS 553 For A,B
- Page 555 and 556: A.3. PROPER STATEMENTS 555 A.3.1.0.
- Page 557 and 558: A.4. SCHUR COMPLEMENT 557 A.4 Schur
- Page 559 and 560: A.4. SCHUR COMPLEMENT 559 A.4.0.0.2
- Page 561 and 562: A.5. EIGEN DECOMPOSITION 561 When B
- Page 563 and 564: A.5. EIGEN DECOMPOSITION 563 dim N(
- Page 565 and 566: A.6. SINGULAR VALUE DECOMPOSITION,
- Page 567 and 568: A.6. SINGULAR VALUE DECOMPOSITION,
- Page 569 and 570: A.7. ZEROS 569 Given symmetric matr
- Page 571 and 572: A.7. ZEROS 571 (TRANSPOSE.) Likewis
- Page 573 and 574: A.7. ZEROS 573 For X,A∈ S M + [31
- Page 575 and 576: A.7. ZEROS 575 A.7.5.0.1 Propositio
- Page 577 and 578: Appendix B Simple matrices Mathemat
- Page 579 and 580: B.1. RANK-ONE MATRIX (DYAD) 579 R(v
- Page 581 and 582: B.1. RANK-ONE MATRIX (DYAD) 581 ran
- Page 583 and 584: B.2. DOUBLET 583 R([u v ]) R(Π)= R
- Page 585 and 586: B.3. ELEMENTARY MATRIX 585 If λ
- Page 587 and 588: B.4. AUXILIARY V -MATRICES 587 the
- Page 589 and 590: B.4. AUXILIARY V -MATRICES 589 18.
- Page 591 and 592: B.5. ORTHOGONAL MATRIX 591 B.5 Orth
- Page 593 and 594: B.5. ORTHOGONAL MATRIX 593 Figure 1
- Page 595 and 596: Appendix C Some analytical optimal
- Page 597 and 598: C.2. TRACE, SINGULAR AND EIGEN VALU
548 APPENDIX A. LINEAR ALGEBRA<br />
By similar reasoning,<br />
λ(I + µA) = 1 + λ(µA) (1355)<br />
For vector σ(A) holding the singular values of any matrix A<br />
σ(I + µA T A) = π(|1 + µσ(A T A)|) (1356)<br />
σ(µI + A T A) = π(|µ1 + σ(A T A)|) (1357)<br />
where π is the nonlinear permutation-operator sorting its vector<br />
argument into nonincreasing order.<br />
For A∈ S M and each and every ‖w‖= 1 [176,7.7, prob.9]<br />
w T Aw ≤ µ ⇔ A ≼ µI ⇔ λ(A) ≼ µ1 (1358)<br />
[176,2.5.4] (confer (37))<br />
A is normal ⇔ ‖A‖ 2 F = λ(A) T λ(A) (1359)<br />
For A∈ R m×n A T A ≽ 0, AA T ≽ 0 (1360)<br />
because, for dimensionally compatible vector x , x T A T Ax = ‖Ax‖ 2 2 ,<br />
x T AA T x = ‖A T x‖ 2 2 .<br />
For A∈ R n×n and c∈R<br />
tr(cA) = c tr(A) = c1 T λ(A)<br />
(A.1.1 no.4)<br />
For m a nonnegative integer, (1744)<br />
det(A m ) =<br />
tr(A m ) =<br />
n∏<br />
λ(A) m i (1361)<br />
i=1<br />
n∑<br />
λ(A) m i (1362)<br />
i=1