v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
592 APPENDIX A. LINEAR ALGEBRAA.1.1IdentitiesThis δ notation is efficient and unambiguous as illustrated in the followingexamples where: A ◦ B denotes Hadamard product [202] [159,1.1.4] ofmatrices of like size, ⊗ Kronecker product [166] (D.1.2.1), y a vector, Xa matrix, e i the i th member of the standard basis for R n , S N h the symmetrichollow subspace, σ(A) a vector of (nonincreasingly) ordered singular values,and λ(A) a vector of nonincreasingly ordered eigenvalues of matrix A :1. δ(A) = δ(A T )2. tr(A) = tr(A T ) = δ(A) T 1 = 〈I, A〉3. δ(cA) = cδ(A) c∈R4. tr(cA) = c tr(A) = c1 T λ(A) c∈R5. vec(cA) = c vec(A) c∈R6. A ◦ cB = cA ◦ B c∈R7. A ⊗ cB = cA ⊗ B c∈R8. δ(A + B) = δ(A) + δ(B)9. tr(A + B) = tr(A) + tr(B)10. vec(A + B) = vec(A) + vec(B)11. (A + B) ◦ C = A ◦ C + B ◦ CA ◦ (B + C) = A ◦ B + A ◦ C12. (A + B) ⊗ C = A ⊗ C + B ⊗ CA ⊗ (B + C) = A ⊗ B + A ⊗ C13. sgn(c)λ(|c|A) = cλ(A) c∈R14. sgn(c)σ(|c|A) = cσ(A) c∈R15. tr(c √ A T A) = c tr √ A T A = c1 T σ(A) c∈R16. π(δ(A)) = λ(I ◦A) where π is the presorting function.17. δ(AB) = (A ◦ B T )1 = (B T ◦ A)118. δ(AB) T = 1 T (A T ◦ B) = 1 T (B ◦ A T )
A.1. MAIN-DIAGONAL δ OPERATOR, λ , TRACE, VEC 593⎡ ⎤u 1 v 119. δ(uv T ⎢ ⎥) = ⎣ . ⎦ = u ◦ v ,u N v Nu,v ∈ R N20. tr(A T B) = tr(AB T ) = tr(BA T ) = tr(B T A)= 1 T (A ◦ B)1 = 1 T δ(AB T ) = δ(A T B) T 1 = δ(BA T ) T 1 = δ(B T A) T 121. D = [d ij ] ∈ S N h , H = [h ij ] ∈ S N h , V = I − 1 N 11T ∈ S N (conferB.4.2 no.20)N tr(−V (D ◦ H)V ) = tr(D T H) = 1 T (D ◦ H)1 = tr(11 T (D ◦ H)) = ∑ d ij h iji,j22. tr(ΛA) = δ(Λ) T δ(A), δ 2 (Λ) Λ ∈ S N23. y T Bδ(A) = tr ( Bδ(A)y T) = tr ( δ(B T y)A ) = tr ( Aδ(B T y) )= δ(A) T B T y = tr ( yδ(A) T B T) = tr ( A T δ(B T y) ) = tr ( δ(B T y)A T)24. δ 2 (A T A) = ∑ ie i e T iA T Ae i e T i25. δ ( δ(A)1 T) = δ ( 1δ(A) T) = δ(A)26. δ(A1)1 = δ(A11 T ) = A1 , δ(y)1 = δ(y1 T ) = y27. δ(I1) = δ(1) = I28. δ(e i e T j 1) = δ(e i ) = e i e T i29. For ζ =[ζ i ]∈ R k and x=[x i ]∈ R k ,30.∑ζ i /x i = ζ T δ(x) −1 1vec(A ◦ B) = vec(A) ◦ vec(B) = δ(vecA) vec(B)= vec(B) ◦ vec(A) = δ(vecB) vec(A)31. vec(AXB) = (B T ⊗ A) vec X32. vec(BXA) = (A T ⊗ B) vec Xi(42)(1787)(notH )33.34.tr(AXBX T ) = vec(X) T vec(AXB) = vec(X) T (B T ⊗ A) vec X [166]= δ ( vec(X) vec(X) T (B T ⊗ A) ) T1tr(AX T BX) = vec(X) T vec(BXA) = vec(X) T (A T ⊗ B) vec X= δ ( vec(X) vec(X) T (A T ⊗ B) ) T1
- Page 541 and 542: 6.8. DUAL EDM CONE 5416.8.1.7 Schoe
- Page 543 and 544: 6.8. DUAL EDM CONE 5430dvec rel ∂
- Page 545 and 546: 6.10. POSTSCRIPT 5456.10 Postscript
- Page 547 and 548: Chapter 7Proximity problemsIn the
- Page 549 and 550: 549project on the subspace, then pr
- Page 551 and 552: 551HS N h0EDM NK = S N h ∩ R N×N
- Page 553 and 554: 5537.0.3 Problem approachProblems t
- Page 555 and 556: 7.1. FIRST PREVALENT PROBLEM: 555fi
- Page 557 and 558: 7.1. FIRST PREVALENT PROBLEM: 5577.
- Page 559 and 560: 7.1. FIRST PREVALENT PROBLEM: 559di
- Page 561 and 562: 7.1. FIRST PREVALENT PROBLEM: 5617.
- Page 563 and 564: 7.1. FIRST PREVALENT PROBLEM: 563wh
- Page 565 and 566: 7.1. FIRST PREVALENT PROBLEM: 565Th
- Page 567 and 568: 7.2. SECOND PREVALENT PROBLEM: 567O
- Page 569 and 570: 7.2. SECOND PREVALENT PROBLEM: 569S
- Page 571 and 572: 7.2. SECOND PREVALENT PROBLEM: 571r
- Page 573 and 574: 7.2. SECOND PREVALENT PROBLEM: 573w
- Page 575 and 576: 7.2. SECOND PREVALENT PROBLEM: 5757
- Page 577 and 578: 7.2. SECOND PREVALENT PROBLEM: 577a
- Page 579 and 580: 7.3. THIRD PREVALENT PROBLEM: 579is
- Page 581 and 582: 7.3. THIRD PREVALENT PROBLEM: 581We
- Page 583 and 584: 7.3. THIRD PREVALENT PROBLEM: 583su
- Page 585 and 586: 7.3. THIRD PREVALENT PROBLEM: 585Gi
- Page 587 and 588: 7.3. THIRD PREVALENT PROBLEM: 587Op
- Page 589 and 590: 7.4. CONCLUSION 589filtering, multi
- Page 591: Appendix ALinear algebraA.1 Main-di
- Page 595 and 596: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 597 and 598: A.2. SEMIDEFINITENESS: DOMAIN OF TE
- Page 599 and 600: A.3. PROPER STATEMENTS 599(AB) T
- Page 601 and 602: A.3. PROPER STATEMENTS 601A.3.1Semi
- Page 603 and 604: A.3. PROPER STATEMENTS 603For A dia
- Page 605 and 606: A.3. PROPER STATEMENTS 605Diagonali
- Page 607 and 608: A.3. PROPER STATEMENTS 607For A,B
- Page 609 and 610: A.3. PROPER STATEMENTS 609When B is
- Page 611 and 612: A.4. SCHUR COMPLEMENT 611A.4 Schur
- Page 613 and 614: A.4. SCHUR COMPLEMENT 613A.4.0.0.3
- Page 615 and 616: A.4. SCHUR COMPLEMENT 615From Corol
- Page 617 and 618: A.5. EIGENVALUE DECOMPOSITION 617wh
- Page 619 and 620: A.5. EIGENVALUE DECOMPOSITION 619A.
- Page 621 and 622: A.6. SINGULAR VALUE DECOMPOSITION,
- Page 623 and 624: A.6. SINGULAR VALUE DECOMPOSITION,
- Page 625 and 626: A.7. ZEROS 625A.6.5SVD of symmetric
- Page 627 and 628: A.7. ZEROS 627(Transpose.)Likewise,
- Page 629 and 630: A.7. ZEROS 629For X,A∈ S M +[34,2
- Page 631 and 632: A.7. ZEROS 631A.7.5.0.1 Proposition
- Page 633 and 634: Appendix BSimple matricesMathematic
- Page 635 and 636: B.1. RANK-ONE MATRIX (DYAD) 635R(v)
- Page 637 and 638: B.1. RANK-ONE MATRIX (DYAD) 637B.1.
- Page 639 and 640: B.2. DOUBLET 639R([u v ])R(Π)= R([
- Page 641 and 642: B.3. ELEMENTARY MATRIX 641has N −
592 APPENDIX A. LINEAR ALGEBRAA.1.1IdentitiesThis δ notation is efficient and unambiguous as illustrated in the followingexamples where: A ◦ B denotes Hadamard product [202] [159,1.1.4] ofmatrices of like size, ⊗ Kronecker product [166] (D.1.2.1), y a vector, Xa matrix, e i the i th member of the standard basis for R n , S N h the symmetrichollow subspace, σ(A) a vector of (nonincreasingly) ordered singular values,and λ(A) a vector of nonincreasingly ordered eigenvalues of matrix A :1. δ(A) = δ(A T )2. tr(A) = tr(A T ) = δ(A) T 1 = 〈I, A〉3. δ(cA) = cδ(A) c∈R4. tr(cA) = c tr(A) = c1 T λ(A) c∈R5. vec(cA) = c vec(A) c∈R6. A ◦ cB = cA ◦ B c∈R7. A ⊗ cB = cA ⊗ B c∈R8. δ(A + B) = δ(A) + δ(B)9. tr(A + B) = tr(A) + tr(B)10. vec(A + B) = vec(A) + vec(B)11. (A + B) ◦ C = A ◦ C + B ◦ CA ◦ (B + C) = A ◦ B + A ◦ C12. (A + B) ⊗ C = A ⊗ C + B ⊗ CA ⊗ (B + C) = A ⊗ B + A ⊗ C13. sgn(c)λ(|c|A) = cλ(A) c∈R14. sgn(c)σ(|c|A) = cσ(A) c∈R15. tr(c √ A T A) = c tr √ A T A = c1 T σ(A) c∈R16. π(δ(A)) = λ(I ◦A) where π is the presorting function.17. δ(AB) = (A ◦ B T )1 = (B T ◦ A)118. δ(AB) T = 1 T (A T ◦ B) = 1 T (B ◦ A T )