v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
578 APPENDIX B. SIMPLE MATRICES B.1 Rank-one matrix (dyad) Any matrix formed from the unsigned outer product of two vectors, Ψ = uv T ∈ R M×N (1492) where u ∈ R M and v ∈ R N , is rank-one and called a dyad. Conversely, any rank-one matrix must have the form Ψ . [176, prob.1.4.1] Product −uv T is a negative dyad. For matrix products AB T , in general, we have R(AB T ) ⊆ R(A) , N(AB T ) ⊇ N(B T ) (1493) with equality when B =A [287,3.3,3.6] B.1 or respectively when B is invertible and N(A)=0. Yet for all nonzero dyads we have R(uv T ) = R(u) , N(uv T ) = N(v T ) ≡ v ⊥ (1494) where dim v ⊥ =N −1. It is obvious a dyad can be 0 only when u or v is 0; Ψ = uv T = 0 ⇔ u = 0 or v = 0 (1495) The matrix 2-norm for Ψ is equivalent to the Frobenius norm; ‖Ψ‖ 2 = ‖uv T ‖ F = ‖uv T ‖ 2 = ‖u‖ ‖v‖ (1496) When u and v are normalized, the pseudoinverse is the transposed dyad. Otherwise, Ψ † = (uv T ) † vu T = (1497) ‖u‖ 2 ‖v‖ 2 B.1 Proof. R(AA T ) ⊆ R(A) is obvious. R(AA T ) = {AA T y | y ∈ R m } ⊇ {AA T y | A T y ∈ R(A T )} = R(A) by (132)
B.1. RANK-ONE MATRIX (DYAD) 579 R(v) 0 0 R(Ψ) = R(u) N(Ψ)= N(v T ) N(u T ) R N = R(v) ⊕ N(uv T ) N(u T ) ⊕ R(uv T ) = R M Figure 132: The four fundamental subspaces [289,3.6] of any dyad Ψ = uv T ∈R M×N . Ψ(x) ∆ = uv T x is a linear mapping from R N to R M . The map from R(v) to R(u) is bijective. [287,3.1] When dyad uv T ∈R N×N is square, uv T has at least N −1 0-eigenvalues and corresponding eigenvectors spanning v ⊥ . The remaining eigenvector u spans the range of uv T with corresponding eigenvalue λ = v T u = tr(uv T ) ∈ R (1498) Determinant is a product of the eigenvalues; so, it is always true that det Ψ = det(uv T ) = 0 (1499) When λ = 1, the square dyad is a nonorthogonal projector projecting on its range (Ψ 2 =Ψ ,E.6); a projector dyad. It is quite possible that u∈v ⊥ making the remaining eigenvalue instead 0 ; B.2 λ = 0 together with the first N −1 0-eigenvalues; id est, it is possible uv T were nonzero while all its eigenvalues are 0. The matrix [ ] 1 [ 1 1] = −1 [ 1 1 −1 −1 ] (1500) for example, has two 0-eigenvalues. In other words, eigenvector u may simultaneously be a member of the nullspace and range of the dyad. The explanation is, simply, because u and v share the same dimension, dimu = M = dimv = N : B.2 A dyad is not always diagonalizable (A.5) because its eigenvectors are not necessarily independent.
- Page 527 and 528: 7.3. THIRD PREVALENT PROBLEM: 527 w
- Page 529 and 530: 7.3. THIRD PREVALENT PROBLEM: 529 7
- Page 531 and 532: 7.3. THIRD PREVALENT PROBLEM: 531 7
- Page 533 and 534: 7.3. THIRD PREVALENT PROBLEM: 533 O
- Page 535 and 536: 7.4. CONCLUSION 535 The rank constr
- Page 537 and 538: Appendix A Linear algebra A.1 Main-
- Page 539 and 540: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 541 and 542: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 543 and 544: A.2. SEMIDEFINITENESS: DOMAIN OF TE
- Page 545 and 546: A.3. PROPER STATEMENTS 545 (AB) T
- Page 547 and 548: A.3. PROPER STATEMENTS 547 A.3.1 Se
- Page 549 and 550: A.3. PROPER STATEMENTS 549 For A di
- Page 551 and 552: A.3. PROPER STATEMENTS 551 Diagonal
- Page 553 and 554: A.3. PROPER STATEMENTS 553 For A,B
- Page 555 and 556: A.3. PROPER STATEMENTS 555 A.3.1.0.
- Page 557 and 558: A.4. SCHUR COMPLEMENT 557 A.4 Schur
- Page 559 and 560: A.4. SCHUR COMPLEMENT 559 A.4.0.0.2
- Page 561 and 562: A.5. EIGEN DECOMPOSITION 561 When B
- Page 563 and 564: A.5. EIGEN DECOMPOSITION 563 dim N(
- Page 565 and 566: A.6. SINGULAR VALUE DECOMPOSITION,
- Page 567 and 568: A.6. SINGULAR VALUE DECOMPOSITION,
- Page 569 and 570: A.7. ZEROS 569 Given symmetric matr
- Page 571 and 572: A.7. ZEROS 571 (TRANSPOSE.) Likewis
- Page 573 and 574: A.7. ZEROS 573 For X,A∈ S M + [31
- Page 575 and 576: A.7. ZEROS 575 A.7.5.0.1 Propositio
- Page 577: Appendix B Simple matrices Mathemat
- Page 581 and 582: B.1. RANK-ONE MATRIX (DYAD) 581 ran
- Page 583 and 584: B.2. DOUBLET 583 R([u v ]) R(Π)= R
- Page 585 and 586: B.3. ELEMENTARY MATRIX 585 If λ
- Page 587 and 588: B.4. AUXILIARY V -MATRICES 587 the
- Page 589 and 590: B.4. AUXILIARY V -MATRICES 589 18.
- Page 591 and 592: B.5. ORTHOGONAL MATRIX 591 B.5 Orth
- Page 593 and 594: B.5. ORTHOGONAL MATRIX 593 Figure 1
- Page 595 and 596: Appendix C Some analytical optimal
- Page 597 and 598: C.2. TRACE, SINGULAR AND EIGEN VALU
- Page 599 and 600: C.2. TRACE, SINGULAR AND EIGEN VALU
- Page 601 and 602: C.2. TRACE, SINGULAR AND EIGEN VALU
- Page 603 and 604: C.3. ORTHOGONAL PROCRUSTES PROBLEM
- Page 605 and 606: C.4. TWO-SIDED ORTHOGONAL PROCRUSTE
- Page 607 and 608: C.4. TWO-SIDED ORTHOGONAL PROCRUSTE
- Page 609 and 610: Appendix D Matrix calculus From too
- Page 611 and 612: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 613 and 614: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 615 and 616: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 617 and 618: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 619 and 620: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 621 and 622: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 623 and 624: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 625 and 626: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
- Page 627 and 628: D.1. DIRECTIONAL DERIVATIVE, TAYLOR
B.1. RANK-ONE MATRIX (DYAD) 579<br />
R(v)<br />
0 0 <br />
R(Ψ) = R(u)<br />
N(Ψ)= N(v T )<br />
N(u T )<br />
R N = R(v) ⊕ N(uv T )<br />
N(u T ) ⊕ R(uv T ) = R M<br />
Figure 132:<br />
The four fundamental subspaces [289,3.6] of any dyad<br />
Ψ = uv T ∈R M×N . Ψ(x) ∆ = uv T x is a linear mapping from R N to R M . The<br />
map from R(v) to R(u) is bijective. [287,3.1]<br />
When dyad uv T ∈R N×N is square, uv T has at least N −1 0-eigenvalues<br />
and corresponding eigenvectors spanning v ⊥ . The remaining eigenvector u<br />
spans the range of uv T with corresponding eigenvalue<br />
λ = v T u = tr(uv T ) ∈ R (1498)<br />
Determinant is a product of the eigenvalues; so, it is always true that<br />
det Ψ = det(uv T ) = 0 (1499)<br />
When λ = 1, the square dyad is a nonorthogonal projector projecting on its<br />
range (Ψ 2 =Ψ ,E.6); a projector dyad. It is quite possible that u∈v ⊥ making<br />
the remaining eigenvalue instead 0 ; B.2 λ = 0 together with the first N −1<br />
0-eigenvalues; id est, it is possible uv T were nonzero while all its eigenvalues<br />
are 0. The matrix<br />
[ ] 1 [ 1 1]<br />
=<br />
−1<br />
[ 1 1<br />
−1 −1<br />
]<br />
(1500)<br />
for example, has two 0-eigenvalues. In other words, eigenvector u may<br />
simultaneously be a member of the nullspace and range of the dyad.<br />
The explanation is, simply, because u and v share the same dimension,<br />
dimu = M = dimv = N :<br />
B.2 A dyad is not always diagonalizable (A.5) because its eigenvectors are not necessarily<br />
independent.