v2009.01.01 - Convex Optimization

v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

578 APPENDIX B. SIMPLE MATRICES B.1 Rank-one matrix (dyad) Any matrix formed from the unsigned outer product of two vectors, Ψ = uv T ∈ R M×N (1492) where u ∈ R M and v ∈ R N , is rank-one and called a dyad. Conversely, any rank-one matrix must have the form Ψ . [176, prob.1.4.1] Product −uv T is a negative dyad. For matrix products AB T , in general, we have R(AB T ) ⊆ R(A) , N(AB T ) ⊇ N(B T ) (1493) with equality when B =A [287,3.3,3.6] B.1 or respectively when B is invertible and N(A)=0. Yet for all nonzero dyads we have R(uv T ) = R(u) , N(uv T ) = N(v T ) ≡ v ⊥ (1494) where dim v ⊥ =N −1. It is obvious a dyad can be 0 only when u or v is 0; Ψ = uv T = 0 ⇔ u = 0 or v = 0 (1495) The matrix 2-norm for Ψ is equivalent to the Frobenius norm; ‖Ψ‖ 2 = ‖uv T ‖ F = ‖uv T ‖ 2 = ‖u‖ ‖v‖ (1496) When u and v are normalized, the pseudoinverse is the transposed dyad. Otherwise, Ψ † = (uv T ) † vu T = (1497) ‖u‖ 2 ‖v‖ 2 B.1 Proof. R(AA T ) ⊆ R(A) is obvious. R(AA T ) = {AA T y | y ∈ R m } ⊇ {AA T y | A T y ∈ R(A T )} = R(A) by (132)

B.1. RANK-ONE MATRIX (DYAD) 579 R(v) 0 0 R(Ψ) = R(u) N(Ψ)= N(v T ) N(u T ) R N = R(v) ⊕ N(uv T ) N(u T ) ⊕ R(uv T ) = R M Figure 132: The four fundamental subspaces [289,3.6] of any dyad Ψ = uv T ∈R M×N . Ψ(x) ∆ = uv T x is a linear mapping from R N to R M . The map from R(v) to R(u) is bijective. [287,3.1] When dyad uv T ∈R N×N is square, uv T has at least N −1 0-eigenvalues and corresponding eigenvectors spanning v ⊥ . The remaining eigenvector u spans the range of uv T with corresponding eigenvalue λ = v T u = tr(uv T ) ∈ R (1498) Determinant is a product of the eigenvalues; so, it is always true that det Ψ = det(uv T ) = 0 (1499) When λ = 1, the square dyad is a nonorthogonal projector projecting on its range (Ψ 2 =Ψ ,E.6); a projector dyad. It is quite possible that u∈v ⊥ making the remaining eigenvalue instead 0 ; B.2 λ = 0 together with the first N −1 0-eigenvalues; id est, it is possible uv T were nonzero while all its eigenvalues are 0. The matrix [ ] 1 [ 1 1] = −1 [ 1 1 −1 −1 ] (1500) for example, has two 0-eigenvalues. In other words, eigenvector u may simultaneously be a member of the nullspace and range of the dyad. The explanation is, simply, because u and v share the same dimension, dimu = M = dimv = N : B.2 A dyad is not always diagonalizable (A.5) because its eigenvectors are not necessarily independent.

B.1. RANK-ONE MATRIX (DYAD) 579<br />

R(v)<br />

0 0 <br />

R(Ψ) = R(u)<br />

N(Ψ)= N(v T )<br />

N(u T )<br />

R N = R(v) ⊕ N(uv T )<br />

N(u T ) ⊕ R(uv T ) = R M<br />

Figure 132:<br />

The four fundamental subspaces [289,3.6] of any dyad<br />

Ψ = uv T ∈R M×N . Ψ(x) ∆ = uv T x is a linear mapping from R N to R M . The<br />

map from R(v) to R(u) is bijective. [287,3.1]<br />

When dyad uv T ∈R N×N is square, uv T has at least N −1 0-eigenvalues<br />

and corresponding eigenvectors spanning v ⊥ . The remaining eigenvector u<br />

spans the range of uv T with corresponding eigenvalue<br />

λ = v T u = tr(uv T ) ∈ R (1498)<br />

Determinant is a product of the eigenvalues; so, it is always true that<br />

det Ψ = det(uv T ) = 0 (1499)<br />

When λ = 1, the square dyad is a nonorthogonal projector projecting on its<br />

range (Ψ 2 =Ψ ,E.6); a projector dyad. It is quite possible that u∈v ⊥ making<br />

the remaining eigenvalue instead 0 ; B.2 λ = 0 together with the first N −1<br />

0-eigenvalues; id est, it is possible uv T were nonzero while all its eigenvalues<br />

are 0. The matrix<br />

[ ] 1 [ 1 1]<br />

=<br />

−1<br />

[ 1 1<br />

−1 −1<br />

]<br />

(1500)<br />

for example, has two 0-eigenvalues. In other words, eigenvector u may<br />

simultaneously be a member of the nullspace and range of the dyad.<br />

The explanation is, simply, because u and v share the same dimension,<br />

dimu = M = dimv = N :<br />

B.2 A dyad is not always diagonalizable (A.5) because its eigenvectors are not necessarily<br />

independent.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!