v2007.09.13 - Convex Optimization
v2007.09.13 - Convex Optimization v2007.09.13 - Convex Optimization
596 APPENDIX E. PROJECTIONa ∗ 2K ∗a 2a ∗ 1xzKya 10a 1 ⊥ a ∗ 2a 2 ⊥ a ∗ 1x = y + z = P a1 x + P a2 xK ∗Figure 118: (confer Figure 49) Biorthogonal expansion of point x∈aff Kis found by projecting x nonorthogonally on range of extreme directions ofpolyhedral cone K ⊂ R 2 . Direction of projection on extreme direction a 1 isorthogonal to extreme direction a ∗ 1 of dual cone K ∗ and parallel to a 2 (E.3.5);similarly, direction of projection on a 2 is orthogonal to a ∗ 2 and parallel toa 1 . Point x is sum of nonorthogonal projections: x on R(a 1 ) and x onR(a 2 ). Expansion is unique because extreme directions of K are linearlyindependent. Were a 1 orthogonal to a 2 , then K would be identical to K ∗and nonorthogonal projections would become orthogonal.
E.5. PROJECTION EXAMPLES 597of relative dual cone K ∗ ∩aff K=cone(A †T ) (2.13.9.4) correspond to thelinearly independent (B.1.1.1) rows of A † . Directions of nonorthogonalprojection are determined by the pseudoinverse; id est, direction ofprojection a i a ∗Ti x−x on R(a i ) is orthogonal to a ∗ i . E.8Because the extreme directions of this cone K are linearly independent,the component projections are unique in the sense:there is only one linear combination of extreme directions of K thatyields a particular point x∈ R(A) wheneverR(A) = aff K = R(a 1 ) ⊕ R(a 2 ) ⊕ ... ⊕ R(a n ) (1702)E.5.0.0.4 Example. Nonorthogonal projection on elementary matrix.Suppose P Y is a linear nonorthogonal projector projecting on subspace Y ,and suppose the range of a vector u is linearly independent of Y ; id est,for some other subspace M containing Y supposeM = R(u) ⊕ Y (1703)Assuming P M x = P u x + P Y x holds, then it follows for vector x∈MP u x = x − P Y x , P Y x = x − P u x (1704)nonorthogonal projection of x on R(u) can be determined fromnonorthogonal projection of x on Y , and vice versa.Such a scenario is realizable were there some arbitrary basis for Ypopulating a full-rank skinny-or-square matrix AA ∆ = [ basis Y u ] ∈ R n+1 (1705)Then P M =AA † fulfills the requirements, with P u =A(:,n + 1)A † (n + 1,:)and P Y =A(:,1 : n)A † (1 : n,:). Observe, P M is an orthogonal projectorwhereas P Y and P u are nonorthogonal projectors.Now suppose, for example, P Y is an elementary matrix (B.3); inparticular,P Y = I − e 1 1 T =[0 √ ]2V N ∈ R N×N (1706)E.8 This remains true in high dimension although only a little more difficult to visualizein R 3 ; confer , Figure 50.
- Page 546 and 547: 546 APPENDIX C. SOME ANALYTICAL OPT
- Page 548 and 549: 548 APPENDIX C. SOME ANALYTICAL OPT
- Page 550 and 551: 550 APPENDIX D. MATRIX CALCULUSThe
- Page 552 and 553: 552 APPENDIX D. MATRIX CALCULUSGrad
- Page 554 and 555: 554 APPENDIX D. MATRIX CALCULUSBeca
- Page 556 and 557: 556 APPENDIX D. MATRIX CALCULUSwhic
- Page 558 and 559: 558 APPENDIX D. MATRIX CALCULUS⎡
- Page 560 and 561: 560 APPENDIX D. MATRIX CALCULUS→Y
- Page 562 and 563: 562 APPENDIX D. MATRIX CALCULUSD.1.
- Page 564 and 565: 564 APPENDIX D. MATRIX CALCULUSwhic
- Page 566 and 567: 566 APPENDIX D. MATRIX CALCULUSIn t
- Page 568 and 569: 568 APPENDIX D. MATRIX CALCULUSD.1.
- Page 570 and 571: 570 APPENDIX D. MATRIX CALCULUSD.2
- Page 572 and 573: 572 APPENDIX D. MATRIX CALCULUSalge
- Page 574 and 575: 574 APPENDIX D. MATRIX CALCULUStrac
- Page 576 and 577: 576 APPENDIX D. MATRIX CALCULUSD.2.
- Page 578 and 579: 578 APPENDIX D. MATRIX CALCULUS
- Page 580 and 581: 580 APPENDIX E. PROJECTIONThe follo
- Page 582 and 583: 582 APPENDIX E. PROJECTIONFor matri
- Page 584 and 585: 584 APPENDIX E. PROJECTION(⇐) To
- Page 586 and 587: 586 APPENDIX E. PROJECTIONNonorthog
- Page 588 and 589: 588 APPENDIX E. PROJECTIONE.2.0.0.1
- Page 590 and 591: 590 APPENDIX E. PROJECTIONE.3.2Orth
- Page 592 and 593: 592 APPENDIX E. PROJECTIONE.3.5Unif
- Page 594 and 595: 594 APPENDIX E. PROJECTIONE.4 Algeb
- Page 598 and 599: 598 APPENDIX E. PROJECTIONwhere Y =
- Page 600 and 601: 600 APPENDIX E. PROJECTION(B.4.2).
- Page 602 and 603: 602 APPENDIX E. PROJECTIONis a nono
- Page 604 and 605: 604 APPENDIX E. PROJECTIONE.6.4.1Or
- Page 606 and 607: 606 APPENDIX E. PROJECTIONq i q T i
- Page 608 and 609: 608 APPENDIX E. PROJECTIONThe test
- Page 610 and 611: 610 APPENDIX E. PROJECTIONPerpendic
- Page 612 and 613: 612 APPENDIX E. PROJECTIONE.8 Range
- Page 614 and 615: 614 APPENDIX E. PROJECTIONAs for su
- Page 616 and 617: 616 APPENDIX E. PROJECTIONWith refe
- Page 618 and 619: 618 APPENDIX E. PROJECTIONProjectio
- Page 620 and 621: 620 APPENDIX E. PROJECTIONE.9.2.2.2
- Page 622 and 623: 622 APPENDIX E. PROJECTIONThe foreg
- Page 624 and 625: 624 APPENDIX E. PROJECTION❇❇❇
- Page 626 and 627: 626 APPENDIX E. PROJECTIONE.10 Alte
- Page 628 and 629: 628 APPENDIX E. PROJECTIONbH 1H 2P
- Page 630 and 631: 630 APPENDIX E. PROJECTIONa(a){y |
- Page 632 and 633: 632 APPENDIX E. PROJECTION(a feasib
- Page 634 and 635: 634 APPENDIX E. PROJECTIONwhile, th
- Page 636 and 637: 636 APPENDIX E. PROJECTIONE.10.2.1.
- Page 638 and 639: 638 APPENDIX E. PROJECTION10 0dist(
- Page 640 and 641: 640 APPENDIX E. PROJECTIONE.10.3.1D
- Page 642 and 643: 642 APPENDIX E. PROJECTIONE 3K ⊥
- Page 644 and 645: 644 APPENDIX E. PROJECTION
596 APPENDIX E. PROJECTIONa ∗ 2K ∗a 2a ∗ 1xzKya 10a 1 ⊥ a ∗ 2a 2 ⊥ a ∗ 1x = y + z = P a1 x + P a2 xK ∗Figure 118: (confer Figure 49) Biorthogonal expansion of point x∈aff Kis found by projecting x nonorthogonally on range of extreme directions ofpolyhedral cone K ⊂ R 2 . Direction of projection on extreme direction a 1 isorthogonal to extreme direction a ∗ 1 of dual cone K ∗ and parallel to a 2 (E.3.5);similarly, direction of projection on a 2 is orthogonal to a ∗ 2 and parallel toa 1 . Point x is sum of nonorthogonal projections: x on R(a 1 ) and x onR(a 2 ). Expansion is unique because extreme directions of K are linearlyindependent. Were a 1 orthogonal to a 2 , then K would be identical to K ∗and nonorthogonal projections would become orthogonal.