v2010.10.26 - Convex Optimization
v2010.10.26 - Convex Optimization v2010.10.26 - Convex Optimization
58 CHAPTER 2. CONVEX GEOMETRYwords, S M is isometrically isomorphic with R M(M+1)/2 in the Euclidean senseunder transformation svec .The set of all symmetric matrices S M forms a proper subspace in R M×M ,so for it there exists a standard orthonormal basis in isometrically isomorphicR M(M+1)/2 ⎧⎨{E ij ∈ S M } =⎩e i e T i ,1 √2(e i e T j + e j e T ii = j = 1... M), 1 ≤ i < j ≤ M⎫⎬⎭(59)where M(M + 1)/2 standard basis matrices E ij are formed from thestandard basis vectors[{ ]1, i = je i =0, i ≠ j , j = 1... M ∈ R M (60)Thus we have a basic orthogonal expansion for Y ∈ S MY =M∑ j∑〈E ij ,Y 〉 E ij (61)j=1 i=1whose coefficients〈E ij ,Y 〉 ={Yii , i = 1... MY ij√2 , 1 ≤ i < j ≤ M(62)correspond to entries of the symmetric vectorization (56).2.2.3 Symmetric hollow subspace2.2.3.0.1 Definition. Hollow subspaces. [352]Define a subspace of R M×M : the convex set of all (real) symmetric M ×Mmatrices having 0 main diagonal;R M×Mh { A∈ R M×M | A=A T , δ(A) = 0 } ⊂ R M×M (63)where the main diagonal of A∈ R M×M is denoted (A.1)δ(A) ∈ R M (1415)
2.2. VECTORIZED-MATRIX INNER PRODUCT 59Operating on a vector, linear operator δ naturally returns a diagonal matrix;δ(δ(A)) is a diagonal matrix. Operating recursively on a vector Λ∈ R N ordiagonal matrix Λ∈ S N , operator δ(δ(Λ)) returns Λ itself;δ 2 (Λ) ≡ δ(δ(Λ)) = Λ (1417)The subspace R M×Mh(63) comprising (real) symmetric hollow matrices isisomorphic with subspace R M(M−1)/2 ; its orthogonal complement isR M×M⊥h { A∈ R M×M | A=−A T + 2δ 2 (A) } ⊆ R M×M (64)the subspace of antisymmetric antihollow matrices in R M×M ; id est,R M×Mh⊕ R M×M⊥h= R M×M (65)Yet defined instead as a proper subspace of ambient S MS M h { A∈ S M | δ(A) = 0 } ≡ R M×Mh⊂ S M (66)the orthogonal complement S M⊥h of symmetric hollow subspace S M h ,S M⊥h { A∈ S M | A=δ 2 (A) } ⊆ S M (67)called symmetric antihollow subspace, is simply the subspace of diagonalmatrices; id est,S M h ⊕ S M⊥h = S M (68)△Any matrix A∈ R M×M can be written as a sum of its symmetric hollowand antisymmetric antihollow parts: respectively,( ) ( 1 1A =2 (A +AT ) − δ 2 (A) +2 (A −AT ) + δ (A))2 (69)The symmetric hollow part is orthogonal to the antisymmetric antihollowpart in R M2 ; videlicet,))1 1tr((2 (A +AT ) − δ (A))( 2 2 (A −AT ) + δ 2 (A) = 0 (70)
- Page 7 and 8: PreludeThe constant demands of my d
- Page 9 and 10: Convex Optimization&Euclidean Dista
- Page 11 and 12: CONVEX OPTIMIZATION & EUCLIDEAN DIS
- Page 13 and 14: List of Figures1 Overview 211 Orion
- Page 15 and 16: LIST OF FIGURES 1562 Shrouded polyh
- Page 17: LIST OF FIGURES 17130 Elliptope E 3
- Page 21 and 22: Chapter 1OverviewConvex Optimizatio
- Page 23 and 24: ˇx 4ˇx 3ˇx 2Figure 2: Applicatio
- Page 25 and 26: 25Figure 4: This coarsely discretiz
- Page 27 and 28: (biorthogonal expansion) is examine
- Page 29 and 30: 29cardinality Boolean solution to a
- Page 31 and 32: 31Figure 8: Robotic vehicles in con
- Page 33 and 34: an elaborate exposition offering in
- Page 35 and 36: Chapter 2Convex geometryConvexity h
- Page 37 and 38: 2.1. CONVEX SET 372.1.2 linear inde
- Page 39 and 40: 2.1. CONVEX SET 392.1.6 empty set v
- Page 41 and 42: 2.1. CONVEX SET 41(a)R(b)R 2(c)R 3F
- Page 43 and 44: 2.1. CONVEX SET 43where Q∈ R 3×3
- Page 45 and 46: 2.1. CONVEX SET 45Now let’s move
- Page 47 and 48: 2.1. CONVEX SET 47By additive inver
- Page 49 and 50: 2.1. CONVEX SET 49R nR mR(A T )x px
- Page 51 and 52: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 53 and 54: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 55 and 56: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 57: 2.2. VECTORIZED-MATRIX INNER PRODUC
- Page 61 and 62: 2.3. HULLS 61Figure 20: Convex hull
- Page 63 and 64: 2.3. HULLS 63Aaffine hull (drawn tr
- Page 65 and 66: 2.3. HULLS 65subset of the affine h
- Page 67 and 68: 2.3. HULLS 672.3.2.0.2 Example. Nuc
- Page 69 and 70: 2.3. HULLS 692.3.2.0.3 Exercise. Co
- Page 71 and 72: 2.3. HULLS 71Figure 24: A simplicia
- Page 73 and 74: 2.4. HALFSPACE, HYPERPLANE 73H + =
- Page 75 and 76: 2.4. HALFSPACE, HYPERPLANE 7511−1
- Page 77 and 78: 2.4. HALFSPACE, HYPERPLANE 772.4.2.
- Page 79 and 80: 2.4. HALFSPACE, HYPERPLANE 792.4.2.
- Page 81 and 82: 2.4. HALFSPACE, HYPERPLANE 81tradit
- Page 83 and 84: 2.4. HALFSPACE, HYPERPLANE 832.4.2.
- Page 85 and 86: 2.5. SUBSPACE REPRESENTATIONS 852.5
- Page 87 and 88: 2.5. SUBSPACE REPRESENTATIONS 87(Ex
- Page 89 and 90: 2.5. SUBSPACE REPRESENTATIONS 89(a)
- Page 91 and 92: 2.5. SUBSPACE REPRESENTATIONS 91are
- Page 93 and 94: 2.6. EXTREME, EXPOSED 93A one-dimen
- Page 95 and 96: 2.6. EXTREME, EXPOSED 952.6.1.1 Den
- Page 97 and 98: 2.7. CONES 97X(a)00(b)XFigure 33: (
- Page 99 and 100: 2.7. CONES 99XXFigure 37: Truncated
- Page 101 and 102: 2.7. CONES 101Figure 39: Not a cone
- Page 103 and 104: 2.7. CONES 103cone that is a halfli
- Page 105 and 106: 2.7. CONES 105A pointed closed conv
- Page 107 and 108: 2.8. CONE BOUNDARY 107That means th
58 CHAPTER 2. CONVEX GEOMETRYwords, S M is isometrically isomorphic with R M(M+1)/2 in the Euclidean senseunder transformation svec .The set of all symmetric matrices S M forms a proper subspace in R M×M ,so for it there exists a standard orthonormal basis in isometrically isomorphicR M(M+1)/2 ⎧⎨{E ij ∈ S M } =⎩e i e T i ,1 √2(e i e T j + e j e T ii = j = 1... M), 1 ≤ i < j ≤ M⎫⎬⎭(59)where M(M + 1)/2 standard basis matrices E ij are formed from thestandard basis vectors[{ ]1, i = je i =0, i ≠ j , j = 1... M ∈ R M (60)Thus we have a basic orthogonal expansion for Y ∈ S MY =M∑ j∑〈E ij ,Y 〉 E ij (61)j=1 i=1whose coefficients〈E ij ,Y 〉 ={Yii , i = 1... MY ij√2 , 1 ≤ i < j ≤ M(62)correspond to entries of the symmetric vectorization (56).2.2.3 Symmetric hollow subspace2.2.3.0.1 Definition. Hollow subspaces. [352]Define a subspace of R M×M : the convex set of all (real) symmetric M ×Mmatrices having 0 main diagonal;R M×Mh { A∈ R M×M | A=A T , δ(A) = 0 } ⊂ R M×M (63)where the main diagonal of A∈ R M×M is denoted (A.1)δ(A) ∈ R M (1415)