v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
496 CHAPTER 7. PROXIMITY PROBLEMS 7.0.1 Measurement matrix H Ideally, we want a given matrix of measurements H ∈ R N×N to conform with the first three Euclidean metric properties (5.2); to belong to the intersection of the orthant of nonnegative matrices R N×N + with the symmetric hollow subspace S N h (2.2.3.0.1). Geometrically, we want H to belong to the polyhedral cone (2.12.1.0.1) K ∆ = S N h ∩ R N×N + (1206) Yet in practice, H can possess significant measurement uncertainty (noise). Sometimes realization of an optimization problem demands that its input, the given matrix H , possess some particular characteristics; perhaps symmetry and hollowness or nonnegativity. When that H given does not possess the desired properties, then we must impose them upon H prior to optimization: When measurement matrix H is not symmetric or hollow, taking its symmetric hollow part is equivalent to orthogonal projection on the symmetric hollow subspace S N h . When measurements of distance in H are negative, zeroing negative entries effects unique minimum-distance projection on the orthant of nonnegative matrices R N×N + in isomorphic R N2 (E.9.2.2.3). 7.0.1.1 Order of imposition Since convex cone K (1206) is the intersection of an orthant with a subspace, we want to project on that subset of the orthant belonging to the subspace; on the nonnegative orthant in the symmetric hollow subspace that is, in fact, the intersection. For that reason alone, unique minimum-distance projection of H on K (that member of K closest to H in isomorphic R N2 in the Euclidean sense) can be attained by first taking its symmetric hollow part, and only then clipping negative entries of the result to 0 ; id est, there is only one correct order of projection, in general, on an orthant intersecting a subspace:
497 project on the subspace, then project the result on the orthant in that subspace. (conferE.9.5) In contrast, order of projection on an intersection of subspaces is arbitrary. That order-of-projection rule applies more generally, of course, to the intersection of any convex set C with any subspace. Consider the proximity problem 7.1 over convex feasible set S N h ∩ C given nonsymmetric nonhollow H ∈ R N×N : minimize B∈S N h subject to ‖B − H‖ 2 F B ∈ C (1207) a convex optimization problem. Because the symmetric hollow subspace is orthogonal to the antisymmetric antihollow subspace (2.2.3), then for B ∈ S N h ( ( )) 1 tr B T 2 (H −HT ) + δ 2 (H) = 0 (1208) so the objective function is equivalent to ( )∥ ‖B − H‖ 2 F ≡ 1 ∥∥∥ 2 ∥ B − 2 (H +HT ) − δ 2 (H) + F 2 1 ∥2 (H −HT ) + δ 2 (H) ∥ F (1209) This means the antisymmetric antihollow part of given matrix H would be ignored by minimization with respect to symmetric hollow variable B under the Frobenius norm; id est, minimization proceeds as though given the symmetric hollow part of H . This action of the Frobenius norm (1209) is effectively a Euclidean projection (minimum-distance projection) of H on the symmetric hollow subspace S N h prior to minimization. Thus minimization proceeds inherently following the correct order for projection on S N h ∩ C . Therefore we may either assume H ∈ S N h , or take its symmetric hollow part prior to optimization. 7.1 There are two equivalent interpretations of projection (E.9): one finds a set normal, the other, minimum distance between a point and a set. Here we realize the latter view.
- Page 445 and 446: Chapter 6 Cone of distance matrices
- Page 447 and 448: 6.1. DEFINING EDM CONE 447 6.1 Defi
- Page 449 and 450: 6.2. POLYHEDRAL BOUNDS 449 This con
- Page 451 and 452: 6.3. √ EDM CONE IS NOT CONVEX 451
- Page 453 and 454: 6.4. A GEOMETRY OF COMPLETION 453 (
- Page 455 and 456: 6.4. A GEOMETRY OF COMPLETION 455 (
- Page 457 and 458: 6.4. A GEOMETRY OF COMPLETION 457 F
- Page 459 and 460: 6.5. EDM DEFINITION IN 11 T 459 by
- Page 461 and 462: 6.5. EDM DEFINITION IN 11 T 461 6.5
- Page 463 and 464: 6.5. EDM DEFINITION IN 11 T 463 1 0
- Page 465 and 466: 6.5. EDM DEFINITION IN 11 T 465 6.5
- Page 467 and 468: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 469 and 470: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 471 and 472: 6.6. CORRESPONDENCE TO PSD CONE S N
- Page 473 and 474: 6.7. VECTORIZATION & PROJECTION INT
- Page 475 and 476: 6.7. VECTORIZATION & PROJECTION INT
- Page 477 and 478: 6.8. DUAL EDM CONE 477 When the Fin
- Page 479 and 480: 6.8. DUAL EDM CONE 479 Proof. First
- Page 481 and 482: 6.8. DUAL EDM CONE 481 EDM 2 = S 2
- Page 483 and 484: 6.8. DUAL EDM CONE 483 whose veraci
- Page 485 and 486: 6.8. DUAL EDM CONE 485 6.8.1.3.1 Ex
- Page 487 and 488: 6.8. DUAL EDM CONE 487 has dual aff
- Page 489 and 490: 6.8. DUAL EDM CONE 489 6.8.1.7 Scho
- Page 491 and 492: 6.9. THEOREM OF THE ALTERNATIVE 491
- Page 493 and 494: 6.10. POSTSCRIPT 493 When D is an E
- Page 495: Chapter 7 Proximity problems In sum
- Page 499 and 500: 499 H S N h 0 EDM N K = S N h ∩ R
- Page 501 and 502: 501 7.0.3 Problem approach Problems
- Page 503 and 504: 7.1. FIRST PREVALENT PROBLEM: 503 f
- Page 505 and 506: 7.1. FIRST PREVALENT PROBLEM: 505 7
- Page 507 and 508: 7.1. FIRST PREVALENT PROBLEM: 507 d
- Page 509 and 510: 7.1. FIRST PREVALENT PROBLEM: 509 7
- Page 511 and 512: 7.1. FIRST PREVALENT PROBLEM: 511 w
- Page 513 and 514: 7.1. FIRST PREVALENT PROBLEM: 513 T
- Page 515 and 516: 7.2. SECOND PREVALENT PROBLEM: 515
- Page 517 and 518: 7.2. SECOND PREVALENT PROBLEM: 517
- Page 519 and 520: 7.2. SECOND PREVALENT PROBLEM: 519
- Page 521 and 522: 7.2. SECOND PREVALENT PROBLEM: 521
- Page 523 and 524: 7.2. SECOND PREVALENT PROBLEM: 523
- Page 525 and 526: 7.3. THIRD PREVALENT PROBLEM: 525 g
- Page 527 and 528: 7.3. THIRD PREVALENT PROBLEM: 527 w
- Page 529 and 530: 7.3. THIRD PREVALENT PROBLEM: 529 7
- Page 531 and 532: 7.3. THIRD PREVALENT PROBLEM: 531 7
- Page 533 and 534: 7.3. THIRD PREVALENT PROBLEM: 533 O
- Page 535 and 536: 7.4. CONCLUSION 535 The rank constr
- Page 537 and 538: Appendix A Linear algebra A.1 Main-
- Page 539 and 540: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 541 and 542: A.1. MAIN-DIAGONAL δ OPERATOR, λ
- Page 543 and 544: A.2. SEMIDEFINITENESS: DOMAIN OF TE
- Page 545 and 546: A.3. PROPER STATEMENTS 545 (AB) T
497<br />
project on the subspace, then project the result on the orthant in that<br />
subspace. (conferE.9.5)<br />
In contrast, order of projection on an intersection of subspaces is arbitrary.<br />
That order-of-projection rule applies more generally, of course, to<br />
the intersection of any convex set C with any subspace. Consider the<br />
proximity problem 7.1 over convex feasible set S N h ∩ C given nonsymmetric<br />
nonhollow H ∈ R N×N :<br />
minimize<br />
B∈S N h<br />
subject to<br />
‖B − H‖ 2 F<br />
B ∈ C<br />
(1207)<br />
a convex optimization problem. Because the symmetric hollow subspace<br />
is orthogonal to the antisymmetric antihollow subspace (2.2.3), then for<br />
B ∈ S N h<br />
( ( ))<br />
1<br />
tr B T 2 (H −HT ) + δ 2 (H) = 0 (1208)<br />
so the objective function is equivalent to<br />
( )∥ ‖B − H‖ 2 F ≡<br />
1 ∥∥∥<br />
2<br />
∥ B − 2 (H +HT ) − δ 2 (H) +<br />
F<br />
2<br />
1<br />
∥2 (H −HT ) + δ 2 (H)<br />
∥<br />
F<br />
(1209)<br />
This means the antisymmetric antihollow part of given matrix H would<br />
be ignored by minimization with respect to symmetric hollow variable B<br />
under the Frobenius norm; id est, minimization proceeds as though given<br />
the symmetric hollow part of H .<br />
This action of the Frobenius norm (1209) is effectively a Euclidean<br />
projection (minimum-distance projection) of H on the symmetric hollow<br />
subspace S N h prior to minimization. Thus minimization proceeds inherently<br />
following the correct order for projection on S N h ∩ C . Therefore we<br />
may either assume H ∈ S N h , or take its symmetric hollow part prior to<br />
optimization.<br />
7.1 There are two equivalent interpretations of projection (E.9): one finds a set normal,<br />
the other, minimum distance between a point and a set. Here we realize the latter view.