sparse image representation via combined transforms - Convex ...
sparse image representation via combined transforms - Convex ... sparse image representation via combined transforms - Convex ...
50 CHAPTER 3. IMAGE TRANSFORMS AND IMAGE FEATURES Let Σ denote the covariance matrix, and let Σ 1 and Σ 2 denote two matrices that have special structures that we will specify later. We will refer to the following table (Table 3.4) in the next Theorem. Σ 1 (Toeplitz part) Σ 2 (Hankel part) Σ 1 +Σ 2 (covariance matrix) type-I B · C 1 · B B ·D(C 2 ) · B B · C 1 · B + B ·D(C 2 ) · B type-II C 1 C 2 C 1 + C 2 type-III type-IV B · C 1 ′ · B C 1 ′ B ·D(C′ 2 ) · B C 2 ′ B · C′ 1 · B + B ·D(C′ 2 ) · B C 1 ′ + C′ 2 Table 3.4: Decomposition of covariance matrix that can be diagonalized by different types of DCT. Theorem 3.5 (DCT Diagonalization) If a covariance matrix Σ can be diagonalized by one type of DCT, then it can be decomposed into two matrices, Σ=Σ 1 +Σ 2 ,andthematrices Σ 1 and Σ 2 have special structures as listed in Table 3.4. For example, if a covariance matrix Σ can be diagonalized by DCT-I, then Σ=Σ 1 +Σ 2 = B · C 1 · B + B ·D(C 2 ) · B. The matrices B,C 1 ,C 1 ′ ,C 2,C 2 ′ , D(C 2) and D(C 2 ′ ) are defined in equations (3.14), (3.15), (3.16), (3.17), (3.18) and (3.19), respectively. Moreover, the elements c i and c ′ i are determined by the following expressions: c i = 1 N c ′ i = 1 N N−1 ∑ k=0 N−1 ∑ k=0 λ k b 2 k πki cos ,i=0, 1,... ,2N − 1, N λ k cos π(k + 1 2 )i ,i=0, 1,... ,2N − 1, N where the sequence {λ k : k =0, 1,... ,N − 1} is a real-valued sequence.
3.1. DCT AND HOMOGENEOUS COMPONENTS 51 The diagonal matrix ⎛ diag{λ 0 ,λ 1 ,... ,λ N−1 } = ⎜ ⎝ ⎞ λ 0 λ 1 . .. ⎟ ⎠ λ N−1 is the result of DCT diagonalization. Since Σ is a covariance matrix, the value of λ k is the variance of the kth coefficient of the corresponding DCT. Why is this result meaningful? Because it specifies the particular structure of matrices that can be diagonalized by DCTs. Some previous research has sought the specifications (for example, the boundary conditions) of a GMRF so that the covariance matrix has one of the structures that are described in Table 3.4, or has a structure close to one of them. The research reported in [110, 111] is an example. Conclusion of Section 3.1.4 When an image, or equivalently a GMRF, is homogeneous, the covariance matrix should be Toeplitz. Generally we also assume locality, or Markovity; hence the covariance matrix is nearly diagonal. In order to show that DCT almost diagonalizes the covariance matrix of a class of homogeneous signals, we take type-II DCT as an example. We explain in a reverse order. If a covariance matrix can be diagonalized by type-II DCT, based on Theorem 3.5 and Table 3.4, the covariance matrix should look like C 1 +C 2 . If we take the sequence {c 0 ,c 1 ,... ,c N }, such that the sequence has large amplitude at c 0 and vanishing elements at the other end (which is equivalent to saying |c i | → 0asi → 0), then the Toeplitz part C 1 becomes significant and the Hankel part C 2 vanishes—only the upper-left corner and the bottomright parts of the matrix C 2 are significantly nonzero. It would be possible for us to choose a sequence {c 0 ,c 1 ,... ,c N } such that the matrix C 1 + C 2 is a close approximation to the covariance matrix. Hence the type-II DCT can approximately diagonalize the covariance matrix, and is nearly the KLT of this class of images or GMRFs.
- Page 27 and 28: List of Abbreviations BCR .........
- Page 29 and 30: Chapter 1 Introduction 1.1 Overview
- Page 31 and 32: Chapter 2 Sparsity in Image Coding
- Page 33 and 34: 2.1. IMAGE CODING 5 INFORMATION SOU
- Page 35 and 36: 2.1. IMAGE CODING 7 2.1.2 Source an
- Page 37 and 38: 2.1. IMAGE CODING 9 x ✲ T y ERROR
- Page 39 and 40: 2.1. IMAGE CODING 11 where Q stands
- Page 41 and 42: 2.2. SPARSITY AND COMPRESSION 13 Pr
- Page 43 and 44: 2.2. SPARSITY AND COMPRESSION 15 av
- Page 45 and 46: 2.2. SPARSITY AND COMPRESSION 17 wi
- Page 47 and 48: 2.2. SPARSITY AND COMPRESSION 19 lo
- Page 49 and 50: 2.3. DISCUSSION 21 tail compact. Th
- Page 51 and 52: 2.4. PROOF 23 The index l does not
- Page 53 and 54: Chapter 3 Image Transforms and Imag
- Page 55 and 56: 27 Some of the figures show the bas
- Page 57 and 58: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 59 and 60: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 61 and 62: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 63 and 64: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 65 and 66: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 67 and 68: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 69 and 70: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 71 and 72: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 73 and 74: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 75 and 76: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 77: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 81 and 82: 3.2. WAVELETS AND POINT SINGULARITI
- Page 83 and 84: 3.2. WAVELETS AND POINT SINGULARITI
- Page 85 and 86: 3.2. WAVELETS AND POINT SINGULARITI
- Page 87 and 88: 3.2. WAVELETS AND POINT SINGULARITI
- Page 89 and 90: 3.2. WAVELETS AND POINT SINGULARITI
- Page 91 and 92: 3.2. WAVELETS AND POINT SINGULARITI
- Page 93 and 94: 3.3. EDGELETS AND LINEAR SINGULARIT
- Page 95 and 96: 3.4. OTHER TRANSFORMS 67 uncertaint
- Page 97 and 98: 3.4. OTHER TRANSFORMS 69 Chirplets
- Page 99 and 100: 3.4. OTHER TRANSFORMS 71 Folding. A
- Page 101 and 102: 3.4. OTHER TRANSFORMS 73 We can app
- Page 103 and 104: 3.5. DISCUSSION 75 give only a few
- Page 105 and 106: 3.7. PROOFS 77 the ijth component o
- Page 107 and 108: 3.7. PROOFS 79 Similarly, we have [
- Page 109 and 110: Chapter 4 Combined Image Representa
- Page 111 and 112: 4.2. SPARSE DECOMPOSITION 83 interi
- Page 113 and 114: 4.3. MINIMUM l 1 NORM SOLUTION 85 l
- Page 115 and 116: 4.4. LAGRANGE MULTIPLIERS 87 ρ( x
- Page 117 and 118: 4.5. HOW TO CHOOSE ρ AND λ 89 3 (
- Page 119 and 120: 4.6. HOMOTOPY 91 A way to interpret
- Page 121 and 122: 4.7. NEWTON DIRECTION 93 4.7 Newton
- Page 123 and 124: 4.9. ITERATIVE METHODS 95 1. Avoidi
- Page 125 and 126: 4.11. DISCUSSION 97 ρ(β) =‖β
- Page 127 and 128: 4.12. PROOFS 99 4.12.2 Proof of The
50 CHAPTER 3. IMAGE TRANSFORMS AND IMAGE FEATURES<br />
Let Σ denote the covariance matrix, and let Σ 1 and Σ 2 denote two matrices that have<br />
special structures that we will specify later.<br />
We will refer to the following table (Table 3.4) in the next Theorem.<br />
Σ 1 (Toeplitz part) Σ 2 (Hankel part) Σ 1 +Σ 2 (covariance matrix)<br />
type-I B · C 1 · B B ·D(C 2 ) · B B · C 1 · B + B ·D(C 2 ) · B<br />
type-II C 1 C 2 C 1 + C 2<br />
type-III<br />
type-IV<br />
B · C 1 ′ · B<br />
C 1 ′ B ·D(C′ 2 ) · B<br />
C 2 ′ B · C′ 1 · B + B ·D(C′ 2 ) · B<br />
C 1 ′ + C′ 2<br />
Table 3.4: Decomposition of covariance matrix that can be diagonalized by different types<br />
of DCT.<br />
Theorem 3.5 (DCT Diagonalization) If a covariance matrix Σ can be diagonalized by<br />
one type of DCT, then it can be decomposed into two matrices, Σ=Σ 1 +Σ 2 ,andthematrices<br />
Σ 1 and Σ 2 have special structures as listed in Table 3.4. For example, if a covariance matrix<br />
Σ can be diagonalized by DCT-I, then<br />
Σ=Σ 1 +Σ 2 = B · C 1 · B + B ·D(C 2 ) · B.<br />
The matrices B,C 1 ,C 1 ′ ,C 2,C 2 ′ , D(C 2) and D(C 2 ′ ) are defined in equations (3.14), (3.15),<br />
(3.16), (3.17), (3.18) and (3.19), respectively.<br />
Moreover, the elements c i and c ′ i<br />
are determined by the following expressions:<br />
c i = 1 N<br />
c ′ i = 1 N<br />
N−1<br />
∑<br />
k=0<br />
N−1<br />
∑<br />
k=0<br />
λ k b 2 k<br />
πki<br />
cos ,i=0, 1,... ,2N − 1,<br />
N<br />
λ k cos π(k + 1 2 )i ,i=0, 1,... ,2N − 1,<br />
N<br />
where the sequence {λ k : k =0, 1,... ,N − 1} is a real-valued sequence.