sparse image representation via combined transforms - Convex ...
sparse image representation via combined transforms - Convex ... sparse image representation via combined transforms - Convex ...
52 CHAPTER 3. IMAGE TRANSFORMS AND IMAGE FEATURES 3.1.5 2-D DCT The 2-D DCT is an extension of the 1-D DCT. On a matrix, we simply apply a 1-D DCT to each row, and then apply a 1-D DCT to each column. The basis function of the 2-D DCT is the tensor product of (two) basis functions for the 1-D DCT. The optimality of the 2-D DCT is nearly a direct extension of the optimality of the 1-D DCT. As long as the homogeneous components of images are defined consistently with the definition corresponding to 1-D homogeneous components, we can show that the 2-D DCT will diagonalize the covariance matrices of the 2-D signal (images) too. Based on this, we can generate a slogan: “The 2-D DCT is good for images with homogeneous components.” Another way to show the optimality of the DCT is to look at its basis functions. The properties of the basis functions represent the properties of a transform. A coefficient after a transform is equal to the inner product of an input and a basis function. Intuitively, if basis functions are similar to the input, then we only need a small number of basis functions to represent the original input. Note here that the input is a signal. When the basis functions are close to the features we want to capture in the images, we say that the corresponding transform is good for this type of images. To show that the 2-D DCT is good for homogeneous images, let’s look at its basis functions. Figure 3.2 shows all 2-D DCT basis functions on an 8 × 8 block. From these figures, we should say that the basis functions are pretty homogeneous, because it is impossible to say that the statistical properties in one area are different from the statistical properties in another. 3.2 Wavelets and Point Singularities It is interesting to review the history of the development of wavelets. The following description is basically from Deslauriers and Dubuc [60, Preface]. In 1985 in France, the first orthogonal wavelet basis was discovered by Meyer. Shortly thereafter Mallat introduced multiresolution analysis, which explained some of the mysteries of Meyer’s wavelet basis. In February, 1987, in Montreal, Daubechies found an orthonormal wavelet basis that has compact support. Next came the biorthogonal wavelets related to splines. In Paris, in May 1985, Deslauriers and Dubuc used dyadic interpolation to explain multiresolution, a term that by then was familiar to many. Donoho and Johnstone developed the wavelet shrinkage
3.2. WAVELETS AND POINT SINGULARITIES 53 Figure 3.2: Two-dimensional discrete cosine transform basis functions on an 8 × 8block. The upper-left corner corresponds to the low-low frequency, and the lower-right corner corresponds to the high-high frequency.
- Page 29 and 30: Chapter 1 Introduction 1.1 Overview
- Page 31 and 32: Chapter 2 Sparsity in Image Coding
- Page 33 and 34: 2.1. IMAGE CODING 5 INFORMATION SOU
- Page 35 and 36: 2.1. IMAGE CODING 7 2.1.2 Source an
- Page 37 and 38: 2.1. IMAGE CODING 9 x ✲ T y ERROR
- Page 39 and 40: 2.1. IMAGE CODING 11 where Q stands
- Page 41 and 42: 2.2. SPARSITY AND COMPRESSION 13 Pr
- Page 43 and 44: 2.2. SPARSITY AND COMPRESSION 15 av
- Page 45 and 46: 2.2. SPARSITY AND COMPRESSION 17 wi
- Page 47 and 48: 2.2. SPARSITY AND COMPRESSION 19 lo
- Page 49 and 50: 2.3. DISCUSSION 21 tail compact. Th
- Page 51 and 52: 2.4. PROOF 23 The index l does not
- Page 53 and 54: Chapter 3 Image Transforms and Imag
- Page 55 and 56: 27 Some of the figures show the bas
- Page 57 and 58: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 59 and 60: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 61 and 62: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 63 and 64: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 65 and 66: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 67 and 68: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 69 and 70: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 71 and 72: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 73 and 74: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 75 and 76: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 77 and 78: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 79: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 83 and 84: 3.2. WAVELETS AND POINT SINGULARITI
- Page 85 and 86: 3.2. WAVELETS AND POINT SINGULARITI
- Page 87 and 88: 3.2. WAVELETS AND POINT SINGULARITI
- Page 89 and 90: 3.2. WAVELETS AND POINT SINGULARITI
- Page 91 and 92: 3.2. WAVELETS AND POINT SINGULARITI
- Page 93 and 94: 3.3. EDGELETS AND LINEAR SINGULARIT
- Page 95 and 96: 3.4. OTHER TRANSFORMS 67 uncertaint
- Page 97 and 98: 3.4. OTHER TRANSFORMS 69 Chirplets
- Page 99 and 100: 3.4. OTHER TRANSFORMS 71 Folding. A
- Page 101 and 102: 3.4. OTHER TRANSFORMS 73 We can app
- Page 103 and 104: 3.5. DISCUSSION 75 give only a few
- Page 105 and 106: 3.7. PROOFS 77 the ijth component o
- Page 107 and 108: 3.7. PROOFS 79 Similarly, we have [
- Page 109 and 110: Chapter 4 Combined Image Representa
- Page 111 and 112: 4.2. SPARSE DECOMPOSITION 83 interi
- Page 113 and 114: 4.3. MINIMUM l 1 NORM SOLUTION 85 l
- Page 115 and 116: 4.4. LAGRANGE MULTIPLIERS 87 ρ( x
- Page 117 and 118: 4.5. HOW TO CHOOSE ρ AND λ 89 3 (
- Page 119 and 120: 4.6. HOMOTOPY 91 A way to interpret
- Page 121 and 122: 4.7. NEWTON DIRECTION 93 4.7 Newton
- Page 123 and 124: 4.9. ITERATIVE METHODS 95 1. Avoidi
- Page 125 and 126: 4.11. DISCUSSION 97 ρ(β) =‖β
- Page 127 and 128: 4.12. PROOFS 99 4.12.2 Proof of The
- Page 129 and 130: 4.12. PROOFS 101 case of (4.16). Co
52 CHAPTER 3. IMAGE TRANSFORMS AND IMAGE FEATURES<br />
3.1.5 2-D DCT<br />
The 2-D DCT is an extension of the 1-D DCT. On a matrix, we simply apply a 1-D DCT<br />
to each row, and then apply a 1-D DCT to each column. The basis function of the 2-D<br />
DCT is the tensor product of (two) basis functions for the 1-D DCT.<br />
The optimality of the 2-D DCT is nearly a direct extension of the optimality of the 1-D<br />
DCT. As long as the homogeneous components of <strong>image</strong>s are defined consistently with the<br />
definition corresponding to 1-D homogeneous components, we can show that the 2-D DCT<br />
will diagonalize the covariance matrices of the 2-D signal (<strong>image</strong>s) too. Based on this, we<br />
can generate a slogan: “The 2-D DCT is good for <strong>image</strong>s with homogeneous components.”<br />
Another way to show the optimality of the DCT is to look at its basis functions. The<br />
properties of the basis functions represent the properties of a transform. A coefficient after a<br />
transform is equal to the inner product of an input and a basis function. Intuitively, if basis<br />
functions are similar to the input, then we only need a small number of basis functions to<br />
represent the original input. Note here that the input is a signal. When the basis functions<br />
are close to the features we want to capture in the <strong>image</strong>s, we say that the corresponding<br />
transform is good for this type of <strong>image</strong>s.<br />
To show that the 2-D DCT is good for homogeneous <strong>image</strong>s, let’s look at its basis functions.<br />
Figure 3.2 shows all 2-D DCT basis functions on an 8 × 8 block. From these figures,<br />
we should say that the basis functions are pretty homogeneous, because it is impossible to<br />
say that the statistical properties in one area are different from the statistical properties in<br />
another.<br />
3.2 Wavelets and Point Singularities<br />
It is interesting to review the history of the development of wavelets. The following description<br />
is basically from Deslauriers and Dubuc [60, Preface]. In 1985 in France, the first<br />
orthogonal wavelet basis was discovered by Meyer. Shortly thereafter Mallat introduced<br />
multiresolution analysis, which explained some of the mysteries of Meyer’s wavelet basis.<br />
In February, 1987, in Montreal, Daubechies found an orthonormal wavelet basis that has<br />
compact support. Next came the biorthogonal wavelets related to splines. In Paris, in May<br />
1985, Deslauriers and Dubuc used dyadic interpolation to explain multiresolution, a term<br />
that by then was familiar to many. Donoho and Johnstone developed the wavelet shrinkage