sparse image representation via combined transforms - Convex ...
sparse image representation via combined transforms - Convex ... sparse image representation via combined transforms - Convex ...
60 CHAPTER 3. IMAGE TRANSFORMS AND IMAGE FEATURES Similarly, from (3.32), for any j ∈ N, the sequence β j−1 is a downsampled version of a convolution of two sequences α j and g: α j−1 =(h ∗ α j ) ↓ 2. (3.34) The algorithm for the DWT arises from a combination of equations (3.33) and (3.34). We start with α j in subspace V j , j ∈ N. From (3.33) and (3.34) we get sequences α j−1 and β j−1 corresponding to decompositions in subspaces V j−1 and W j−1 , respectively. Then we further map the sequence α j−1 into sequences α j−2 and β j−2 corresponding to decompositions in subspaces V j−2 and W j−2 . We continue this process until it stops at scale 0. The concatenation of sets α 0 , β 0 , β 1 , ... , β j−1 gives the decomposition into a union of all the subspaces V 0 , W 0 , W 1 , ... , W j−1 . The sequence α 0 corresponds to a projection of function f into subspace V 0 . For l =0, 1,... ,j− 1, the sequence β l corresponds to a projection of function f into subspace W l . The set α 0 ∪ β 0 ∪ β 1 ∪ ...∪ β j−1 is called the DWT of the sequence α j . The first graph in Figure 3.4 gives a scaled illustration of the DWT algorithm for sequence α 3 . Note that we assume a sequence has finite length. The length of each block is proportional to the length of its corresponding coefficient sequence, which is a sequence of α’s and β’s. We can see that for a finite sequence, the length of the DWT is equal to the length of the original sequence. The second graph in Figure 3.4 is a non-scaled depiction for a more generic scenario. 3.2.4 Point Singularities We will explain why the wavelet transform is good at processing point singularities. The key reason is that a single wavelet basis function is a time-localized function. In other words, the support of the basis function is finite. Sometimes we say that wavelet basis function has compact support. The wavelet basis is a system of functions made by dilations and translations of a single wavelet function, together with some scaling functions at the coarsest scale. In the discrete wavelet transform, for a signal concentrated at one point (or, equivalently, for one point singularity) at every scale because of the time localization property, there are only a few significant wavelet coefficients. For a length-N signal, the number of scales is O(log N), so for a time singularity, a DWT should give no more than O(log N) wavelet coefficients that have significant amplitudes. Compared with the length
3.2. WAVELETS AND POINT SINGULARITIES 61 α 3 β 0 α 2 β 2 α 1 β 1 ✠ ❅ L H ❅ ❅❘ ✠ α 0 ❅ L H❅ ❅❘ SIGNAL ❅ ✠ L H ❅❅❘ α 1 α 0 β 0 α j α j−1 β j−1 α j−2 β j−2 β j−3 Figure 3.4: Illustration of the discrete algorithm for forward orthonormal wavelet transform on a finite-length discrete signal. The upper graph is for cases having 3 layers. The width of each block is proportional to the length of the corresponding subsequence in the discrete signal. The bottom one is a symbolic version for general cases.
- Page 37 and 38: 2.1. IMAGE CODING 9 x ✲ T y ERROR
- Page 39 and 40: 2.1. IMAGE CODING 11 where Q stands
- Page 41 and 42: 2.2. SPARSITY AND COMPRESSION 13 Pr
- Page 43 and 44: 2.2. SPARSITY AND COMPRESSION 15 av
- Page 45 and 46: 2.2. SPARSITY AND COMPRESSION 17 wi
- Page 47 and 48: 2.2. SPARSITY AND COMPRESSION 19 lo
- Page 49 and 50: 2.3. DISCUSSION 21 tail compact. Th
- Page 51 and 52: 2.4. PROOF 23 The index l does not
- Page 53 and 54: Chapter 3 Image Transforms and Imag
- Page 55 and 56: 27 Some of the figures show the bas
- Page 57 and 58: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 59 and 60: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 61 and 62: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 63 and 64: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 65 and 66: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 67 and 68: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 69 and 70: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 71 and 72: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 73 and 74: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 75 and 76: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 77 and 78: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 79 and 80: 3.1. DCT AND HOMOGENEOUS COMPONENTS
- Page 81 and 82: 3.2. WAVELETS AND POINT SINGULARITI
- Page 83 and 84: 3.2. WAVELETS AND POINT SINGULARITI
- Page 85 and 86: 3.2. WAVELETS AND POINT SINGULARITI
- Page 87: 3.2. WAVELETS AND POINT SINGULARITI
- Page 91 and 92: 3.2. WAVELETS AND POINT SINGULARITI
- Page 93 and 94: 3.3. EDGELETS AND LINEAR SINGULARIT
- Page 95 and 96: 3.4. OTHER TRANSFORMS 67 uncertaint
- Page 97 and 98: 3.4. OTHER TRANSFORMS 69 Chirplets
- Page 99 and 100: 3.4. OTHER TRANSFORMS 71 Folding. A
- Page 101 and 102: 3.4. OTHER TRANSFORMS 73 We can app
- Page 103 and 104: 3.5. DISCUSSION 75 give only a few
- Page 105 and 106: 3.7. PROOFS 77 the ijth component o
- Page 107 and 108: 3.7. PROOFS 79 Similarly, we have [
- Page 109 and 110: Chapter 4 Combined Image Representa
- Page 111 and 112: 4.2. SPARSE DECOMPOSITION 83 interi
- Page 113 and 114: 4.3. MINIMUM l 1 NORM SOLUTION 85 l
- Page 115 and 116: 4.4. LAGRANGE MULTIPLIERS 87 ρ( x
- Page 117 and 118: 4.5. HOW TO CHOOSE ρ AND λ 89 3 (
- Page 119 and 120: 4.6. HOMOTOPY 91 A way to interpret
- Page 121 and 122: 4.7. NEWTON DIRECTION 93 4.7 Newton
- Page 123 and 124: 4.9. ITERATIVE METHODS 95 1. Avoidi
- Page 125 and 126: 4.11. DISCUSSION 97 ρ(β) =‖β
- Page 127 and 128: 4.12. PROOFS 99 4.12.2 Proof of The
- Page 129 and 130: 4.12. PROOFS 101 case of (4.16). Co
- Page 131 and 132: Chapter 5 Iterative Methods This ch
- Page 133 and 134: 5.1. OVERVIEW 105 the k-th iteratio
- Page 135 and 136: 5.1. OVERVIEW 107 5.1.4 Preconditio
- Page 137 and 138: 5.2. LSQR 109 among all the block d
3.2. WAVELETS AND POINT SINGULARITIES 61<br />
α 3<br />
β 0<br />
α 2<br />
β 2<br />
α 1 β 1<br />
✠<br />
❅<br />
L H ❅ ❅❘<br />
<br />
✠<br />
α 0<br />
❅<br />
L H❅ ❅❘<br />
SIGNAL<br />
<br />
❅<br />
✠ L<br />
H ❅❅❘<br />
<br />
α 1 <br />
<br />
<br />
α 0 β 0<br />
α<br />
<br />
j <br />
α j−1<br />
β j−1<br />
<br />
α j−2 β j−2<br />
<br />
β j−3<br />
Figure 3.4: Illustration of the discrete algorithm for forward orthonormal wavelet transform<br />
on a finite-length discrete signal. The upper graph is for cases having 3 layers. The width<br />
of each block is proportional to the length of the corresponding subsequence in the discrete<br />
signal. The bottom one is a symbolic version for general cases.