sparse image representation via combined transforms - Convex ...

sparse image representation via combined transforms - Convex ... sparse image representation via combined transforms - Convex ...

convexoptimization.com
from convexoptimization.com More from this publisher
10.03.2015 Views

50 CHAPTER 3. IMAGE TRANSFORMS AND IMAGE FEATURES Let Σ denote the covariance matrix, and let Σ 1 and Σ 2 denote two matrices that have special structures that we will specify later. We will refer to the following table (Table 3.4) in the next Theorem. Σ 1 (Toeplitz part) Σ 2 (Hankel part) Σ 1 +Σ 2 (covariance matrix) type-I B · C 1 · B B ·D(C 2 ) · B B · C 1 · B + B ·D(C 2 ) · B type-II C 1 C 2 C 1 + C 2 type-III type-IV B · C 1 ′ · B C 1 ′ B ·D(C′ 2 ) · B C 2 ′ B · C′ 1 · B + B ·D(C′ 2 ) · B C 1 ′ + C′ 2 Table 3.4: Decomposition of covariance matrix that can be diagonalized by different types of DCT. Theorem 3.5 (DCT Diagonalization) If a covariance matrix Σ can be diagonalized by one type of DCT, then it can be decomposed into two matrices, Σ=Σ 1 +Σ 2 ,andthematrices Σ 1 and Σ 2 have special structures as listed in Table 3.4. For example, if a covariance matrix Σ can be diagonalized by DCT-I, then Σ=Σ 1 +Σ 2 = B · C 1 · B + B ·D(C 2 ) · B. The matrices B,C 1 ,C 1 ′ ,C 2,C 2 ′ , D(C 2) and D(C 2 ′ ) are defined in equations (3.14), (3.15), (3.16), (3.17), (3.18) and (3.19), respectively. Moreover, the elements c i and c ′ i are determined by the following expressions: c i = 1 N c ′ i = 1 N N−1 ∑ k=0 N−1 ∑ k=0 λ k b 2 k πki cos ,i=0, 1,... ,2N − 1, N λ k cos π(k + 1 2 )i ,i=0, 1,... ,2N − 1, N where the sequence {λ k : k =0, 1,... ,N − 1} is a real-valued sequence.

3.1. DCT AND HOMOGENEOUS COMPONENTS 51 The diagonal matrix ⎛ diag{λ 0 ,λ 1 ,... ,λ N−1 } = ⎜ ⎝ ⎞ λ 0 λ 1 . .. ⎟ ⎠ λ N−1 is the result of DCT diagonalization. Since Σ is a covariance matrix, the value of λ k is the variance of the kth coefficient of the corresponding DCT. Why is this result meaningful? Because it specifies the particular structure of matrices that can be diagonalized by DCTs. Some previous research has sought the specifications (for example, the boundary conditions) of a GMRF so that the covariance matrix has one of the structures that are described in Table 3.4, or has a structure close to one of them. The research reported in [110, 111] is an example. Conclusion of Section 3.1.4 When an image, or equivalently a GMRF, is homogeneous, the covariance matrix should be Toeplitz. Generally we also assume locality, or Markovity; hence the covariance matrix is nearly diagonal. In order to show that DCT almost diagonalizes the covariance matrix of a class of homogeneous signals, we take type-II DCT as an example. We explain in a reverse order. If a covariance matrix can be diagonalized by type-II DCT, based on Theorem 3.5 and Table 3.4, the covariance matrix should look like C 1 +C 2 . If we take the sequence {c 0 ,c 1 ,... ,c N }, such that the sequence has large amplitude at c 0 and vanishing elements at the other end (which is equivalent to saying |c i | → 0asi → 0), then the Toeplitz part C 1 becomes significant and the Hankel part C 2 vanishes—only the upper-left corner and the bottomright parts of the matrix C 2 are significantly nonzero. It would be possible for us to choose a sequence {c 0 ,c 1 ,... ,c N } such that the matrix C 1 + C 2 is a close approximation to the covariance matrix. Hence the type-II DCT can approximately diagonalize the covariance matrix, and is nearly the KLT of this class of images or GMRFs.

50 CHAPTER 3. IMAGE TRANSFORMS AND IMAGE FEATURES<br />

Let Σ denote the covariance matrix, and let Σ 1 and Σ 2 denote two matrices that have<br />

special structures that we will specify later.<br />

We will refer to the following table (Table 3.4) in the next Theorem.<br />

Σ 1 (Toeplitz part) Σ 2 (Hankel part) Σ 1 +Σ 2 (covariance matrix)<br />

type-I B · C 1 · B B ·D(C 2 ) · B B · C 1 · B + B ·D(C 2 ) · B<br />

type-II C 1 C 2 C 1 + C 2<br />

type-III<br />

type-IV<br />

B · C 1 ′ · B<br />

C 1 ′ B ·D(C′ 2 ) · B<br />

C 2 ′ B · C′ 1 · B + B ·D(C′ 2 ) · B<br />

C 1 ′ + C′ 2<br />

Table 3.4: Decomposition of covariance matrix that can be diagonalized by different types<br />

of DCT.<br />

Theorem 3.5 (DCT Diagonalization) If a covariance matrix Σ can be diagonalized by<br />

one type of DCT, then it can be decomposed into two matrices, Σ=Σ 1 +Σ 2 ,andthematrices<br />

Σ 1 and Σ 2 have special structures as listed in Table 3.4. For example, if a covariance matrix<br />

Σ can be diagonalized by DCT-I, then<br />

Σ=Σ 1 +Σ 2 = B · C 1 · B + B ·D(C 2 ) · B.<br />

The matrices B,C 1 ,C 1 ′ ,C 2,C 2 ′ , D(C 2) and D(C 2 ′ ) are defined in equations (3.14), (3.15),<br />

(3.16), (3.17), (3.18) and (3.19), respectively.<br />

Moreover, the elements c i and c ′ i<br />

are determined by the following expressions:<br />

c i = 1 N<br />

c ′ i = 1 N<br />

N−1<br />

∑<br />

k=0<br />

N−1<br />

∑<br />

k=0<br />

λ k b 2 k<br />

πki<br />

cos ,i=0, 1,... ,2N − 1,<br />

N<br />

λ k cos π(k + 1 2 )i ,i=0, 1,... ,2N − 1,<br />

N<br />

where the sequence {λ k : k =0, 1,... ,N − 1} is a real-valued sequence.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!