v2009.01.01 - Convex Optimization
v2009.01.01 - Convex Optimization v2009.01.01 - Convex Optimization
300 CHAPTER 4. SEMIDEFINITE PROGRAMMING gap-loss easy: it amounts to solving a linear system of equations and requires little or no optimization; with caveat, number of equations exceeds cardinality of signal representation (roughly l ≥ k) with respect to DCT basis. But addition of a significant amount of noise η increases level of difficulty dramatically; a 1-norm based method of reducing cardinality, for example, almost always returns DCT basis coefficients numbering in excess of minimum cardinality. We speculate that is because signal cardinality 2l becomes the predominant cardinality. DCT basis coefficient cardinality is an explicit constraint to the optimization problem we shall pose: In presence of noise, constraints equating reconstructed signal f to received signal g are not possible. We can instead formulate the dropout recovery problem as a best approximation: ∥[ ∥∥∥ minimize x∈R n subject to f = Ψx x ≽ 0 cardx ≤ k ]∥ f 1:l − g 1:l ∥∥∥ f n−l+1:n − g n−l+1:n (689) We propose solving this nonconvex problem (689) by moving the cardinality constraint to the objective as a regularization term as explained in4.5; id est, by iteration of two convex problems until convergence: and minimize 〈x , y〉 + x∈R n subject to f = Ψx x ≽ 0 [ ∥ minimize y∈R n 〈x ⋆ , y〉 subject to 0 ≼ y ≼ 1 ]∥ f 1:l − g 1:l ∥∥∥ f n−l+1:n − g n−l+1:n y T 1 = n − k (467) (690) Signal cardinality 2l is implicit to the problem statement. When number of samples in the dropout region exceeds half the window size, then that deficient cardinality of signal remaining becomes a source of degradation to reconstruction in presence of noise. Thus, by observation, we divine a reconstruction rule for this signal dropout problem to attain good
4.5. CONSTRAINING CARDINALITY 301 flatline and g 0.25 0.2 0.15 s + η 0.1 0.05 0 −0.05 −0.1 η s + η (a) −0.15 −0.2 dropout (s = 0) −0.25 0 100 200 300 400 500 f and g 0.25 0.2 0.15 f 0.1 0.05 0 (b) −0.05 −0.1 −0.15 −0.2 −0.25 0 100 200 300 400 500 Figure 81: (a) Signal dropout in signal s corrupted by noise η (SNR =10dB, g = s + η). Flatline indicates duration of signal dropout. (b) Reconstructed signal f (red) overlaid with corrupted signal g .
- Page 249 and 250: 4.1. CONIC PROBLEM 249 4.1.1.2 Redu
- Page 251 and 252: 4.1. CONIC PROBLEM 251 In any SDP f
- Page 253 and 254: 4.1. CONIC PROBLEM 253 Proposition
- Page 255 and 256: 4.2. FRAMEWORK 255 sets are closed
- Page 257 and 258: 4.2. FRAMEWORK 257 4.2.1.1.3 Exampl
- Page 259 and 260: 4.2. FRAMEWORK 259 4.2.2 Duals The
- Page 261 and 262: 4.2. FRAMEWORK 261 When equality is
- Page 263 and 264: 4.2. FRAMEWORK 263 The pseudoinvers
- Page 265 and 266: 4.2. FRAMEWORK 265 For the data giv
- Page 267 and 268: 4.2. FRAMEWORK 267 minimizes an aff
- Page 269 and 270: 4.3. RANK REDUCTION 269 whose rank
- Page 271 and 272: 4.3. RANK REDUCTION 271 and where m
- Page 273 and 274: 4.3. RANK REDUCTION 273 4.3.3 Optim
- Page 275 and 276: 4.3. RANK REDUCTION 275 Initialize:
- Page 277 and 278: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 279 and 280: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 281 and 282: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 283 and 284: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 285 and 286: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 287 and 288: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 289 and 290: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 291 and 292: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 293 and 294: 4.4. RANK-CONSTRAINED SEMIDEFINITE
- Page 295 and 296: 4.5. CONSTRAINING CARDINALITY 295 m
- Page 297 and 298: 4.5. CONSTRAINING CARDINALITY 297 m
- Page 299: 4.5. CONSTRAINING CARDINALITY 299 a
- Page 303 and 304: 4.5. CONSTRAINING CARDINALITY 303 n
- Page 305 and 306: 4.5. CONSTRAINING CARDINALITY 305 W
- Page 307 and 308: 4.5. CONSTRAINING CARDINALITY 307 t
- Page 309 and 310: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 311 and 312: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 313 and 314: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 315 and 316: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 317 and 318: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 319 and 320: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 321 and 322: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 323 and 324: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 325 and 326: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 327 and 328: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 329 and 330: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 331 and 332: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 333 and 334: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 335 and 336: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 337 and 338: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 339 and 340: 4.6. CARDINALITY AND RANK CONSTRAIN
- Page 341 and 342: 4.7. CONVEX ITERATION RANK-1 341 fi
- Page 343 and 344: 4.7. CONVEX ITERATION RANK-1 343 Gi
- Page 345 and 346: Chapter 5 Euclidean Distance Matrix
- Page 347 and 348: 5.2. FIRST METRIC PROPERTIES 347 co
- Page 349 and 350: 5.3. ∃ FIFTH EUCLIDEAN METRIC PRO
4.5. CONSTRAINING CARDINALITY 301<br />
flatline and g<br />
0.25<br />
0.2<br />
0.15<br />
s + η<br />
0.1<br />
0.05<br />
0<br />
−0.05<br />
−0.1<br />
η<br />
s + η<br />
(a)<br />
−0.15<br />
−0.2<br />
dropout (s = 0)<br />
−0.25<br />
0 100 200 300 400 500<br />
f and g<br />
0.25<br />
0.2<br />
0.15<br />
f<br />
0.1<br />
0.05<br />
0<br />
(b)<br />
−0.05<br />
−0.1<br />
−0.15<br />
−0.2<br />
−0.25<br />
0 100 200 300 400 500<br />
Figure 81: (a) Signal dropout in signal s corrupted by noise η (SNR =10dB,<br />
g = s + η). Flatline indicates duration of signal dropout. (b) Reconstructed<br />
signal f (red) overlaid with corrupted signal g .