motion estimation and compensation for very low bitrate video coding

More documents

Recommendations

Info

10 Introduction Once the proposed scheme is outlined, Chapter Five presents solutions to the two main steps of the scheme: the automatic design of a mesh adapted to the spatial contents of the reference image, and the adaptation of the BMA vector eld so as to be applicable to the mesh. The rst problem is addressed by detecting object contours in the image and tracking these contours so as to extract \corners" (i.e. maximum curvature points). The selected corners then serve asvertices of a triangular mesh generated by Delaunay triangulation. The second problem is solved byaninterpolation technique known as \inverse kriging". Finally, the chapter concludes by presenting some subjective results. Finally, a general conclusion is drawn from the obtained results. It reviews the various contributions of the present work but also raises the question as to which parts of the motion exploitation chain (estimation - transmission - compensation) is it useful to take the spatial contents of the images into account. Contributions of the Thesis The key contributions of the present research are summarized on the gure below. Some of these contributions are personal, others are the result of a close collaboration with other members of the TELE laboratory 2 . Some are also the subject of previous publications [111, 77, 11, 73, 68, 70, 23, 69, 19, 20, 71, 75, 74, 76]. Framework Thesis contributions CODER Estimation: motion analysis Chap. 3 Adaptive Block- Matching Algorithm Channel Transmission Chap. 4 Study of the impact of preprocessing DECODER Motion compensation Chap. 5 Mesh-based reconstruction of BMA fields Improve BMA with content-adapted techniques 2 Most of the work related to the COMIS scheme has been achieved in collaboration with many other researchers in image processing at the laboratory: M.P. Queluz, B. Simon, O. Bruyndonckx, V. Warscotte, T. Delmot, C. Devleeschouwer.
Introduction 11 With the exception of the COMIS contribution presented in Chapter One, all the contributions obey the same approach: to use some contentadapted information in order to improve the performances of the reference Block-Matching Algorithm. This approach involves the following achievements: Chapter Three requires the programming and ne tuning of the existing Adaptive Block Matching Algorithm (ABMA) in order to improve motion estimation. It also details how to distribute the computational burden of the ABMA among several processors. Chapter Four establishes a model of the behavior of very-low bitrate video coding. It proposes an analytical study of the impact of pre-processing on such a VLBR coding. Some experimentation aims at validating the developed model and at practically determining whether pre-processing o ers some gain when inserted in a complete coding scheme. Chapter Five deals with the conception and the development of an original scheme for motion compensation. It rst involves developing a tool for corner extraction, which isachieved by improving the half-boundaries detector of Noble. The application of interpolation to motion vector elds is also tackled so as to transpose the information they provide from a regular grid to a non-regular one. Finally, Chapter Five integrates and simulates the proposed asymmetric motion estimation & compensation process, relying on mesh-based reconstruction.
Page 1: LABORATOIRE DE TELECOMMUNICATIONS E
Page 5: Avant-propos Mener a bien une these
Page 8 and 9: Resume L'estimation du mouvement re
Page 10 and 11: x 2.1.1 Apparent versus Real Motion
Page 12 and 13: xii A VLBR-like video sequences 167
Page 14 and 15: 2 Introduction Ancient Greece initi
Page 16 and 17: 4 Introduction Meanwhile, the desir
Page 18 and 19: 6 Introduction However, one can que
Page 20 and 21: 8 Introduction compensation in a vi
Page 25 and 26: Chapter 1 Digital Video Coding at V
Page 27 and 28: 1.2 Video Coding 15 These di erence
Page 29 and 30: 1.2 Video Coding 17 { The redundanc
Page 31 and 32: 1.2 Video Coding 19 exhaustive use
Page 33 and 34: 1.4 Some (Very-) Low BitRate Codecs
Page 49: 1.5 Discussion 37 1.5 Discussion Th
Page 52 and 53: 40 Chapter 2. Motion in the Framewo
Page 72 and 73:
60 Chapter 2. Motion in the Framewo
Page 74 and 75:
Page 76 and 77:
Page 78 and 79:
Page 80 and 81:
Page 82 and 83:
Page 84 and 85:
Page 86 and 87:
Page 88 and 89:
Page 90 and 91:
78 Chapter 3. Multiscale Block Matc
Page 92 and 93:
Page 94 and 95:
Page 96 and 97:
Page 98 and 99:
Page 100 and 101:
Page 102 and 103:
Page 104 and 105:
Page 107 and 108:
Chapter 4 Image Pre-Processing for
Page 109 and 110:
4.1 Intuitive Rationale 97 (a) (b)
Page 111 and 112:
4.1 Intuitive Rationale 99 (a) (b)
Page 113 and 114:
4.2 Rate Distortion Conditions 101
Page 115 and 116:
Page 117 and 118:
Page 119 and 120:
4.3 Experimental Results 107 Pre-pr
Page 121 and 122:
4.3 Experimental Results 109 Mean P
Page 123 and 124:
4.3 Experimental Results 111 From t
Page 125 and 126:
4.3 Experimental Results 113 Origin
Page 127 and 128:
Page 129 and 130:
Page 131:
4.4 Conclusion 119 4.4 Conclusion T
Page 134 and 135:
122 Chapter 5. Mesh-Based Motion Co
Page 136 and 137:
Page 138 and 139:
Page 140 and 141:
Page 142 and 143:
Page 144 and 145:
Page 146 and 147:
Page 148 and 149:
Page 150 and 151:
Page 152 and 153:
Page 154 and 155:
Page 156 and 157:
Page 158 and 159:
Page 160 and 161:
Page 162 and 163:
Page 164 and 165:
Page 166 and 167:
Page 168 and 169:
Page 170 and 171:
Page 172 and 173:
Page 174 and 175:
162 Conclusion so as to adapt the s
Page 176 and 177:
164 Conclusion gain is not as obvio
Page 179 and 180:
Appendix A VLBR-like video sequence
Page 181 and 182:
VLBR-like video sequences 169 Coast
Page 183 and 184:
Appendix B Rate Distortion theory A
Page 185 and 186:
B.1 Information Theory 173 B.1 Info
Page 187 and 188:
B.2 Discrete Memoryless Sources and
Page 189 and 190:
B.3 Rate Distortion Function 177 B.
Page 191 and 192:
B.4 Extension to Moving Pictures 17
Page 193:
B.4 Extension to Moving Pictures 18
Page 196 and 197:
184 Chapter C. Markov Random Fields
Page 198 and 199:
186 Chapter C. Markov Random Fields
Page 201 and 202:
Appendix D Complements to Chapter 5
Page 203 and 204:
D.2 Pseudo-code of the implementati
Page 205 and 206:
Page 207 and 208:
Page 209 and 210:
Page 211 and 212:
Page 213 and 214:
Page 215 and 216:
Bibliography [1] COST 211ter Simula
Page 217 and 218:
Bibliography 205 [21] E. Decenciere
Page 219 and 220:
Bibliography 207 [41] R.M. Gray. Ve
Page 221 and 222:
Bibliography 209 [65] B. Macq, M.P.
Page 223 and 224:
Bibliography 211 [86] H.G. Musmann,
Page 225 and 226:
Bibliography 213 [110] M.P. Queluz
Page 227:
Bibliography 215 [132] F. Vermaut,
show all

motion estimation and compensation for very low bitrate video coding

Create successful ePaper yourself

Delete template?

Save as template?