On Video Completion: Line Scratch Detection in Films and Video Inpainting of Complex Scenes
Thursday, June 12, 2014
2:00 pm - 3:00 pm
Gross Hall 330
Alasdair Newson, Duke University
Abstract: In this presentation, I will talk about the two main subjects which I studied during my PhD. This work was carried out jointly with Telecom ParisTech and Technicolor. My supervisors were Andres Almansa (Telecom ParisTech), Yann Gousseau (Telecom ParisTech) and Patrick Perez (Technicolor). The first problem is the detection of line scratches in films. The second is video inpainting, which is the generic process of filling in an unknown region in a video. The process of video inpainting can obviously be used to restore line scratches, but also more generally to remove any sort of degradation or object from a video. The second part of the thesis concerned video inpainting. In this work, we present an automatic and generic video inpainting algorithm which is based on the optimisation of a patch-based energy functional in a multi-resolution framework. We look at some of the major challenges which arise in such an approach, and show the solutions which we propose. Among other issues, we have addressed the following problems: long execution times due to the search for the nearest neighbours of patches, dealing with textures in images and videos and inpainting with moving background or cameras. The resulting algorithm produces high quality results in a wide range of challenging situations, in highly reduced execution times compared with the state of the art.