Virtual 3D interactions between 2D real multi-views

In this paper, we introduce an image processing tool, Video Spatialization, as a new approach to navigate through a "virtualized" scene, only known by a limited set of 2 D uncalibrated images (i.e without any 3 D CAD model). We develop this approach in the context of an interactive application : a multipoint teleconferencing system for very low bit rate links (internet, mobile communications), based on the immersion of the 3 D virtual models of all the participants in a common virtualized meeting place controlled by video spatialization. This article contains (i) the recall of an efficient "mesh-oriented" algorithm for the reconstruction of real views and the synthesis of virtual ones from a triplet of uncalibrated views; (ii) some extensions of the original approach from one to n triplets of views to simulate 3 D navigation and (iii) preliminary investigations using video spatialization for background control within the context of our virtual teleconferencing application.