Title
Online tracking of outdoor lighting variations for augmented reality with moving cameras.
Abstract
In augmented reality, one of key tasks to achieve a convincing visual appearance consistency between virtual objects and video scenes is to have a coherent illumination along the whole sequence. As outdoor illumination is largely dependent on the weather, the lighting condition may change from frame to frame. In this paper, we propose a full image-based approach for online tracking of outdoor illumination variations from videos captured with moving cameras. Our key idea is to estimate the relative intensities of sunlight and skylight via a sparse set of planar feature-points extracted from each frame. To address the inevitable feature misalignments, a set of constraints are introduced to select the most reliable ones. Exploiting the spatial and temporal coherence of illumination, the relative intensities of sunlight and skylight are finally estimated by using an optimization process. We validate our technique on a set of real-life videos and show that the results with our estimations are visually coherent along the video sequences.
Year
DOI
Venue
2012
10.1109/TVCG.2012.53
IEEE Trans. Vis. Comput. Graph.
Keywords
Field
DocType
temporal coherence,optimisation,full image-based approach,video signal processing,planar feature point extraction,relative intensity,optimization process,video scene,moving camera,key task,lighting,virtual object,outdoor lighting variations,skylight relative intensity,inevitable feature misalignments,moving cameras.,coherent illumination,visual appearance consistency,spatial coherence,outdoor illumination variation,illumination coherence,online tracking,life video,sunlight relative intensity,feature extraction,augmented reality,object tracking,image sequences,cameras,lighting condition,key idea,outdoor lighting variation,illumination,outdoor illumination,planar feature,video sequence,computer graphics,algorithms,three dimensional,estimation,motion,geometry
Virtual image,Computer vision,Computer graphics (images),Computer science,Feature extraction,Augmented reality,Coherence (physics),Video tracking,Planar,Skylight,Artificial intelligence,Visual appearance
Journal
Volume
Issue
ISSN
18
4
1941-0506
Citations 
PageRank 
References 
13
0.56
29
Authors
2
Name
Order
Citations
PageRank
Yanli Liu18610.05
Xavier Granier235728.97