Spatio-temporal video segmentation and representation for video indexing:
new issues in motion analysis
Patrick Bouthemy
IRISA / INRIA Rennes
Efficient access to information contained in video databases implies that a
structured representation of the content of the video is built beforehand.
We will address several important issues to be solved in that context:
- temporal segmentation of the video into shots handling different
kinds of transitions (cut, fade, dissolve, wipe)
- camera motion characterization (static, panning, zooming, tracking)
- extraction and tracking of relevant entities within a shot
- scene activity characterization for a large range of motion types
- creation of "annotated" iconic video summaries and index database
- motion-based query by similarity.
We have build an original and unified framework which mainly proceeds
from the analysis of the apparent motion between successive images
and of related information. It relies on statistical techniques, involving
robust estimation of 2D parametric motion models, Hinkley's test,
log-likelihood ratio tests, MRF modeling, statistical contextual labeling,
temporal cooccurrences of local motion-related quantities.
References:
Some of them are available by a
click here.
P. Bouthemy, M. Gelgon and F. Ganansia.
A unified approach to shot change detection and camera motion
characterization.
To appear in IEEE Trans. on Circuits and Systems for Video
Technology (scheduled Dec. 1999)
P. Bouthemy and R. Fablet,
Motion characterization from temporal cooccurrences of local
motion-based measures for video indexing.
Proc. 14th Int. Conf on Pattern Recognition, ICPR'98, p. 905--908,
Brisbane, August 1998.
M. Gelgon and P. Bouthemy,
Determining a structured spatio-temporal representation of video
content for efficient visualisation and indexing.
{\it Proc. of the 5th European Conf. on Computer Vision, ECCV'98},
LNCS 1406, Springer Verlag, p. 595--609,
Fribourg, June 1998.
M. Gelgon, P. Bouthemy and T. Dubois
A region tracking method with failure detection for an interactive video
indexing environment.
Proc. 3rd Int. Conf. on Visual Information Systems, Visual'99
Amsterdam, June 1999.
J.-M. Odobez and P. Bouthemy.
Robust multiresolution estimation of parametric motion models.
Journal of Visual Communication and Image Representation,
6(4):348--365, Dec. 1995.