People Watching (original) (raw)

People Watching: Human Actions as a Cue for Single-View Geometry

teaserImage

People

Abstract

We present an approach which exploits the coupling between human actions and scene geometry. We investigate the use of human pose as a cue for single-view 3D scene understanding. Our method builds upon recent advances in still-image pose estimation to extract functional and geometric constraints about the scene. These constraints are then used to improve state-of-the-art single-view 3D scene understanding approaches. The proposed method is validated on a collection of monocular time lapse sequences collected from YouTube and a dataset of still images of indoor scenes. We demonstrate that observing people performing different actions can significantly improve estimates of 3D scene geometry.

Paper

@inproceedings{Fouhey12, title = {People Watching: Human Actions as a Cue for Single-View Geometry}, author = {Fouhey, David F. and Delaitre, Vincent and Gupta, Abhinav and Efros, Alexei A. and Laptev, Ivan and Sivic, Josef}, booktitle = {Proc. 12th European Conference on Computer Vision}, year = {2012}, }

Extended Results

This video shows a selection of input timelapses and the evolution of functional surfaces and the resulting geometric interpretation.

Download (mp4, 18MB)

Timelapse Results Gallery (40 Sequences)

Still Results Gallery (100 Images)

Data

V. Delaitre, D. Fouhey, I. Laptev, J. Sivic, A. Gupta, and A. Efros. Scene Semantics from Long-term Observation of People. In Proc. ECCV 2012.

Funding

This research is supported by:

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright.