Experimental Platforms for Computational Photography (original) (raw)

Abstract

Although interest in computational photography has steadily increased among graphics and vision researchers, few of these techniques have found their way into commercial cameras. In this article I offer several possible explanations, including barriers to entry that arise from the current structure of the photography industry, and an incompleteness and lack of robustness in current computational photography techniques. To begin addressing these problems, my laboratory has designed an open architecture for programmable cameras (called Frankencamera), an API (called FCam) with bindings for C++, and two reference implementations: a Nokia N900 smartphone with a modified software stack and a custom camera called the Frankencamera F2. Our short-term goal is to standardize this architecture and distribute our reference platforms to researchers and students worldwide. Our long-term goal is to help create an open-source camera community, leading eventually to commercial cameras that accept plugins and apps. I discuss the steps that might be needed to bootstrap this community, including scaling up the world's educational programs in photographic technology. Finally, I talk about some of future research challenges in computational photography.

The paper

• Experimental Platforms for Computational Photography (PDF file, 1MB)
  Note: The hardcopy published version contains an editorial mistake (a sentence out of place), which is corrected in this electronic version. The electronic version in the IEEE library has also been corrected.

Related material

• OurSIGGRAPH 2010 paper on the Frankencamera architecture.
  This paper includes a technical presentation of the FCam API, our two reference platforms, and our six demonstration applications.
• Documentation of the FCam API.
• Binaries and source code for our implementation of the FCam API forNokia N900 smartphones.

© Copyright 2010 by Marc Levoy
Last update: August 30, 2010 01:04:39 PM