Multicamera video-stitching (original) (raw)
Related papers
Fast stitching of videos captured from freely moving devices by exploiting temporal redundancy
2010
We investigate the problem of efficient panoramic video construction based on time-synchronized input video streams. No additional constraints are imposed regarding the motion of the capturing video cameras. The presented work is, to the best of our knowledge, the first attempt to construct in real-time a panoramic video stream from input video streams captured by freely moving cameras. The main contribution is in proposing an efficient panoramic video construction algorithm that exploits temporal information to avoid solving the stitching problem fully on a frame by frame basis. We provide detailed experimental evaluation of different methodologies that employ previous frames stitching results such as tracking interest points using optical flow and using areas of overlap to limit the search space for interest points. Our results clearly indicate that making use of temporal information in video stitching can achieve a significant reduction in execution time while providing a comparable effectiveness.
A new image projection method for panoramic image stitching
2010
We propose a new image projection method in an attempt to reduce the perceptual distortion in panoramic image mosaics. Specifically, we reduce the stretching distortion of some image patches and bending of straight lines. Since the stretching distortion usually occurs when projecting a viewing sphere to the cylindrical image surface in an oblique direction, we propose to use an adjustable cylindrical surface to match the viewing direction with the equator of the cylindrical surface. Also, in order to find the trade-off between the stretching distortion and bending of straight lines, we also adjust the curvature of cylindrical surface according to the object of interest in the image. The warping function from the viewing sphere to the adjustable image surface is derived and the amount of distortion caused by this warping function is also defined. From the measure of distortion, the optimal pose of the cylindrical image plane and its curvature are determined, and the image on the viewing sphere is projected on the optimal plane. The experimental results show that the proposed method produces the panoramic image with less distortion than the existing methods.
Computer Graphics Forum, 2008
Many video sequences consist of a locally dynamic background containing moving foreground subjects. In this paper we propose a novel way of re-displaying these sequences, by giving the user control over a virtual camera frame. Based on video mosaicing, we first compute a static high quality background panorama. After segmenting and removing the foreground subjects from the original video, the remaining elements are merged into a dynamic background panorama, which seamlessly extends the original video footage. We then re-display this augmented video by warping and cropping the panorama. The virtual camera can have an enlarged field-of-view and a controlled camera motion. Our technique is able to process videos with complex camera motions, reconstructing high quality panoramas without parallax artefacts, visible seams or blurring, while retaining repetitive dynamic elements.
A Survey on Real Time Image Stitching
Image stitching is an area of research in Computer graphics or computer vision. It is the process that combines multiple images together using various algorithms, techniques to encompass Field Of View(FOV) to create Panoramic view in a single, large high resolution frame using computer software. In recent years many algorithms, techniques are developed to handle challenges in image stitching. The demand of panoramic view is increased in various fields. Super-resolution images with wide angles are created by image stitching used in medical image stitching, photo mosaics with high resolution, satellite photography , Telemedicine and more. This paper represents recent approaches utilized in Image stitching. Finally, challenges in image stitching is alsodiscussed.
An innovative method for stitching the images for panoramic view
An image stitching method panorama gives serious issues with respect to distortion when collaborating long similar sequential images. To solve the distortion enhanced approach is proposed in this work, adding the alteration of the way sequential referred image and adding a head an approach that can calculate the transformation matrix[3] for any image with in the sequence to put for alignment[11] with the referred image with in the same space of coordinate area. Apart from this the enhanced stitching approach selects the next preceding image automatically based on the matched output points with respect to number of SIFT[10] approach. With regular stitching methodology and enhanced stitching[8] methodology , by comparing these two our approach decreases the SIFT features ROI detected area of the referred image. Our practical results shows theenhanced approach cannotonly initiate the efficiency of stitching on image processing and also drastic reduction of thepanoramic distortion[10][14] issues. This resu lts the plain non distorted panoramic image output.
Evergreen, 2023
Computer vision techniques for aligning and fusing images have long been employed to create smooth photographic mosaics. These methods have found applications in image stabilization features of camcorders, production of digital maps and satellite images through high-resolution photographic mosaics, and more. This paper introduces a novel method for generating composites from two or more images, with the ability to significantly reduce or eliminate white space when operating with a live connection. By leveraging algorithms such as Scale-Invariant Feature Transform (SIFT), the proposed method enables feature recognition and extraction from captured images, facilitating the removal of white space in live images. Additionally, this work presents a technique that merges live images with real-time camera input to complete missing elements by intelligently manipulating controlled elements in the images. The resulting approach offers a promising solution for real-time image fusion and the seamless integration of live camera feeds, enhancing the visual quality and completeness of the final composite.
Robust Alignment for Panoramic Stitching Via an Exact Rank Constraint
IEEE Transactions on Image Processing, 2019
We study the problem of image alignment for panoramic stitching. Unlike most existing approaches that are feature-based, our algorithm works on pixels directly, and accounts for errors across the whole images globally. Technically, we formulate the alignment problem as rank-1 and sparse matrix decomposition over transformed images, and develop an efficient algorithm for solving this challenging non-convex optimization problem. The algorithm reduces to solving a sequence of subproblems, where we analytically establish exact recovery conditions, convergence and optimality, together with convergence rate and complexity. We generalize it to simultaneously align multiple images and recover multiple homographies, extending its application scope towards vast majority of practical scenarios. Experimental results demonstrate that the proposed algorithm is capable of more accurately aligning the images and generating higher quality stitched images than state-of-the-art methods.
A multicamera setup for generating stereo panoramic video
2005
Abstract Traditional visual communication systems convey only two-dimensional (2-D) fixed field-of-view (FOV) video information. The viewer is presented with a series of flat, nonstereoscopic images, which fail to provide a realistic sense of depth. Furthermore, traditional video is restricted to only a small part of the scene, based on the director's discretion and the user is not allowed to" look around" in an environment.
Stereoscopic image stitching with rectangular boundaries
The Visual Computer, 2019
This paper proposes a novel algorithm for stereoscopic image stitching, which aims to produce stereoscopic panoramas with rectangular boundaries. As a result, it provides wider field of view and better viewing experience for users. To achieve this, we formulate stereoscopic image stitching and boundary rectangling in a global optimization framework that simultaneously handles feature alignment, disparity consistency and boundary regularity. Given two (or more) stereoscopic images with overlapping content, each containing two views (for left and right eyes), we represent each view using a mesh and our algorithm contains three main steps: We first perform a global optimization to stitch all the left views and right views simultaneously, which ensures feature alignment and disparity consistency. Then, with the optimized vertices in each view, we extract the irregular boundary in the stereoscopic panorama, by performing polygon Boolean operations in left and right views, and construct the rectangular boundary constraints. Finally, through a global energy optimization, we warp left and right views according to feature alignment, disparity consistency and rectangular boundary constraints. To show the effectiveness of our method, we further extend our method to dis
Panoramic Stereo Videos With a Single Camera
We present a practical solution for generating 360 degrees stereo panoramic videos using a single camera. Current approaches either use a moving camera that captures multiple images of a scene, which are then stitched together to form the final panorama, or use multiple cameras that are synchronized. A moving camera limits the solution to static scenes, while multi-camera solutions require dedicated calibrated setups. Our approach improves upon the existing solutions in two significant ways: It solves the problem using a single camera, thus minimizing the calibration problem and providing us the ability to convert any digital camera into a panoramic stereo capture device. It captures all the light rays required for stereo panoramas in a single frame using a compact custom designed mirror, thus making the design practical to manufacture and easier to use. We analyze several properties of the design as well as present panoramic stereo and depth estimation results.