Methods of Background Reconstruction
The YUVsoft Background Reconstruction plugin creates input data for the final stage of 3D video creation: conversion from 2D to stereo or multiview video. The algorithm restores occluded background areas that were invisible to the 2D camera because of foreground objects. In case of camera motion or object movement, you can use the plugin to restore background details for a certain frame using information from other frames; this method is called Temporal inpainting.
This method is applicable only in cases of significant object motion, where the background (which is initially hidden behind an object) becomes visible as the scene progresses. In other cases the missing background can be restored using the Hybrid method, where both Temporal inpainting and Spatial inpainting methods are applied. Here the data received by Spatial inpainting is propagated by Temporal inpainting to the other frames in the video, thus avoiding abrupt changes in the restored background. Two types of Spatial inpainting, each designed to process various background types, are available: Texture Spatial inpainting and Blur Spatial inpainting. Texture Spatial inpainting applies to highly detailed backgrounds such as grass or sandy beaches, and Blur Spatial inpainting yields fine results for fuzzy backgrounds with smooth areas, such as water or sky areas.
Reconstruction of the missing background is a crucial stage of 2D-to-3D video conversion, and it requires precision processing to yield an impressive 3D image. The YUVsoft Background Reconstruction plugin successfully tackles this important task. The restored background then can used by YUVsoft Stereo Generator.
See also:
- 2D to S3D conversion process – general paradigm.
- Stereo Generator – the tool for high quality stereo generation from 2D+Depth video.
- Stereo Generator plugin for Adobe After Effects.
- Fuzzy edges processing – handles such complicate details as fur, hair and translucent areas.
- Depth map dilation – helps to eliminate halos and stripes of wrong color around foreground objects on the resulting stereo video.