High-Quality Increase in Depth Map Resolution Using Depth Upscale

 Depth Upscale
2D to 3D Suite 2D to 3D Suite
Available for After Effects and Nuke
Nuke After Effects

Frequently, performing 2D-to-3D conversion of video content using a low-resolution version of the input video is preferable. For instance, it is easier to draw a depth map manually for a frame in low resolution—and it takes less time to render the downscaled video sequence—than to do so for a full-HD frame. Auxiliary software for semiautomatic 2D-to-3D conversion also takes less time when processing downscaled video. Another reason to work with frames in low resolution is the reduced number of artifacts compared with processing the same video in higher quality. But when it comes time to increase the resolution to the original size, the result may appear rough, owing to sloppy object boundaries or to ghosting and loss of detail in gradient areas. YUVsoft Depth Upscale technology ensures quality results when increasing depth map resolution.

Upscale results
Upscale results (small depth map is 480×270 pixels; upscaled depth map has 1920×1080 resolution)

 

The algorithm uses the source video and the downscaled depth map sequence as input. The algorithm can then vary the resolution of the input depth map across a wide range of values. The Spatial strength parameter controls the degree of similarity between object boundaries in the source frame and those in the upscaled depth map. High Spatial strength values are not always preferable, however, because the source frame’s object boundaries can be blurred or the image may contain noise, reducing the quality of the upscaled depth sequence. But regardless of the selected Spatial strength value, the boundaries of upscaled objects will be in strict accordance with those of the source video frames.

Upscale results
Upscale results in comparisson with standart Lanczos interpolation mode (the image was croped)

 

YUVsoft Depth Upscale is a handy tool that automatically produces depth maps in the increased resolution: the upscaled depth maps demonstrate accurate boundaries and gradient areas. The algorithm supports various upscaling resolutions. Output depth maps from Depth Upscale can be used as input for other depth estimation and processing tools, or for stereo generation.

 Depth Upscale
2D to 3D Suite 2D to 3D Suite
Available for After Effects and Nuke
Nuke After Effects

 

See also: