StereoRectificationGridGenerator¶
Generates two deformation fields to resample in epipolar geometry, a pair of stereo images up to the sensor model precision
Description¶
This application generates a pair of deformation grid to stereo-rectify a pair of stereo images according to sensor modelling and a mean elevation hypothesis.
This application is the first part of the stereo reconstruction framework. The output deformation grids can be passed to the GridBasedImageResampling application for actual resampling into epipolar geometry.
There are several ways to set the elevation source:
- An arbitrary constant elevation
- A DEM directory
- Compute an average elevation from a DEM
If needed, the application can compute inverse resampling grids (from epipolar to original sensor geometry). Don’t forget to check the other outputs from the application. For instance, the application gives the X and Y size of the rectified images, along with an estimated baseline ratio.
This application has several output images and supports “multi-writing”. Instead of computing and writing each image independently, the streamed image blocks are written in a synchronous way for each output. The output images will be computed strip by strip, using the available RAM to compute the strip size, and a user defined streaming mode can be specified using the streaming extended filenames (type, mode and value). Note that multi-writing can be disabled using the multi-write extended filename option: &multiwrite=false, in this case the output images will be written one by one. Note that multi-writing is not supported for MPI writers.
Parameters¶
Input and output data¶
This group of parameters allows setting the input and output images.
Left input image -io.inleft image
Mandatory
The left image from the stereo pair, in sensor geometry.
Right input image -io.inright image
Mandatory
The right image from the stereo pair, in sensor geometry.
Left output deformation grid -io.outleft image [dtype]
Mandatory
The deformation grid to resample the left image from sensor geometry to epipolar geometry.
Right output deformation grid -io.outright image [dtype]
Mandatory
The deformation grid to resample the right image from sensor geometry to epipolar geometry.
Epipolar geometry and grid parameters¶
Parameters of the epipolar geometry and output grids
Elevation management¶
This group of parameters allows managing elevation values.
DEM directory -epi.elevation.dem directory
This parameter allows selecting a directory containing Digital Elevation Model files. Note that this directory should contain only DEM files. Unexpected behaviour might occurs if other images are found in this directory. Input DEM tiles should be in a raster format supported by GDAL.
Geoid File -epi.elevation.geoid filename [dtype]
Use a geoid grid to get the height above the ellipsoid in case there is no DEM available, no coverage for some points or pixels with no_data in the DEM tiles. A version of the geoid can be found on the OTB website (egm96.grd and egm96.grd.hdr at https://gitlab.orfeo-toolbox.org/orfeotoolbox/otb/-/tree/master/Data/Input/DEM).
Default elevation -epi.elevation.default float
Default value: 0
This parameter allows setting the default height above ellipsoid when there is no DEM available, no coverage for some points or pixels with no_data in the DEM tiles, and no geoid file has been set. This is also used by some application as an average elevation value.
Average elevation computed from DEM¶
Average elevation computed from the provided DEM
Sub-sampling step -epi.elevation.avgdem.step int
Default value: 1
Step of sub-sampling for average elevation estimation
Average elevation value -epi.elevation.avgdem.value float
Mandatory
Average elevation value estimated from DEM
Minimum disparity from DEM -epi.elevation.avgdem.mindisp float
Mandatory
Disparity corresponding to estimated minimum elevation over the left image
Maximum disparity from DEM -epi.elevation.avgdem.maxdisp float
Mandatory
Disparity corresponding to estimated maximum elevation over the left image
Scale of epipolar images -epi.scale float
Default value: 1
The scale parameter allows generating zoomed-in (scale < 1) or zoomed-out (scale > 1) epipolar images.
Step of the deformation grid (in number of pixels) -epi.step int
Default value: 1
Stereo-rectification deformation grid only varies slowly. Therefore, it is recommended to use a coarser grid (higher step value) in case of large images
Rectified image size X -epi.rectsizex int
Mandatory
The application computes the optimal rectified image size so that the whole left input image fits into the rectified area. However, due to the scale and step parameter, this size may not match the size of the deformation field output. In this case, one can use these output values.
Rectified image size Y -epi.rectsizey int
Mandatory
The application computes the optimal rectified image size so that the whole left input image fits into the rectified area. However, due to the scale and step parameter, this size may not match the size of the deformation field output. In this case, one can use these output values.
Mean baseline ratio -epi.baseline float
Mandatory
This parameter is the mean value, in pixels.meters^-1, of the baseline to sensor altitude ratio. It can be used to convert disparities to physical elevation, since a disparity of one pixel will correspond to an elevation offset of the invert of this value with respect to the mean elevation.
Write inverse fields¶
This group of parameter allows generating the inverse fields as well
Left inverse deformation grid -inverse.outleft image [dtype]
The deformation grid to resample the left image from the epipolar geometry back into its original sensor geometry.
Right inverse deformation grid -inverse.outright image [dtype]
The output deformation grid to resample the right image from the epipolar geometry back into its original sensor geometry.
Sub-sampling rate for inversion -inverse.ssrate int
Default value: 16
Grid inversion is an heavy process that implies spline regression on control points. To avoid eating to much memory, this parameter allows one to first sub-sample the field to invert.
Available RAM (MB) -ram int
Default value: 256
Available memory for processing (in MB).
Examples¶
From the command-line:
otbcli_StereoRectificationGridGenerator -io.inleft wv2_xs_left.tif -io.inright wv2_xs_left.tif -io.outleft wv2_xs_left_epi_field.tif -io.outright wv2_xs_right_epi_field.tif -epi.elevation.default 400
From Python:
import otbApplication
app = otbApplication.Registry.CreateApplication("StereoRectificationGridGenerator")
app.SetParameterString("io.inleft", "wv2_xs_left.tif")
app.SetParameterString("io.inright", "wv2_xs_left.tif")
app.SetParameterString("io.outleft", "wv2_xs_left_epi_field.tif")
app.SetParameterString("io.outright", "wv2_xs_right_epi_field.tif")
app.SetParameterFloat("epi.elevation.default", 400)
app.ExecuteAndWriteOutput()
Limitations¶
Generation of the deformation grid is not streamable, pay attention to this fact when setting the grid step.