ONNX-MobileStereoNet
Python scripts for performing stereo depth estimation using the MobileStereoNet model in ONNX
Stereo depth estimation on the cones images from the Middlebury dataset (https://vision.middlebury.edu/stereo/data/scenes2003/)
Requirements
- Check the requirements.txt file. Additionally, pafy and youtube-dl are required for youtube video inference.
Installation
pip install -r requirements.txt
pip install pafy youtube-dl
ONNX model
The original models were converted to different formats (including .onnx) by PINTO0309, the models can be found in his repository.
Original Pytorch model
The Pytorch pretrained model was taken from the original repository.
Examples
- Image inference:
python image_depth_estimation.py
- Video inference:
python video_depth_estimation.py
- DrivingStereo dataset inference:
python driving_sereo_test.py
Inference video Example
References:
- MobileStereoNet model: https://github.com/cogsys-tuebingen/mobilestereonet
- PINTO0309's model zoo: https://github.com/PINTO0309/PINTO_model_zoo
- PINTO0309's model conversion tool: https://github.com/PINTO0309/openvino2tensorflow
- DrivingStereo dataset: https://drivingstereo-dataset.github.io/
- Original paper: https://arxiv.org/pdf/2108.09770.pdf