Python scripts for performing stereo depth estimation using the HITNET Tensorflow model.

Overview

HITNET-Stereo-Depth-estimation

Python scripts for performing stereo depth estimation using the HITNET Tensorflow model from Google Research.

Hitnet stereo depth estimation Stereo depth estimation on the cones images from the Middlebury dataset (https://vision.middlebury.edu/stereo/data/scenes2003/)

Requirements

Tensorflow models

Download the tensorflow models from the original repository and save them into the models folder.

Examples

  • Image inference:
python imageDepthEstimation.py 
  • Video inference:
python videoDepthEstimation.py
  • DrivingStereo dataset inference:
python drivingStereoTest.py

Inference video Example

!Hitnet stereo depth estimation on video

References:

You might also like...
Light-weight network, depth estimation, knowledge distillation, real-time depth estimation, auxiliary data.
Light-weight network, depth estimation, knowledge distillation, real-time depth estimation, auxiliary data.

light-weight-depth-estimation Boosting Light-Weight Depth Estimation Via Knowledge Distillation, https://arxiv.org/abs/2105.06143 Junjie Hu, Chenyou F

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.
Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

Honours project, on creating a depth estimation map from two stereo images of featureless regions

image-processing This module generates depth maps for shape-blocked-out images Install If working with anaconda, then from the root directory: conda e

Monocular Depth Estimation Using Laplacian Pyramid-Based Depth Residuals
Monocular Depth Estimation Using Laplacian Pyramid-Based Depth Residuals

LapDepth-release This repository is a Pytorch implementation of the paper "Monocular Depth Estimation Using Laplacian Pyramid-Based Depth Residuals" M

The implemention of Video Depth Estimation by Fusing Flow-to-Depth Proposals

Flow-to-depth (FDNet) video-depth-estimation This is the implementation of paper Video Depth Estimation by Fusing Flow-to-Depth Proposals Jiaxin Xie,

(CVPR 2022 - oral) Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometry
(CVPR 2022 - oral) Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometry

Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometry Official implementation of the paper Multi-View Depth Est

Python scripts for performing lane detection using the LSTR model in ONNX
Python scripts for performing lane detection using the LSTR model in ONNX

ONNX LSTR Lane Detection Python scripts for performing lane detection using the Lane Shape Prediction with Transformers (LSTR) model in ONNX. Requirem

Python scripts for performing road segemtnation and car detection using the HybridNets multitask model in ONNX.
Python scripts for performing road segemtnation and car detection using the HybridNets multitask model in ONNX.

ONNX-HybridNets-Multitask-Road-Detection Python scripts for performing road segemtnation and car detection using the HybridNets multitask model in ONN

Python scripts performing class agnostic object localization using the Object Localization Network model in ONNX.
Python scripts performing class agnostic object localization using the Object Localization Network model in ONNX.

ONNX Object Localization Network Python scripts performing class agnostic object localization using the Object Localization Network model in ONNX. Ori

Comments
  • Tensorflow models

    Tensorflow models

    Hello, thank you for this code, i try to test imageDepthEstimation.py i did not find the Tensorflow models, can you please give me the link to download it . thank you

    opened by chaimaOues 10
  • imageDepthEstimation.py error

    imageDepthEstimation.py error

    Hi,

    I tried to run "python imageDepthEstimation.py" and encounter the following error:

    NotImplementedError: Cannot convert a symbolic Tensor (PartitionedCall:0) to a numpy array.

    when I traced the code below:

            def inference(self, input_tensor):
    		output = self.model(input_tensor)
    		return np.squeeze(output)
    

    and found that: input_tensor: <tf.Tensor 'Const:0' shape=(1, 375, 450, 2) dtype=float32> output: <tf.Tensor 'PartitionedCall:0' shape=(?, ?, ?, ?) dtype=float32>

    It seems the model is not working!? (I did trace the model path are correct and loading the model went through without any error message...)

    Could you please help to shed some insight on what caussing this problem? and how to fix it?

    environemnt: tensorflow: 1.15 python: 3.6.5 numpy: 1.19.5

    Thanks.

    opened by ynjiun 2
  • reproduce eval metrics

    reproduce eval metrics

    Hi I'm trying to reproduce the metrics reported here https://github.com/zjjMaiMai/TinyHITNet

    When running ModelType.middlebury on cones/im2.png cones/im6.png the disparity_map looks close in visualisation But it's values are maxed at ~55.0 and EPE metric is at ~98.0 when compared to cones/disp2.png

    Could you please share the proper way to evaluate the model ?

    opened by N950 2
  • when I run

    when I run "python imageDepthEstimation.py",it seems some errors appered.

    errors:

    /HITNET-Stereo-Depth-estimation/hitnet/utils_hitnet.py", line 28, in draw_disparity
        disparity_map = disparity_map.astype("uint8")
    ValueError: setting an array element with a sequence.
    
    opened by yjzhang19 0
Owner
Ibai Gorordo
Passionate about sensors, technology and their potential to help people.
Ibai Gorordo
Python scripts form performing stereo depth estimation using the HITNET model in ONNX.

ONNX-HITNET-Stereo-Depth-estimation Python scripts form performing stereo depth estimation using the HITNET model in ONNX. Stereo depth estimation on

Ibai Gorordo 30 Nov 8, 2022
Python scripts form performing stereo depth estimation using the high res stereo model in PyTorch .

PyTorch-High-Res-Stereo-Depth-Estimation Python scripts form performing stereo depth estimation using the high res stereo model in PyTorch. Stereo dep

Ibai Gorordo 26 Nov 24, 2022
Python scripts for performing stereo depth estimation using the MobileStereoNet model in Tensorflow Lite.

TFLite-MobileStereoNet Python scripts for performing stereo depth estimation using the MobileStereoNet model in Tensorflow Lite. Stereo depth estimati

Ibai Gorordo 4 Feb 14, 2022
Python scripts form performing stereo depth estimation using the CoEx model in ONNX.

ONNX-CoEx-Stereo-Depth-estimation Python scripts form performing stereo depth estimation using the CoEx model in ONNX. Stereo depth estimation on the

Ibai Gorordo 8 Dec 29, 2022
Python scripts for performing stereo depth estimation using the MobileStereoNet model in ONNX

ONNX-MobileStereoNet Python scripts for performing stereo depth estimation using the MobileStereoNet model in ONNX Stereo depth estimation on the cone

Ibai Gorordo 23 Nov 29, 2022
Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in Tensorflow Lite.

TFLite-msg_chn_wacv20-depth-completion Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model

Ibai Gorordo 2 Oct 4, 2021
ONNX-GLPDepth - Python scripts for performing monocular depth estimation using the GLPDepth model in ONNX

ONNX-GLPDepth - Python scripts for performing monocular depth estimation using the GLPDepth model in ONNX

Ibai Gorordo 18 Nov 6, 2022
ONNX-PackNet-SfM: Python scripts for performing monocular depth estimation using the PackNet-SfM model in ONNX

Python scripts for performing monocular depth estimation using the PackNet-SfM model in ONNX

Ibai Gorordo 14 Dec 9, 2022
Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in ONNX

ONNX msg_chn_wacv20 depth completion Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20 model in

Ibai Gorordo 19 Oct 22, 2022
Monocular Depth Estimation - Weighted-average prediction from multiple pre-trained depth estimation models

merged_depth runs (1) AdaBins, (2) DiverseDepth, (3) MiDaS, (4) SGDepth, and (5) Monodepth2, and calculates a weighted-average per-pixel absolute dept

Pranav 39 Nov 21, 2022