Multi-Scale Geometric Consistency Guided Multi-View Stereo

Related tags

Deep Learning ACMM
Overview

ACMM

[News] The code for ACMH is released!!!
[News] The code for ACMP is released!!!

About

ACMM is a multi-scale geometric consistency guided multi-view stereo method for efficient and accurate depth map estimation. If you find this project useful for your research, please cite:

@article{Xu2019ACMM,  
  title={Multi-Scale Geometric Consistency Guided Multi-View Stereo}, 
  author={Xu, Qingshan and Tao, Wenbing}, 
  journal={Computer Vision and Pattern Recognition (CVPR)},
  year={2019}
}

Dependencies

The code has been tested on Ubuntu 14.04 with GTX Titan X.

Usage

  • Compile ACMM
cmake .  
make
  • Test
Use script colmap2mvsnet_acm.py to convert COLMAP SfM result to ACMM input   
Run ./ACMM $data_folder to get reconstruction results

SfM Reconstructions for Tanks and Temples Dataset

To ease comparison with other MVS methods with our method on Tanks and Temples dataset, we release our SfM reconstuctions on this dataset. They are obtained by COLMAP and can be downloaded from here.

Acknowledgements

This code largely benefits from the following repositories: Gipuma and COLMAP. Thanks to their authors for opening source of their excellent works.

You might also like...
Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency[ECCV 2020]
Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency[ECCV 2020]

Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency(ECCV 2020) This is an official python implementati

 Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes
Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes

Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes

Code for
Code for "Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency" paper

UNICORN πŸ¦„ Webpage | Paper | BibTex PyTorch implementation of "Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency" pap

City-Scale Multi-Camera Vehicle Tracking Guided by Crossroad Zones Code

City-Scale Multi-Camera Vehicle Tracking Guided by Crossroad Zones Requirements Python 3.8 or later with all requirements.txt dependencies installed,

Official Implementation and Dataset of
Official Implementation and Dataset of "PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistency", CVPR 2021

Portrait Photo Retouching with PPR10K Paper | Supplementary Material PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask an

 the official code for ICRA 2021 Paper:
the official code for ICRA 2021 Paper: "Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimation"

G2S This is the official code for ICRA 2021 Paper: Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimation by Hemang

Code for 'Self-Guided and Cross-Guided Learning for Few-shot segmentation. (CVPR' 2021)'

SCL Introduction Code for 'Self-Guided and Cross-Guided Learning for Few-shot segmentation. (CVPR' 2021)' We evaluated our approach using two baseline

Aerial Single-View Depth Completion with Image-Guided Uncertainty Estimation (RA-L/ICRA 2020)
Aerial Single-View Depth Completion with Image-Guided Uncertainty Estimation (RA-L/ICRA 2020)

Aerial Depth Completion This work is described in the letter "Aerial Single-View Depth Completion with Image-Guided Uncertainty Estimation", by Lucas

PyTorch implementation for View-Guided Point Cloud Completion

PyTorch implementation for View-Guided Point Cloud Completion

Comments
  • ACMM input question

    ACMM input question

    Hi, thank you for providing this amazing work πŸ₯‡ πŸ₯‡

    please excuse ignorance , I am trying to use your method here with my SFM output , if I understood the script colmap2mvsnet_acm.py correctly the ACMM input is

    +── input_folder
    β”‚   +── cams
    β”‚   β”‚   +── pair.txt
    β”‚   β”‚   +── 00000000_cam.txt
    β”‚   β”‚   +── 00000001_cam.txt
    β”‚   β”‚   +── 00000002_cam.txt
    β”‚   β”‚   +── ...
    β”‚   +── images
    β”‚   β”‚   +── 00000000.jpg
    β”‚   β”‚   +── 00000001.jpg
    β”‚   β”‚   +── 00000002.jpg
    β”‚   β”‚   +── ...
    

    the _cam.txt files are for example :

    extrinsic
    7.49715011e+01 -6.19671023e+01 -1.02564244e+03  7.84223389e+00
    3.71642195e+02  8.19559173e+02 -2.30744366e+02  3.18972292e+00
    8.65385352e-01 -7.98839231e-02 -4.94698647e-01  8.12122229e-03
    0. 0. 0. 1.
    
    intrinsic
    853.36265647 0. 577.21334278
    0. 852.01008808 370.2930352
    0. 0. 1.
    
    <depth_value1> <depth_value2> <depth_value3> <depth_value4> <<<< depth range and interval 
    

    the pairs.txt file is for example :

     20 
     1
     <len(sorted_score>
     2
     <len(sorted_score>
     3
     <len(sorted_score>
     ....
     <sorted_score[image_id][0]>  <sorted_score[s][0]>
     <sorted_score[image_id][1]>  <sorted_score[s][1]>
     ...
    

    my question is what are the 4 depth values range and interval ? and what is the sorted_score ?

    opened by Alihamdy2496 0
  • GPU memory increasing problem

    GPU memory increasing problem

    Hi GhiXu, Thanks for your work a lot! There might a bug in ACMM.cpp at line 584 and line 672. The pre_costs_cuda is allocated memory two times when params.hierarchy is True but release once.

    cudaMalloc((void**)&pre_costs_cuda, sizeof(float) * cameras[0].height * cameras[0].width);

    opened by zhanzhanmiao 0
Owner
Qingshan Xu
Ph.D. Candidate, HUST
Qingshan Xu
(CVPR 2022 - oral) Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometry

Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometry Official implementation of the paper Multi-View Depth Est

Bae, Gwangbin 138 Dec 28, 2022
Code for "Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo"

Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo This repository includes the source code for our CVPR 2021 paper on multi-view mult

Jiahao Lin 66 Jan 4, 2023
Python scripts form performing stereo depth estimation using the high res stereo model in PyTorch .

PyTorch-High-Res-Stereo-Depth-Estimation Python scripts form performing stereo depth estimation using the high res stereo model in PyTorch. Stereo dep

Ibai Gorordo 26 Nov 24, 2022
RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching

RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching This repository contains the source code for our paper: RAFT-Stereo: Multilevel

Princeton Vision & Learning Lab 328 Jan 9, 2023
RTS3D: Real-time Stereo 3D Detection from 4D Feature-Consistency Embedding Space for Autonomous Driving

RTS3D: Real-time Stereo 3D Detection from 4D Feature-Consistency Embedding Space for Autonomous Driving (AAAI2021). RTS3D is efficiency and accuracy s

null 71 Nov 29, 2022
Blender add-on: Add to Cameras menu: View β†’ Camera, View β†’ Add Camera, Camera β†’ View, Previous Camera, Next Camera

Blender add-on: Camera additions In 3D view, it adds these actions to the View|Cameras menu: View β†’ Camera : set the current camera to the 3D view Vie

German Bauer 11 Feb 8, 2022
Planar Prior Assisted PatchMatch Multi-View Stereo

ACMP [News] The code for ACMH is released!!! [News] The code for ACMM is released!!! About This repository contains the code for the paper Planar Prio

Qingshan Xu 127 Dec 31, 2022
Pytorch codes for "Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentation"

Self-Supervised-MVS This repository is the official PyTorch implementation of our AAAI 2021 paper: "Self-supervised Multi-view Stereo via Effective Co

hongbin_xu 127 Jan 4, 2023
Code release of paper "Deep Multi-View Stereo gone wild"

Deep MVS gone wild Pytorch implementation of "Deep MVS gone wild" (Paper | website) This repository provides the code to reproduce the experiments of

François Darmon 53 Dec 24, 2022
COLMAP - Structure-from-Motion and Multi-View Stereo

COLMAP About COLMAP is a general-purpose Structure-from-Motion (SfM) and Multi-View Stereo (MVS) pipeline with a graphical and command-line interface.

null 4.7k Jan 7, 2023