Official Code Release for "CLIP-Adapter: Better Vision-Language Models with Feature Adapters"

peng gao

Last update: Dec 26, 2022

Related tags

Deep Learning CLIP-Adapter

Overview

Official Code Release for "CLIP-Adapter: Better Vision-Language Models with Feature Adapters"

Pipeline of CLIP-Adapter

CLIP-Adapter is a drop-in module designed for CLIP model on few-shot classfication tasks. CLIP-Adapter can improve the few-shot classfication of CLIP with very simple design.

Results of CLIP-Adapter compared with baseline

Comparison with CLIP, Linear-probe CLIP, CoOp on eleven few shot classfication tasks.

New version of CLIP-Adpter

Please check Training-free CLIP-Adapter.

Contributor

Shijie Geng, Renrui Zhang, Peng Gao

Acknowledegement

CLIP and CoOp

Code release to accompany paper "Geometry-Aware Gradient Algorithms for Neural Architecture Search."

Geometry-Aware Gradient Algorithms for Neural Architecture Search This repository contains the code required to run the experiments for the DARTS sear

18 May 27, 2022

This is the dataset and code release of the OpenRooms Dataset.

95 Jan 8, 2023

Code release of paper "Deep Multi-View Stereo gone wild"

Deep MVS gone wild Pytorch implementation of "Deep MVS gone wild" (Paper | website) This repository provides the code to reproduce the experiments of

53 Dec 24, 2022

Code release for DS-NeRF (Depth-supervised Neural Radiance Fields)

Depth-supervised NeRF: Fewer Views and Faster Training for Free Project | Paper | YouTube Pytorch implementation of our method for learning neural rad

524 Jan 8, 2023

Code release for BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images

BlockGAN Code release for BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images BlockGAN: Learning 3D Object-aware Scene Rep

41 May 18, 2022

Code Release for Learning to Adapt to Evolving Domains

EAML Code release for "Learning to Adapt to Evolving Domains" (NeurIPS 2020) Prerequisites PyTorch = 0.4.0 (with suitable CUDA and CuDNN version) tor

23 Dec 7, 2022

Code release for "Self-Tuning for Data-Efficient Deep Learning" (ICML 2021)

Self-Tuning for Data-Efficient Deep Learning This repository contains the implementation code for paper: Self-Tuning for Data-Efficient Deep Learning

101 Dec 11, 2022

Code release for our paper, "SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereo"

SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereo Thomas Kollar, Michael Laskey, Kevin Stone, Brijen Thananjeyan

68 Dec 14, 2022

Code release for The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification (TIP 2020)

The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification Code release for The Devil is in the Channels: Mutual-Channel

230 Dec 31, 2022

Comments

The problem of accuracy?
Thanks for your great job! When I run this code with COOP, I find the result of trained on oxford_flowers is great, => result => result

total: 2,463

correct: 2,332

accuracy: 94.7%

error: 5.3%

macro_f1: 94.6% Elapsed: 0:15:09 But if I run it again(as your code show, it will use the model I trained last time, which got good results), it gets a bad result as follows: => result

total: 2,463

correct: 24

accuracy: 1.0%

error: 99.0%

macro_f1: 0.1% Elapsed: 0:00:11 I am not sure why it produces a bad result， can you give me some advice.
opened by Zhangwenyao1 0
questions about text adapter

hello, you said in your paper that you use adapter in both visual and text stream, but in your code i just find the visual one, which one is correct? Thanks a lot.

opened by zhangbw21 1

Owner

peng gao

Young Scientist at Shanghai AI Lab

GitHub

Official code release for ICCV 2021 paper SNARF: Differentiable Forward Skinning for Animating Non-rigid Neural Implicit Shapes.

235 Dec 26, 2022

Official code release for "GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis"

GRAF This repository contains official code for the paper GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis. You can find detailed usage i

349 Dec 29, 2022

Official code release for "Learned Spatial Representations for Few-shot Talking-Head Synthesis" ICCV 2021

16 Oct 5, 2022

Official code release for: EditGAN: High-Precision Semantic Image Editing

565 Jan 5, 2023

Code release for NeX: Real-time View Synthesis with Neural Basis Expansion

NeX: Real-time View Synthesis with Neural Basis Expansion Project Page | Video | Paper | COLAB | Shiny Dataset We present NeX, a new approach to novel

536 Dec 20, 2022

The code release of paper 'Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization' NIPS 2020.

Domain Generalization for Medical Imaging Classification with Linear Dependency Regularization The code release of paper 'Domain Generalization for Me

56 Dec 28, 2022

Official Code Release for "CLIP-Adapter: Better Vision-Language Models with Feature Adapters"

Related tags

Overview

Official Code Release for "CLIP-Adapter: Better Vision-Language Models with Feature Adapters"

Pipeline of CLIP-Adapter

Results of CLIP-Adapter compared with baseline

New version of CLIP-Adpter

Contributor

Acknowledegement

You might also like...

Code release to accompany paper "Geometry-Aware Gradient Algorithms for Neural Architecture Search."

This is the dataset and code release of the OpenRooms Dataset.

Code release of paper "Deep Multi-View Stereo gone wild"

Code release for DS-NeRF (Depth-supervised Neural Radiance Fields)

Code release for BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images

Code Release for Learning to Adapt to Evolving Domains

Code release for "Self-Tuning for Data-Efficient Deep Learning" (ICML 2021)

Code release for our paper, "SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereo"

Code release for The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification (TIP 2020)

Comments

The problem of accuracy?

questions about text adapter

Owner

peng gao

Official code release for ICCV 2021 paper SNARF: Differentiable Forward Skinning for Animating Non-rigid Neural Implicit Shapes.

Official code release for "GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis"

Official code release for "Learned Spatial Representations for Few-shot Talking-Head Synthesis" ICCV 2021

Official code release for: EditGAN: High-Precision Semantic Image Editing

Code release for NeX: Real-time View Synthesis with Neural Basis Expansion

The code release of paper 'Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization' NIPS 2020.

Code release for "Transferable Semantic Augmentation for Domain Adaptation" (CVPR 2021)

Code release for "COTR: Correspondence Transformer for Matching Across Images"

Code release for paper: The Boombox: Visual Reconstruction from Acoustic Vibrations

We will release the code of "ConTNet: Why not use convolution and transformer at the same time?" in this repo