Deep Federated Learning for Autonomous Driving

Last update: Dec 1, 2022

Overview

FADNet: Deep Federated Learning for Autonomous Driving

Abstract

Autonomous driving is an active research topic in both academia and industry. However, most of the existing solutions focus on improving the accuracy by training learnable models with centralized large-scale data. Therefore, these methods do not take into account the user's privacy. In this paper, we present a new approach to learn autonomous driving policy while respecting privacy concerns. We propose a peer-to-peer Deep Federated Learning (DFL) approach to train deep architectures in a fully decentralized manner and remove the need for central orchestration. We design a new Federated Autonomous Driving network (FADNet) that can improve the model stability, ensure convergence, and handle imbalanced data distribution problems while is being trained with federated learning methods. Intensively experimental results on three datasets show that our approach with FADNet and DFL achieves superior accuracy compared with other recent methods. Furthermore, our approach can maintain privacy by not collecting user data to a central server.

Code & Data

Coming soon

You might also like...

[ICCV'21] NEAT: Neural Attention Fields for End-to-End Autonomous Driving

NEAT: Neural Attention Fields for End-to-End Autonomous Driving Paper | Supplementary | Video | Poster | Blog This repository is for the ICCV 2021 pap

254 Jan 2, 2023

Code repository for Semantic Terrain Classification for Off-Road Autonomous Driving

BEVNet Datasets Datasets should be put inside data/. For example, data/semantic_kitti_4class_100x100. Training BEVNet-S Example: cd experiments bash t

24 Dec 12, 2022

An unofficial personal implementation of UM-Adapt, specifically to tackle joint estimation of panoptic segmentation and depth prediction for autonomous driving datasets.

Semisupervised Multitask Learning This repository is an unofficial and slightly modified implementation of UM-Adapt[1] using PyTorch. This code primar

11 Nov 25, 2022

Unofficial PyTorch implementation of "RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving" (ECCV 2020)

RTM3D-PyTorch The PyTorch Implementation of the paper: RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving (ECCV 2020

271 Nov 29, 2022

GndNet: Fast ground plane estimation and point cloud segmentation for autonomous vehicles using deep neural networks.

GndNet: Fast Ground plane Estimation and Point Cloud Segmentation for Autonomous Vehicles. Authors: Anshul Paigwar, Ozgur Erkent, David Sierra Gonzale

114 Dec 29, 2022

An example project demonstrating how the Autonomous Learning Library can be used to build new reinforcement learning agents.

About This repository shows how Autonomous Learning Library can be used to build new reinforcement learning agents. In particular, it contains a model

5 Aug 30, 2022

FedJAX is a library for developing custom Federated Learning (FL) algorithms in JAX.

FedJAX: Federated learning with JAX What is FedJAX? FedJAX is a library for developing custom Federated Learning (FL) algorithms in JAX. FedJAX priori

208 Dec 14, 2022

An open framework for Federated Learning.

Welcome to Intel® Open Federated Learning Federated learning is a distributed machine learning approach that enables organizations to collaborate on m

397 Dec 27, 2022

Official code implementation for "Personalized Federated Learning using Hypernetworks"

Personalized Federated Learning using Hypernetworks This is an official implementation of Personalized Federated Learning using Hypernetworks paper. [

121 Dec 25, 2022

Comments

Some confusions about network structure

Hi, AIOZ AI! Thanks for your great work.

I'm a little confused about some of the snippets in the code.

According to Fig 3 in the paper, Feature 1, Feature 2 and Feature 3 are not the output of ResBlock1, ResBlock2 and ResBlock3 respectively. However, the code is implemented like this.

def forward(self, inputs):

 x1 = self.norm(inputs)
 x1 = self.conv1(x1)
 x1 = self.max_pool1(x1)

 x2 = self.res_block1(x1)
 x1 = self.conv2(x1)
 x3 = torch.add(x1, x2)

 x3_1 = x3.view(inputs.shape[0], -1)

 x4 = self.res_block2(x3)
 x3 = self.conv3(x3)
 x4 = torch.add(x3, x4)

 x4_1 = x4.view(inputs.shape[0], -1)

 x5 = self.res_block3(x4)
 x4 = self.conv4(x4)
 x5 = torch.add(x4, x5)

 x6 = x5.view(inputs.shape[0], -1)
 x6 = self.relu(x6)
 x6 = self.dropout(x6)

 return 0.7*self.fc(x6) + 0.1*x3_1.mean() + 0.1*x4_1.mean() + 0.1*x6.mean()

In this line of code("0.7self.fc(x6) + 0.1x3_1.mean() + 0.1x4_1.mean() + 0.1x6.mean()"), what is the basis for choosing the weights ?

opened by JackFroster 3

Owner

AIOZ AI

Research and Develop (R&D) proprietary AI & Deep technologies for intelligent video analytics, mobile robotics, smart city, and beyond.

GitHub

Federated Learning - Including common test models for federated learning, like CNN, Resnet18 and lstm, controlled by different parser

Federated_Learning ?? This projest include common test models for federated lear

10 Dec 11, 2022

Deep Federated Learning for Autonomous Driving

Related tags

Overview

FADNet: Deep Federated Learning for Autonomous Driving

Abstract

Code & Data

You might also like...

[ICCV'21] NEAT: Neural Attention Fields for End-to-End Autonomous Driving

Code repository for Semantic Terrain Classification for Off-Road Autonomous Driving

An unofficial personal implementation of UM-Adapt, specifically to tackle joint estimation of panoptic segmentation and depth prediction for autonomous driving datasets.

Unofficial PyTorch implementation of "RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving" (ECCV 2020)

GndNet: Fast ground plane estimation and point cloud segmentation for autonomous vehicles using deep neural networks.

An example project demonstrating how the Autonomous Learning Library can be used to build new reinforcement learning agents.

FedJAX is a library for developing custom Federated Learning (FL) algorithms in JAX.

An open framework for Federated Learning.

Official code implementation for "Personalized Federated Learning using Hypernetworks"

Comments

Some confusions about network structure

Owner

AIOZ AI

Federated Learning - Including common test models for federated learning, like CNN, Resnet18 and lstm, controlled by different parser

Self-Supervised Pillar Motion Learning for Autonomous Driving (CVPR 2021)

Graph Self-Attention Network for Learning Spatial-Temporal Interaction Representation in Autonomous Driving

Repository to run object detection on a model trained on an autonomous driving dataset.

Official Repo for Ground-aware Monocular 3D Object Detection for Autonomous Driving

RTS3D: Real-time Stereo 3D Detection from 4D Feature-Consistency Embedding Space for Autonomous Driving

[arXiv] What-If Motion Prediction for Autonomous Driving ❓🚗💨

[CVPR'21] Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving

One Million Scenes for Autonomous Driving