DroneCrowd
Paper Detection, Tracking, and Counting Meets Drones in Crowds: A Benchmark.
Introduction
This paper proposes a space-time multi-scale attention network (STANet) to solve density map estimation, localization and tracking in dense crowds of video clips captured by drones with arbitrary crowd density, perspective, and flight altitude. Our STANet method aggregates multi-scale feature maps in sequential frames to exploit the temporal coherency, and then predict the density maps, localize the targets, and associate them in crowds simultaneously. A coarse-to-fine process is designed to gradually apply the attention module on the aggregated multi-scale feature maps to enforce the network to exploit the discriminative space-time features for better performance. The whole network is trained in an end-to-end manner with the multi-task loss, formed by three terms, i.e., the density map loss, localization loss and association loss. The non-maximal suppression followed by the min-cost flow framework is used to generate the trajectories of targets' in scenarios. Since existing crowd counting datasets merely focus on crowd counting in static cameras rather than density map estimation, counting and tracking in crowds on drones, we have collected a new large-scale drone-based dataset, DroneCrowd, formed by 112 video clips with 33,600 high resolution frames (i.e., 1920x1080) captured in 70 different scenarios. With intensive amount of effort, our dataset provides 20,800 people trajectories with 4.8 million head annotations and several video-level attributes in sequences. Extensive experiments are conducted on two challenging public datasets, i.e., Shanghaitech and UCF-QNRF, and our DroneCrowd, to demonstrate that STANet achieves favorable performance against the state-of-the-arts.
Dataset
ECCV2020 Challenge
The VisDrone 2020 Crowd Counting Challenge requires participating algorithms to count persons in each frame. The challenge will provide 112 challenging sequences, including 82 video sequences for training (2,420 frames in total), and 30 sequences for testing (900 frames in total), which are available on the download page. We manually annotate persons with points in each video frame.
DroneCrowd (1.03 GB): BaiduYun(code: h0j8)| GoogleDrive
DroneCrowd (Full Version)
This full version consists of 112 video clips with 33,600 high resolution frames (i.e., 1920x1080) captured in 70 different scenarios. With intensive amount of effort, our dataset provides 20,800 people trajectories with 4.8 million head annotations and several video-level attributes in sequences.
DroneCrowd BaiduYun(code:ml1u)| GoogleDrive
Code
Space-Time Neighbor-Aware Network (STNNet-pytorch)
Space-Time Multi-Scale Attention Network (STANet-pytorch)
Citation
Please cite this paper if you want to use it in your work.
@inproceedings{dronecrowd_cvpr2021,
author = {Longyin Wen and
Dawei Du and
Pengfei Zhu and
Qinghua Hu and
Qilong Wang and
Liefeng Bo and
Siwei Lyu},
title = {Detection, Tracking, and Counting Meets Drones in Crowds: A Benchmark},
booktitle = {CVPR},
year = {2021}
}
41 Nov 23, 2022
3 Aug 8, 2021
8 May 22, 2022
112 Jan 2, 2023
253 Dec 18, 2022
2 Oct 12, 2022
15 Oct 14, 2022
109 Dec 28, 2022
443 Dec 6, 2022
194 Dec 28, 2022
1.3k Jan 8, 2023
113 Dec 27, 2022
546 Dec 5, 2022
498 Dec 30, 2022
0 Feb 9, 2022
6 Dec 31, 2022
439 Dec 22, 2022
13 Dec 10, 2022
62 Dec 21, 2022