synthehicle
synthehicle copied to clipboard
[WACVW 2023] A massive synthetic dataset for 3D multi-target multi-camera tracking and segmentation.
Synthehicle
Synthehicle is a massive CARLA-based synthehic multi-vehicle multi-camera tracking dataset and includes ground truth for 2D detection and tracking, 3D detection and tracking, depth estimation, and semantic, instance and panoptic segmentation.
News (18/11/22)
- Synthehicle has been accepted to WACV Workshops 2023
- We have added the CARLA and evaluation scripts
- The evaluation server is ready!
Dataset
The 17 hour Synthehicle dataset consists of 64 scenes in four different weather conditions, 16 different camera setups, and 340 camera videos. It is freely available via the following download links provided here.
Evaluation
To evaluate on Synthehicle please refer to our wiki.
Generate Data
To generate your own data similar to Synthehicle please refer to our wiki.
Pretrained Models
We provide pretrained weights for 2D detection and vehicle re-identification:
Detection
We have used the YOLOX-x model from mmdetection.
Model | Trained on | Weights | Config | AP |
---|---|---|---|---|
YOLOX-x | All | download | download | 59.7% |
YOLOX-x | Day | download | download | 58.7% |
YOLOX-x | Dawn | download | download | 60.8% |
YOLOX-x | Rain | download | download | 56.8% |
YOLOX-x | Night | download | download | 50.6% |
The specialized models (day, dawn, rain, night) are provided for completeness. Results from our paper indicate that the model trained on all subsets performs best for all environmental setups.
Vehicle Re-Identification
We have used the fastreid ResNet-50 Model with IBN:
Model | Trained on | Weights | Config | mAP |
---|---|---|---|---|
fastreid | All | download | 47.8% | |
fastreid | Day | download | 59.8% | |
fastreid | Dawn | download | 47.57% | |
fastreid | Rain | download | 39.08% | |
fastreid | Night | download | 27.04% |
The specialized models (day, dawn, rain, night) are provided for completeness. Results from our paper indicate that the model trained on all subsets performs best for all environmental setups. We will provide a fast-reid config soon alongside a model class. The weights can be read into any fast-reid ResNet-50 model.
Tracking
In our paper, single-camera tracking has been performed using DeepSORT with the models above. Multi-camera tracking has been performed using ELECTRICITY.
Citation
If you use Synthehicle for your work, please cite:
@InProceedings{Herzog_2023_WACV,
author = {Herzog, Fabian and Chen, Junpeng and Teepe, Torben and Gilg, Johannes and H\"ormann, Stefan and Rigoll, Gerhard},
title = {Synthehicle: Multi-Vehicle Multi-Camera Tracking in Virtual Cities},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops},
month = {January},
year = {2023},
pages = {1-11}
}