However, we observe that the speed and accuracy of YOLOs are negatively affected by the NMS. Recently, end-to-end Transformer-based detectors (DETRs) have provided an alternative to eliminating NMS. Nevertheless, the high computational cost limits their practicality and hinders them from fully exploiting the advantage of excluding NMS. In this paper, we propose the Real-Time DEtection TRansformer (RT-DETR), the first real-time end-to-end object detector to our best knowledge that addresses the above dilemma. We build RT-DETR in two steps, drawing on the advanced DETR: first we focus on maintaining accuracy while improving speed, followed by maintaining speed while improving accuracy.…
The RT-DETRv2 model was proposed in RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformer by Wenyu Lv, Yian Zhao, Qinyao Chang, Kui Huang, Guanzhong Wang, Yi Liu.
Parameters20M
Context—
Weights80.9 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads589.5k
Runs On
What it takes to serve rtdetr_v2_r18vd (20M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.
SAVRN's Notes on rtdetr_v2_r18vd
Eighty-one megabytes is the whole download: five files, 20M parameters, safetensors only. This is Peking University's RT-DETRv2 detector on the R18 backbone, which added a discrete sampling operator for broader deployment compatibility. Our memory table rounds it to 0.0 GB at 16, 8 and 4-bit, so the accelerator gets chosen by how many image streams you push through it, not by fit. The cheapest Index entry is one MI300X at $1.85 an hour, and a detector this small justifies that card only when it shares it or saturates it.
Apache 2.0 with its express patent grant lets you ship it in a product, modify it and redistribute it, provided the license and notices travel along and you state significant changes. Two checks: it was trained on COCO, so that dataset sets the object classes it knows, and no evaluation figures are recorded here, so test it on your own footage first.
Model Card
By Peking University, published under apache-2.0, revision 5650961749fa.
RT-DETRv2
Overview
The RT-DETRv2 model was proposed in RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformer by Wenyu Lv, Yian Zhao, Qinyao Chang, Kui Huang, Guanzhong Wang, Yi Liu. RT-DETRv2 refines RT-DETR by introducing selective multi-scale feature extraction, a discrete sampling operator for broader deployment compatibility, and improved training strategies like dynamic data augmentation and scale-adaptive hyperparameters. These changes enhance flexibility and practicality while maintaining real-time performance.
This model was contributed by @jadechoghari with the help of @cyrilvallez and @qubvel-hf
This is
Performance
RT-DETRv2 consistently outperforms its predecessor across all model sizes while maintaining the same real-time speeds.
How to use
Configuration
- Architecture
- RtDetrV2ForObjectDetection
- Stored precision
- float32
- Model type
- rt_detr_v2
Identity and Version
- Repository
- PekingU/rtdetr_v2_r18vd
- Publisher
- Peking University
- Task
- Object detection
- Modality
- Image
- Library
- transformers
- Parameters
- 20M parameters
- Languages
- en
- Revision
- 5650961749fa93567c0d46fc7f43ea4f9e914107
- First published
- 2025-01-31
- Last updated
- 2025-02-06
Files and Weights
5 files, 80.9 MB in total. The weights are 1 file totalling 80.9 MB in safetensors.
Weights1 file · 80.9 MB
Configuration2 files · 5.9 KB
Documentation1 file · 3.5 KB
Repository1 file · 1.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 80.9 MB | d18309d0d7ea |
| config.json | Configuration | 5.4 KB | — |
| preprocessor_config.json | Configuration | 444 B | — |
| README.md | Documentation | 3.5 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 80.9 MB
Download from Peking University
Released by Peking University through its official repository on Hugging Face. Read the license.
Built From
- Described by arXiv:2407.17140
- Trained on (disclosed) coco
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 80.9 MB |
| 16-bit | 0.0 GB |
| 8-bit | 0.0 GB |
| 4-bit | 0.0 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About rtdetr_v2_r18vd
How much GPU memory does rtdetr_v2_r18vd need?
About 0 GB at 16-bit and 0 GB at 4-bit: the weights (20M parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run rtdetr_v2_r18vd on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use rtdetr_v2_r18vd commercially?
Yes. rtdetr_v2_r18vd is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
Similar Models
However, we observe that the speed and accuracy of YOLOs are negatively affected by the NMS. Recently, end-to-end Transformer-based detectors (DETRs) have provided an alternative to eliminating NMS. Nevertheless, the high computational cost limits their practicality and hinders them from fully exploiting the advantage of excluding NMS. In this paper, we propose the Real-Time DEtection TRansformer (RT-DETR), the first real-time end-to-end object detector to our best knowledge that addresses the above dilemma. We build RT-DETR in two steps, drawing on the advanced DETR: first we focus on maintaining accuracy while improving speed, followed by maintaining speed while improving accuracy.…
The D-FINE model was proposed in D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinement by Yansong Peng, Hebei Li, Peixi Wu, Yueyi Zhang, Xiaoyan Sun, Feng Wu This model was contributed by VladOS95-cyber with the help of @qubvel-hf This is the HF transformers implementation for D-FINE coco -> model trained on COCO obj365 -> model trained on Object365 obj2coco -> model trained on Object365 and then finetuned on COCO D-FINE, a powerful real-time object detector that achieves outstanding localization precision by redefining the bounding box regression task in DETR models. D-FINE comprises two key components: Fine-grained Distribution Refinement (FDR) and Global…
LW-DETR, a Light-Weight DEtection TRansformer model, is designed to be a real-time object detection alternative that outperforms conventional convolutional (YOLO-style) and earlier transformer-based (DETR) methods in terms of speed and accuracy trade-off. It was introduced in the paper LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection by Chen et al. and first released in this repository. Disclaimer: This model was originally contributed by stevenbucaille in transformers. LW-DETR is an end-to-end object detection model that uses a Vision Transformer (ViT) backbone as its encoder, a simple convolutional projector, and a shallow DETR decoder. The core philosophy is to leverage…
Table Transformer (DETR) model trained on PubTables1M. It was introduced in the paper PubTables-1M: Towards Comprehensive Table Extraction From Unstructured Documents by Smock et al. and first released in this repository. Disclaimer: The team releasing Table Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Table Transformer is equivalent to DETR, a Transformer-based object detection model. Note that the authors decided to use the "normalize before" setting of DETR, which means that layernorm is applied before self- and cross-attention. You can use the raw model for detecting tables in documents. See the documentation for…
Table Transformer (DETR) model trained on PubTables1M. It was introduced in the paper PubTables-1M: Towards Comprehensive Table Extraction From Unstructured Documents by Smock et al. and first released in this repository. Disclaimer: The team releasing Table Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Table Transformer is equivalent to DETR, a Transformer-based object detection model. Note that the authors decided to use the "normalize before" setting of DETR, which means that layernorm is applied before self- and cross-attention. You can use the raw model for detecting the structure (like rows, columns) in tables.…