Conditional DEtection TRansformer (DETR) model trained end-to-end on COCO 2017 object detection (118k annotated images). It was introduced in the paper Conditional DETR for Fast Training Convergence by Meng et al. and first released in this repository. The recently-developed DETR approach applies the transformer encoder and decoder architecture to object detection and achieves promising performance. In this paper, we handle the critical issue, slow training convergence, and present a conditional cross-attention mechanism for fast DETR training. Our approach is motivated by that the cross-attention in DETR relies highly on the content embeddings for localizing the four extremities and…
Open weights
apache-2.0
44M parameters
1,024 tokens
transformers
This model is fine-tuned version of microsoft/conditional-detr-resnet-50. You can find details of model in this github repo -> fashion-visual-search And you can find fashion image feature extractor model -> yainage90/fashion-image-feature-extractor This model was trained using a combination of two datasets: modanet and fashionpedia The labels are ['bag', 'bottom', 'dress', 'hat', 'shoes', 'outer', 'top'] In the 96th epoch out of total of 100 epochs, the best score was achieved with mAP 0.7542. Therefore, it is believed that there is a little room for performance improvement.
Open weights
mit
44M parameters
1,024 tokens
transformers
The RT-DETRv2 model was proposed in RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformer by Wenyu Lv, Yian Zhao, Qinyao Chang, Kui Huang, Guanzhong Wang, Yi Liu. RT-DETRv2 refines RT-DETR by introducing selective multi-scale feature extraction, a discrete sampling operator for broader deployment compatibility, and improved training strategies like dynamic data augmentation and scale-adaptive hyperparameters. These changes enhance flexibility and practicality while maintaining real-time performance. This model was contributed by @jadechoghari with the help of @cyrilvallez and @qubvel-hf This is RT-DETRv2 consistently outperforms its predecessor across all…
Open weights
apache-2.0
43M parameters
transformers
However, we observe that the speed and accuracy of YOLOs are negatively affected by the NMS. Recently, end-to-end Transformer-based detectors (DETRs) have provided an alternative to eliminating NMS. Nevertheless, the high computational cost limits their practicality and hinders them from fully exploiting the advantage of excluding NMS. In this paper, we propose the Real-Time DEtection TRansformer (RT-DETR), the first real-time end-to-end object detector to our best knowledge that addresses the above dilemma. We build RT-DETR in two steps, drawing on the advanced DETR: first we focus on maintaining accuracy while improving speed, followed by maintaining speed while improving accuracy.…
Open weights
apache-2.0
43M parameters
transformers
However, we observe that the speed and accuracy of YOLOs are negatively affected by the NMS. Recently, end-to-end Transformer-based detectors (DETRs) have provided an alternative to eliminating NMS. Nevertheless, the high computational cost limits their practicality and hinders them from fully exploiting the advantage of excluding NMS. In this paper, we propose the Real-Time DEtection TRansformer (RT-DETR), the first real-time end-to-end object detector to our best knowledge that addresses the above dilemma. We build RT-DETR in two steps, drawing on the advanced DETR: first we focus on maintaining accuracy while improving speed, followed by maintaining speed while improving accuracy.…
Open weights
apache-2.0
43M parameters
transformers
Two-class visible smoke/flame detector based on PekingU/rtdetrv2r50vd. Conservative historical/reference detector. On the retained independent FireViewer benchmark, COCO mAP50-95 is 0.3502. It remains useful as a reproducible comparator and lower-false-alarm operating reference; public availability does not mean current runtime promotion. Research, evaluation and permitted commercial inference under the checkpoint terms. This model does not determine geographic coordinates, hidden fire origin, a fire perimeter or an emergency decision. Outputs must retain scores/provenance and remain subject to human review. The upstream base model is Apache-2.0. FireViewer checkpoint terms are separate…
Open weights
other
43M parameters
transformers