Model · Image and text to text
Qwen
licensename: qwen-research licenselink: https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct/blob/main/LICENSE pipelinetag: image-text-to-text - multimodal libraryname: transformers In the past five months since Qwen2-VL’s release, numerous developers have built new models on the Qwen2-VL vision-language models, providing us with valuable feedback. During this period, we focused on building more useful vision-language models. Today, we are excited to introduce the latest addition to the Qwen family: Qwen2.5-VL. Understanding long videos and capturing events: Qwen2.5-VL can comprehend videos of over 1 hour, and this time it has a new ability of cpaturing event by pinpointing the relevant video…
Open weights
3.8B parameters
128,000 tokens
transformers
Nanonets-OCR2: A model for transforming documents into structured markdown with intelligent content recognition and semantic tagging Nanonets-OCR2 by Nanonets is a family of powerful, state-of-the-art image-to-markdown OCR models that go far beyond traditional text extraction. It transforms documents into structured markdown with intelligent content recognition and semantic tagging, making it ideal for downstream processing by Large Language Models (LLMs). Nanonets-OCR2 is packed with features designed to handle complex documents with ease: 1. Start the vLLM server. Check out Docstrange for more details. 1. Increasing the image resolution will improve model's performance. 2. For complex…
Open weights
3.8B parameters
128,000 tokens
transformers
SwiftVLN: training and evaluation code for these checkpoints. - SatNav: satellite-image navigation environments, datasets, and evaluation tools. This checkpoint is designed for SwiftVLN on SatNav, the continuous-state vision-and-language navigation benchmark over satellite imagery. It predicts short navigation-action sequences from an instruction, the current RGB window, and sampled visual memory. - swiftvln-satnav: SwiftVLN trained and evaluated on SatNav - 3b: Qwen2.5-VL 3B backbone - 1ep: trained for one epoch - f32s4: uses a 32-frame window and predicts four actions - overlap0: uses non-overlapping training windows - pf-h8: uses per-frame memory with up to eight history frames…
Open weights
3.8B parameters
128,000 tokens
transformers
BLIP-2 model, leveraging OPT-2.7b (a large language model with 2.7 billion parameters). It was introduced in the paper BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models by Li et al. and first released in this repository. Disclaimer: The team releasing BLIP-2 did not write a model card for this model so this model card has been written by the Hugging Face team. BLIP-2 consists of 3 models: a CLIP-like image encoder, a Querying Transformer (Q-Former) and a large language model. The authors initialize the weights of the image encoder and large language model from pre-trained checkpoints and keep them frozen while training the Querying…
Open weights
mit
3.7B parameters
transformers
BLIP-2 model, leveraging Flan T5-xl (a large language model). It was introduced in the paper BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models by Li et al. and first released in this repository. Disclaimer: The team releasing BLIP-2 did not write a model card for this model so this model card has been written by the Hugging Face team. BLIP-2 consists of 3 models: a CLIP-like image encoder, a Querying Transformer (Q-Former) and a large language model. The authors initialize the weights of the image encoder and large language model from pre-trained checkpoints and keep them frozen while training the Querying Transformer, which is a…
Open weights
mit
3.9B parameters
transformers
This model is Rex-Omni, a 3B-parameter Multimodal Large Language Model (MLLM) presented in the paper "Detect Anything via Next Point Prediction". It is compatible with the Hugging Face transformers library and is licensed under the IDEA License 1.0. src="https://img.shields.io/badge/RexOmni-Website-BADFDB?style=flat-square&logo=deno&logoColor=violet&color=BADFDB" alt="RexThinker Website" src="https://img.shields.io/badge/RexOmni-Paper-Red%25red?logo=arxiv&logoColor=red&color=yellow" alt="RexThinker Paper on arXiv" src="https://img.shields.io/badge/RexOmni-Weight-orange?logo=huggingface&logoColor=yellow" alt="RexThinker weight on Hugging Face"…
Open weights
other
4.1B parameters
128,000 tokens
transformers
