SAVRN
Search Contact SAVRN

Organization

vLLM Semantic Router

llm-semantic-router

A programmable Mixture-of-Models router for heterogeneous LLM inference

Models in Library2
Datasets in Library0
Models on Hugging Face72
Followers172

Models

Model · Feature extraction

Vela-1.0-Omni-Nano

vLLM Semantic Router

Vela Omni Nano maps text, images, and speech into a shared embedding space for multimodal search, routing, and use a 0–100 scale; higher is better. All applicable models use the same examples and retrieval pools. N/A denotes a modality the text-only model does not support. Bold Vela scores improve on multi-modal-embed-small. Macro-F1 gives equal weight to every intent class (77 for Banking77 and 60 for MASSIVE), complementing the query-weighted accuracy; undefined class F1 is zero. Text evaluation uses fixed class prototypes: 3,080 Banking77 and 2,972 MASSIVE English queries. Vela Omni is adapted using training examples and intent labels from these two datasets; comparison models are…

Open weights apache-2.0 134M parameters pytorch

Model · Feature extraction

Vela-1.0-Omni-Mini

vLLM Semantic Router

Vela Omni Mini maps text, images, and speech into a shared embedding space for multimodal search, routing, and use a 0–100 scale; higher is better. All applicable models use the same examples and retrieval pools. N/A denotes a modality the text-only model does not support. Bold Vela scores improve on multi-modal-embed-large. Macro-F1 gives equal weight to every intent class (77 for Banking77 and 60 for MASSIVE), complementing the query-weighted accuracy; undefined class F1 is zero. Text evaluation uses fixed class prototypes: 3,080 Banking77 and 2,972 MASSIVE English queries. Vela Omni is adapted using training examples and intent labels from these two datasets; comparison models are…

Open weights apache-2.0 1B parameters pytorch