ViuAI Sarus-500M is a 495-million parameter autoregressive Small Language Model (SLM) designed, trained from scratch, and aligned by ViuAI Research. Engineered for ultra-low latency edge devices and lightweight CPU/GPU deployment, Sarus-500M balances deep knowledge representation with minimal resource requirements (~944 MB model footprint). The official recommended production checkpoint is: You can run Sarus-500M locally in a few lines of code without requiring the heavy transformers package: Because Sarus-500M is a 500M SLM, setting proper sampling parameters prevents logit tail collisions: The dpo5kfinal.pt checkpoint was evaluated on the standard multi-domain benchmark: Sarus-500M is…
Open weights
apache-2.0
2,048 tokens
Viu-1.5B-MoE is a sovereign Indian Large Language Model featuring a 48-Layer Ultra-Deep Frontier Mixture of Experts (MoE) architecture designed for deep hierarchical reasoning, Indic multilingual fluency (Hindi, Hinglish, English), and high-speed on-device inference. 1. 48-Layer Ultra-Deep Reasoning: Deep hierarchical abstraction across 4 cognitive tiers (12 layers each: Token Mechanics $\rightarrow$ Multilingual Alignment $\rightarrow$ Domain Knowledge $\rightarrow$ Deep Deductive Logic). 2. Compressed Sparse Attention 2 (CSA2): DeepSeek-V4.1 style low-rank KV compression saving 80% KV-cache memory for long-context inference on consumer GPUs. 3. Manifold-Constrained Hyper-Connections…
Open weights
apache-2.0
Viu-1.5B-MoE is a sovereign Indian Large Language Model featuring a 48-Layer Ultra-Deep Frontier Mixture of Experts (MoE) architecture designed for deep hierarchical reasoning, Indic multilingual fluency (Hindi, Hinglish, English), and high-speed on-device inference. 1. 48-Layer Ultra-Deep Reasoning: Deep hierarchical abstraction across 4 cognitive tiers (12 layers each: Token Mechanics $\rightarrow$ Multilingual Alignment $\rightarrow$ Domain Knowledge $\rightarrow$ Deep Deductive Logic). 2. Compressed Sparse Attention 2 (CSA2): DeepSeek-V4.1 style low-rank KV compression saving 80% KV-cache memory for long-context inference on consumer GPUs. 3. Manifold-Constrained Hyper-Connections…
Open weights
apache-2.0
