Skip to page content
SAVRN
Search Plan a project

Independent publisher

Vaibhav Kailash Mangroliya

VaibhavKKM

I'm passionate about open-source AI, Large Language Models (LLMs), Small Language Models (SLMs), knowledge distillation, fine-tuning (LoRA/QLoRA), Retrieval-Augmented Generation (RAG), AI agents, and efficient on-device inference.

Models in Library1
Datasets in Library0
Models on Hugging Face1
Followers1

Compare the published evidence

This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.

Published tasks: Text generation.

Reported licenses: cc-by-nc-sa-4.0. Open a record to review its specific license and conditions.

Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.

Models

A fine-tuned Qwen/Qwen3-4B-Instruct-2507 that answers HPC questions: Slurm job scripts, GPUs, modules, storage, and access to EuroHPC systems and the European AI Factories. It works best with retrieved documentation excerpts in the prompt. This release is a full merged model (bf16 safetensors), built in four stages: 1. Logit distillation (round 12a). The student learns the full next-token distribution of Qwen3-Next-80B-A3B-Instruct (top-20 probabilities at every answer token) on 46,717 verified question–answer pairs. LoRA rank 32. Merged. 2. On-policy distillation from Qwen3-Next (round 12e). The stage-1 model answers the training questions itself; 14,514 of its own answers are scored token…

Open weights cc-by-nc-sa-4.0 4B parameters 262,144 tokens transformers