Downloads: Hugging Face — ShayonSarker/SmolVLM-500M-Instruct-Q4KM-GGUF · Source & build recipes: GitHub — model-SmolVLM-500M-Instruct-gguf · Base model: HuggingFaceTB/SmolVLM-500M-Instruct · Failed vision attempt: MM-GGUF The GGUF binaries are hosted on Hugging Face; this repository holds the reproducible conversion pipeline, calibration data, and checksums. Base: HuggingFaceTB/SmolVLM-500M-Instruct (Apache-2.0) · Quant: llama.cpp 0.4.1-dev · imatrix on 3000-line wikitext-2 (seed 42, 625 chunks, 4 threads) Scope correction: this repository holds the text tower only (291 tensors, llama arch — verified: image input is rejected). The SigLIP vision encoder and mmproj are NOT included, so this…
Open weights
apache-2.0
Downloads: Hugging Face — ShayonSarker/Qwen3-4B-Q4KM-GGUF · Source & build recipes: GitHub — model-qwen3-4b-q4-k-m-gguf · Base model: Qwen/Qwen3-4B The GGUF binaries are hosted on Hugging Face; this repository holds the reproducible conversion pipeline, calibration data, and checksums. Base: Qwen/Qwen3-4B (Apache-2.0) · Quant: llama.cpp 0.4.1-dev (60081bb) · imatrix on 3000-line wikitext-2 (seed 42, 618 chunks, 4 threads) The F16 row in the eval table below is a measurement reference, not a downloadable file. Gate was <5% — passed. Task evals not run: perplexity only, stated honestly. Files: smol-Q4KM.gguf, smol-Q80.gguf, imatrix.dat, calib.txt, REPRO.json, SHA256.txt. Full repro: see…
Open weights
apache-2.0
Downloads: Hugging Face — ShayonSarker/SmolLM3-3B-Q4KM-GGUF · Source & build recipes: GitHub — edge-smollm3-gguf · Base model: HuggingFaceTB/SmolLM3-3B-Base The GGUF binaries are hosted on Hugging Face; this repository holds the reproducible conversion pipeline, calibration data, and checksums. Base: HuggingFaceTB/SmolLM3-3B-Base (SmolLM3ForCausalLM, Apache-2.0) · Quant: llama.cpp 0.4.1-dev (c77ae69) · imatrix on 4000-line wikitext-2 (seed 42, 798 chunks, 4 threads) The F16 row in the eval table below is a measurement reference, not a downloadable file. Gate was <5% — passed. Task evals (ARC/HellaSwag) not run: perplexity only, stated honestly. Files: smol-Q4KM.gguf, smol-Q80.gguf…
Open weights
apache-2.0