This repository contains GGUF quantizations of Lythri-7B-A4B for use with llama.cpp and compatible apps. For model details, evaluation results and limitations, see the original model card. Search for Lythri/Lythri-7B-A4B-GGUF in the model browser. To use a specific quantization, append its type to the repository name, for example Lythri/Lythri-7B-A4B-GGUF:Q80. Lythri is built on Gemma 4 and is released under the Apache License 2.0.