The merged model is also here as GGUF, with the template and settings Ollama needs, so this one line runs it: Or build it from the Modelfile after downloading arety-phone-gemma4-12b-Q4KM.gguf and Modelfile: The GGUF has the adapter merged in, so no separate LoRA file is needed. It covers the text model only; Gemma 4's image and audio inputs are not included. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019). - PEFT 0.21.0