This model was finetuned and converted to GGUF format using Unsloth. - Llama-3.2-3B-Instruct.Q4KM.gguf An Ollama Modelfile is included for easy deployment. The model's BOS token behavior was adjusted for GGUF compatibility. This was trained 2x faster with Unsloth
Independent publisher
Mohammed Abdullah H Abdulaziz
dodgeqtr
Models in Library2
Datasets in Library0
Models on Hugging Face2
Followers—
Models
This model was finetuned and converted to GGUF format using Unsloth. - Meta-Llama-3.1-8B-Instruct.Q4KM.gguf An Ollama Modelfile is included for easy deployment. The model's BOS token behavior was adjusted for GGUF compatibility. This was trained 2x faster with Unsloth