A small, unprofessional fine-tune of Qwen 2.5, made to have a slightly different personality. Based on huihui-ai/Qwen2.5-0.5B-Instruct-abliterated-v3.
Mochi prioritizes having multiple different variants of the base model for different purposes, always using 0.5B parameters. It is only made for fun, and has no actual use if you're looking for something powerful or coherent.
What changed from 1.0
- No system prompt required. The personality is now baked in by default. You can still pass a system prompt to adjust behavior, but the Mochi vibe works without one.
- Cleaner dataset. 868 examples, all without system prompts, so the model doesn't depend on one to behave correctly.
Known Issues
- Factual accuracy is degraded compared to the base model. At 0.5B, personality training trades off against factual recall.
- Identity responses. Asking "who are you" or "what are you" may return Qwen's default identity. This is a base model limitation at 0.5B.
Model Details
| Property |
Value |
| Base Model |
Qwen2.5-0.5B-Instruct (abliterated) |
| Parameters |
0.5B |
| Quantization |
Q4_K_M |
| Format |
GGUF |
| Language |
English |
| License |
Apache 2.0 |
Usage
llama.cpp
llama-cli -m Mochi1.5-Q4_K_M.gguf --jinja --ctx-size 2048
Ollama
FROM ./Mochi1.5-Q4_K_M.gguf
ollama create mochi -f Modelfile
ollama run mochi
Training
Fine-tuned with Unsloth using QLoRA on Kaggle (T4 GPU).
- 868 training examples
- 3 epochs
- Learning rate: 1e-4
Credits