rhymeai-gemma-4-gguf is an open-weight model from Tyler Manring, released under Apache License 2.0. Its published files total 9.0 GB. It draws 153 downloads a month.
LoRA fine-tunes of Gemma 4 E2B-it and E4B-it for RhymeAI / Writers Block, a native songwriting app. Trained to follow the app's exact on-device prompt rewrites, single-word rewrites, and synonyms. Runs fully offline via llama.cpp.
Model Card
By Tyler Manring, published under apache-2.0, revision 6230860be9ea.
LoRA fine-tunes of Gemma 4 E2B-it and E4B-it for RhymeAI / Writers Block, a native songwriting app. Trained to follow the app's exact on-device prompt rewrites, single-word rewrites, and synonyms. Runs fully offline via llama.cpp. QLoRA (r=16, alpha=16, 2 epochs, lr 2e-4 cosine, effective batch 16, prompt-masked loss) on 4,947 synthetic examples generated from original seed lyrics and machine-verified for rhyme + format correctness before training (CMU-dictionary rhyme checking). No copyrighted lyrics and no user data. Trained with Unsloth on a Colab L4; merged and quantized with llama.cpp (llama-export-lora + llama-quantize, Q4KM). model\n), stop string.
Read Tyler Manring's full model card
RhymeAI Gemma 4 (E2B / E4B) — on-device lyric assistant models
LoRA fine-tunes of Gemma 4 E2B-it and E4B-it for RhymeAI / Writers Block, a native songwriting app. Trained to follow the app's exact on-device prompt format for four tasks: rhyme-constrained next-line suggestions, passage rewrites, single-word rewrites, and synonyms. Runs fully offline via llama.cpp.
Files
| File | Size | Use |
|---|---|---|
gemma-4-E2B-it-rhymeai-Q4_K_M.gguf |
3.2 GB | default phones (4–8 GB RAM) |
gemma-4-E4B-it-rhymeai-Q4_K_M.gguf |
5.0 GB | larger devices (10 GB+ RAM) |
gemma-4-E2B-it-rhymeai-lora-adapter-F16.gguf |
48 MB | LoRA adapter only |
gemma-4-E4B-it-rhymeai-lora-adapter-F16.gguf |
70 MB | LoRA adapter only |
Eval (app's 43-case harness, temp 0.8 / top-k 40 / top-p 0.95, ctx 2048)
| Task | E2B stock → tuned | E4B stock → tuned |
|---|---|---|
| Suggestions — format pass | 4% → 96% | 4% → 83% |
| Suggestions — rhyme hit | 60% → 92% | 82% → 84% |
| Passage rewrite — format | 0% → 100% | 33% → 83% |
| Single-word rewrite | 56% → 22% | 11% → 78% |
Training
QLoRA (r=16, alpha=16, 2 epochs, lr 2e-4 cosine, effective batch 16,
prompt-masked loss) on 4,947 synthetic examples generated from original
seed lyrics and machine-verified for rhyme + format correctness before
training (CMU-dictionary rhyme checking). No copyrighted lyrics and no
user data. Trained with Unsloth on a Colab L4; merged and quantized with
llama.cpp (llama-export-lora + llama-quantize, Q4_K_M).
Prompt format: raw Gemma turn markers (<start_of_turn>user\n... /
<start_of_turn>model\n), stop string <end_of_turn>.
Identity and Version
- Repository
- Shayde182/rhymeai-gemma-4-gguf
- Publisher
- Tyler Manring
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- on-device
- Revision
- 6230860be9eaa0574018b6df8739d532fa054266
- First published
- 2026-07-08
- Last updated
- 2026-10-07
Files and Weights
7 files, 9.0 GB in total. The weights are 5 files totalling 9.0 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| gemma-4-E2B-it-rhymeai-Q4_K_M.gguf | Weights | 3.4 GB | 4cfffebcb0b9 |
| gemma-4-E2B-it-rhymeai-lora-adapter-F16.gguf | Weights | 50.7 MB | 650afd8c3ba5 |
| gemma-4-E4B-it-rhymeai-Q4_K_M.gguf | Weights | 5.3 GB | 6d6b78906559 |
| gemma-4-E4B-it-rhymeai-lora-adapter-F16.gguf | Weights | 73.4 MB | aff04d96087e |
| gemma-4-E4B-it-rhymeai-v3-lora-adapter-F16.gguf | Weights | 73.4 MB | 87c5fc7eb9b5 |
| README.md | Documentation | 1.9 KB | — |
| .gitattributes | Repository | 1.9 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 9.0 GB
Released by Tyler Manring through its official repository on Hugging Face. Read the license.
Built From
- Derived from unsloth/gemma-4-E2B-it
- Quantized from unsloth/gemma-4-E2B-it
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 9.0 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About rhymeai-gemma-4-gguf
Can I use rhymeai-gemma-4-gguf commercially?
Yes. rhymeai-gemma-4-gguf is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.