auryn-v1-gguf is an open-weight model from Inferre. It has 40,960-token context. Its published files total 3.6 GB. It draws 167 downloads a month.
This model was finetuned and converted to GGUF format using Unsloth. - qwen3-4b.Q4KM.gguf An Ollama Modelfile is included for easy deployment. This was trained 2x faster with Unsloth
Model Card
This model was finetuned and converted to GGUF format using Unsloth. - qwen3-4b.Q4KM.gguf An Ollama Modelfile is included for easy deployment. This was trained 2x faster with Unsloth
Excerpt from the card by Inferre.
Configuration
- Architecture
- Qwen3ForCausalLM
- Context length (tokens)
- 40,960
- Layers
- 36
- Hidden size
- 2,560
- Feed-forward size
- 9,728
- Attention heads
- 32
- Key/value heads
- 8
- Head dimension
- 128
- Vocabulary size
- 151,936
- Stored precision
- float16
- Model type
- qwen3
Identity and Version
- Repository
- inferre/auryn-v1-gguf
- Publisher
- Inferre
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- da6698f2eab658434b14e25b28e5b9e3fb4294a3
- First published
- 2026-05-23
- Last updated
- 2026-09-25
Files and Weights
8 files, 3.6 GB in total. The weights are 2 files totalling 3.6 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| qwen3-1.7b.Q4_K_M.gguf | Weights | 1.1 GB | 5af3703fa13d |
| qwen3-4b.Q4_K_M.gguf | Weights | 2.5 GB | a01d7b616d7b |
| config.json | Configuration | 1.8 KB | — |
| flags.json | Configuration | 15 B | — |
| manifest.json | Configuration | 50 B | — |
| README.md | Documentation | 703 B | — |
| Modelfile | Other | 1.7 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 3.6 GB
Released by Inferre through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 3.6 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About auryn-v1-gguf
What is auryn-v1-gguf's context length?
40,960 tokens, from the maximum position embeddings in its published configuration.