SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Vinci-Piccolo-1.0-GGUF

by SimpleDirect simpledirect/Vinci-Piccolo-1.0-GGUF

Vinci-Piccolo-1.0-GGUF is an open-weight model for text generation from SimpleDirect, released under Apache License 2.0. Its published files total 9.2 GB. It draws 227 downloads a month.

GGUF (quantized) builds of Vinci Piccolo, for local inference with Ollama, LM Studio, and llama.cpp. For the full-precision weights, evals, and details, see simpledirect/Vinci-Piccolo-1.0. No GGUF file in this repository has been evaluated.

Parameters—
Context—
Weights9.2 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads227

Model Card

By SimpleDirect, published under apache-2.0, revision b5d8559d4652.

GGUF (quantized) builds of Vinci Piccolo, for local inference with Ollama, LM Studio, and llama.cpp. For the full-precision weights, evals, and details, see simpledirect/Vinci-Piccolo-1.0. No GGUF file in this repository has been evaluated. The benchmark figures on the full-precision card were measured on the unquantized bf16 weights, not on any file here. Quantization shifts scores, and with no per-tier measurement this card cannot say in which direction or by how much for any tier. This card therefore publishes no per-tier score, no quality ranking between the tiers, and no recommended tier. The file sizes and memory figures below are measured, and describe storage and memory cost only. A…

Read SimpleDirect's full model card

GGUF (quantized) builds of Vinci Piccolo, for local inference with Ollama, LM Studio, and llama.cpp. For the full-precision weights, evals, and details, see simpledirect/Vinci-Piccolo-1.0.

These files are not the measured artifact

No GGUF file in this repository has been evaluated. The benchmark figures on the full-precision card were measured on the unquantized bf16 weights, not on any file here. Quantization shifts scores, and with no per-tier measurement this card cannot say in which direction or by how much for any tier.

This card therefore publishes no per-tier score, no quality ranking between the tiers, and no recommended tier. The file sizes and memory figures below are measured, and describe storage and memory cost only. A file's presence in this repository is not a performance claim about that tier, and not a claim of parity with the full-precision weights.

Available variants

File Size Min RAM Notes
vinci-piccolo-1.0-20260629-Q6_K.gguf 3.46 GB 12 GB 6-bit K-quant
vinci-piccolo-1.0-20260629-Q5_K_M.gguf 3.07 GB 10 GB 5-bit K-quant, medium mixture
vinci-piccolo-1.0-20260629-Q4_K_M.gguf 2.71 GB 8 GB 4-bit K-quant, medium mixture

GPU: Q5_K_M and Q4_K_M run on 4 GB VRAM; Q6_K needs 6 GB. Mac M-series: Q5_K_M fits on 8 GB unified memory; Q6_K needs 16 GB.

Ollama

ollama run hf.co/simpledirect/Vinci-Piccolo-1.0-GGUF

llama.cpp

./llama-cli \
    -m vinci-piccolo-1.0-20260629-Q5_K_M.gguf \
    --ctx-size 262144 \
    --temp 0 \
    --chat-template qwen3

llama-server (OpenAI-compatible API)

./llama-server \
    -m vinci-piccolo-1.0-20260629-Q5_K_M.gguf \
    --ctx-size 262144 \
    --host 0.0.0.0 \
    --port 8080

Prompt format

Qwen / ChatML chat template. No system prompt required — character is trained into the weights. Pass enable_thinking=False when using the tokenizer directly to suppress <think> output.

Citation

@misc{simpledirect2026vinci,
  title        = {Vinci Piccolo 1.0},
  author       = {{SimpleDirect}},
  year         = {2026},
  howpublished = {\url{https://huggingface.co/simpledirect/Vinci-Piccolo-1.0}},
  note         = {Apache 2.0. Fine-tuned from Qwen/Qwen3.5-4B.},
}

Identity and Version

Repository
simpledirect/Vinci-Piccolo-1.0-GGUF
Publisher
SimpleDirect
Task
Text generation
Modality
Text
Library
gguf
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
b5d8559d4652b6694e3a96762cc07f20cdcbaec0
First published
2026-06-29
Last updated
2026-09-28

Files and Weights

7 files, 9.2 GB in total. The weights are 3 files totalling 9.2 GB in gguf.

Weights3 files · 9.2 GB
Documentation1 file · 2.9 KB
Other2 files · 8.9 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
vinci-piccolo-1.0-20260629-Q4_K_M.ggufWeights2.7 GB 8b26b7d90aa0
vinci-piccolo-1.0-20260629-Q5_K_M.ggufWeights3.1 GB 6a546e660a64
vinci-piccolo-1.0-20260629-Q6_K.ggufWeights3.5 GB c085a3d55b2e
README.mdDocumentation2.9 KB —
assets/vero-pixel.svgOther669 B —
assets/vinci-vero-header.svgOther8.2 KB —
.gitattributesRepository1.7 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
9.2 GB
Download from SimpleDirect

Released by SimpleDirect through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published9.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Vinci-Piccolo-1.0-GGUF

Can I use Vinci-Piccolo-1.0-GGUF commercially?

Yes. Vinci-Piccolo-1.0-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Fine-tune Qwen3 (14B) for free using our Google Colab notebook! - Read our Blog about Qwen3 support: unsloth.ai/blog/qwen3 - View the rest of our notebooks in our docs here. Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for…

Open weights apache-2.0 transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers