Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

kinshield-bonsai-d24-w3200-r08-20260924

by Nguyễn Hồng Quân jacky-qualgo/kinshield-bonsai-d24-w3200-r08-20260924

kinshield-bonsai-d24-w3200-r08-20260924 is a model for text generation from Nguyễn Hồng Quân, released under Apache License 2.0 (access requested at publisher). Its published files total 2.4 GB.

Experimental NAS/pruning/full LoRA recovery artifact. Created using Bonsai by Prism ML. Derived from original SFT, revision 011ee6c8d05d49144fa5747bedf23e8904883564. - q1/base-Q10.gguf + q1/adapter-f16.gguf: 169895008 bytes combined.

Parameters—
Context—
Weights2.4 GB
Licenseapache-2.0
AccessAccess requested at publisher
Monthly Downloads—

Model Card

By Nguyễn Hồng Quân, published under apache-2.0, revision c40f2da520a1.

Experimental NAS/pruning/full LoRA recovery artifact. Created using Bonsai by Prism ML. Derived from original SFT, revision 011ee6c8d05d49144fa5747bedf23e8904883564. - q1/base-Q10.gguf + q1/adapter-f16.gguf: 169895008 bytes combined. Cap applies to this deployment pair, not this whole repository. - model/: matching pruned HF base and tokenizer, necessary for this adapter. Do not attach the adapter to the unpruned original base. - hfadapter/: final R08 LoRA weights; metadata/: pruning map, recipe, certificates and provenance. - contract/: original trained contract including recommendations. benchmark/: OOD comparison, recommendations ignored only in core-v1 scoring. One full epoch, 77,358…

Read Nguyễn Hồng Quân's full model card

Kinshield Bonsai d24-w3200 — v1.0.0-r08-20260924

Experimental NAS/pruning/full LoRA recovery artifact. Created using Bonsai by Prism ML. Derived from original SFT, revision 011ee6c8d05d49144fa5747bedf23e8904883564.

Contents and size

  • q1/base-Q1_0.gguf + q1/adapter-f16.gguf: 169895008 bytes combined. Cap applies to this deployment pair, not this whole repository.
  • model/: matching pruned HF base and tokenizer, necessary for this adapter. Do not attach the adapter to the unpruned original base.
  • hf_adapter/: final R08 LoRA weights; metadata/: pruning map, recipe, certificates and provenance.
  • contract/: original trained contract including recommendations. benchmark/: OOD comparison, recommendations ignored only in core-v1 scoring.

Recovery

One full epoch, 77,358 original train samples, 2,418 updates, effective batch32, 3,283,235 assistant tokens. LoRA recovery from R07 warm adapter; frozen child base. Not full-parameter finetuning. Train/dev/OOD separation preserved. Checkpoint, base unchanged, cold replay and Q1 certification PASS.

Verify and use

Download a pinned release tag or commit, then run python scripts/verify.py. Q1 requires the pinned PrismML llama.cpp fork/build in metadata/engine-materialization.json; generic llama.cpp compatibility is not asserted. Set LLAMA_SERVER to the matching server and run bash scripts/serve.sh. Supply contract/system_prompt.txt as system message and the expected SMS/evidence JSON as user message; greedy decoding, thinking disabled, context16384, max1024 output tokens.

HF loading (requires compatible Transformers/PEFT):

from pathlib import Path
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
root = Path('/path/to/downloaded/release')
base = AutoModelForCausalLM.from_pretrained(root / 'model', local_files_only=True)
model = PeftModel.from_pretrained(base, root / 'hf_adapter', local_files_only=True)
tokenizer = AutoTokenizer.from_pretrained(root / 'model', local_files_only=True)

Explicitly load the packaged base: adapter_config's original relative base path alone is not a portable auto-loader instruction.

Evaluation and limitations

See paired OOD core results. Each model: entity384 and scenario384 samples. Strict JSON/verdict/finding catalog validation; recommendations excluded symmetrically. Same raw generation under old contract, not a model retrained for a new two-field contract. D26 leads Findings F1; D24 leads observed verdict F1. SCAM support only36/24 per split. This release validates the pipeline; selection-dev/final winner audit remains incomplete. No raw training/evaluation examples or optimizer checkpoints are uploaded.

Original certificates record source paths as provenance; use metadata/checksums.json for portable package verification. Do not overwrite this release; changes require a new version/tag.

Identity and Version

Repository
jacky-qualgo/kinshield-bonsai-d24-w3200-r08-20260924
Publisher
Nguyễn Hồng Quân
Task
Text generation
Modality
Text
Library
peft
Parameters
Not stated by the source
Languages
vi, en
Revision
c40f2da520a1b14ab7b2ddcbcf4b9376c97fddf7
First published
2026-09-25
Last updated
2026-09-25

Files and Weights

40 files, 2.4 GB in total. The weights are 4 files totalling 2.4 GB in gguf, safetensors.

Weights4 files · 2.4 GB
Configuration20 files · 69.1 KB
Tokenizer4 files · 15.9 MB
Documentation3 files · 14.3 KB
Other8 files · 456.6 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
hf_adapter/adapter_model.safetensorsWeights11.0 MB —
model/model.safetensorsWeights2.2 GB —
q1/adapter-f16.ggufWeights11.0 MB —
q1/base-Q1_0.ggufWeights158.9 MB —
benchmark/core-comparison.jsonConfiguration5.5 KB —
benchmark/test_ood_entity-original.jsonConfiguration2.1 KB —
benchmark/test_ood_scenario-original.jsonConfiguration2.1 KB —
contract/output_schema.jsonConfiguration9.0 KB —
hf_adapter/adapter_config.jsonConfiguration1.0 KB —
metadata/checksums.jsonConfiguration5.3 KB —
metadata/cold-certificate.jsonConfiguration1.5 KB —
metadata/engine-materialization.jsonConfiguration5.5 KB —
metadata/materialization.jsonConfiguration2.3 KB —
metadata/provenance.jsonConfiguration6.5 KB —
metadata/pruning-map.jsonConfiguration6.7 KB —
metadata/q1-certificate.jsonConfiguration2.3 KB —
metadata/recovery.jsonConfiguration1.0 KB —
metadata/training-audit.jsonConfiguration1.1 KB —
metadata/training-recipe.jsonConfiguration12.3 KB —
model/added_tokens.jsonConfiguration707 B —
model/config.jsonConfiguration2.8 KB —
model/generation_config.jsonConfiguration313 B —
model/special_tokens_map.jsonConfiguration613 B —
scripts/verify.pyConfiguration345 B —
LICENSEDocumentation10.2 KB —
README.mdDocumentation3.1 KB —
benchmark/CORE_RESULTS_VI.mdDocumentation961 B —
NOTICE.txtOther416 B —
contract/catalogs/38_finding.jsonlOther146.2 KB —
contract/catalogs/39_recommendation.jsonlOther269.6 KB —
contract/catalogs/46_mention_type.jsonlOther8.5 KB —
contract/catalogs/47_mention_role.jsonlOther2.4 KB —
contract/system_prompt.txtOther24.8 KB —
model/chat_template.jinjaOther4.1 KB —
scripts/serve.shOther672 B —
.gitattributesRepository1.7 KB —
model/merges.txtTokenizer1.7 MB —
model/tokenizer.jsonTokenizer11.4 MB —
model/tokenizer_config.jsonTokenizer5.4 KB —
model/vocab.jsonTokenizer2.8 MB —

License and Download

License
apache-2.0
Access
Access requested at publisher
Download size
2.4 GB
Request access from Nguyễn Hồng Quân

Nguyễn Hồng Quân grants access through its official repository on Hugging Face. Read the license.

Memory Requirements

PrecisionWeights in memory
As published2.4 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About kinshield-bonsai-d24-w3200-r08-20260924

Can I use kinshield-bonsai-d24-w3200-r08-20260924 commercially?

Yes. kinshield-bonsai-d24-w3200-r08-20260924 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers