Skip to page content
SAVRN
Search Plan a project

Open-weight model · Image and text to text

linne-oak-1-0

by Hert4 beyoru/linne-oak-1-0

linne-oak-1-0 is an open-weight model for image and text to text from Hert4, released under Apache License 2.0. It has 262,144-token context. Its published files total 39.8 KB.

linne-oak-1.0 is a 31B decision model. Give it a state (text, a document, JSON, a conversation or an agent trajectory) and a question with a set of options, and it returns one option together with a probability for every option, in a single forward pass.

Parameters—
Context262,144
Weights39.8 KB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Hert4, published under apache-2.0, revision 7a9411569edb.

linne-oak-1.0 is a 31B decision model. Give it a state (text, a document, JSON, a conversation or an agent trajectory) and a question with a set of options, and it returns one option together with a probability for every option, in a single forward pass. It is the larger sibling of linne-fern-1.0: linne-fern is a 27B causal model that also chats, linne-oak is a dedicated decision model. - Decision Index public score 63.94, measured with the official kit (edition 0.3, all 37 public benchmarks, 140,620 requests, complete). - Reads the whole prompt at once: the full-attention layers attend in both directions over the prompt (sliding-window layers keep their native behavior), so the decision…

Read Hert4's full model card

linne-oak-1.0 is a 31B decision model. Give it a state (text, a document, JSON, a conversation or an agent trajectory) and a question with a set of options, and it returns one option together with a probability for every option, in a single forward pass.

It is the larger sibling of linne-fern-1.0: linne-fern is a 27B causal model that also chats, linne-oak is a dedicated decision model.

Highlights

  • Decision Index public score 63.94, measured with the official kit (edition 0.3, all 37 public benchmarks, 140,620 requests, complete).
  • Reads the whole prompt at once: the full-attention layers attend in both directions over the prompt (sliding-window layers keep their native behavior), so the decision sees the state, the question and every option together.
  • Strong across the board: knowledge, language understanding, retrieval and classification, tools and automation.
  • Agent-safe: a strong step-level guard for agents with a low false-block rate.
  • Fast: one forward pass per decision; median 63 ms per request on one H200.

linne-oak-1.0 is a decision-only model. Because its full-attention layers are bidirectional, it does not generate text: use it to pick options and read probabilities, not as a chat model. For chat, use the base model or linne-fern-1.0.

Decision Index (public part, edition 0.3)

Chance-corrected skill, higher is better. linne rows measured by us with the official kit; the other rows are the public-part scores published on the leaderboard.

Model Overall Knowledge Language Retrieval Tools Arts
linne-oak-1.0 (31B) 63.94 54.3 66.6 69.1 78.5 45.1
linne-fern-1.0 (27B) 58.92 44.9 62.8 62.4 79.0 41.5
Perplexity Decider v1.1 (27B), leaderboard 62.25
Quyet-1.0-Large (31B), leaderboard 60.79

Only the public part (20% of the full leaderboard score) can be measured outside the leaderboard.

Usage

The prompt is one user message (chat template, thinking off): the state (compact JSON when not a string), a blank line, Question: <instructions>, one line <label>: <name> - <description> per option, and Answer with the letter of one option only. The answer is the softmax over the next-token logits of the option letters (with the model's final logit soft-capping), read at the last prompt position, with the full-attention layers bidirectional.

linne_engine.py (with nc_hook.py) in this repository implements exactly this, as a Decision Index engine and as a library:

import sys
from huggingface_hub import snapshot_download

path = snapshot_download("MISA-core/linne-oak-1-0")
sys.path.insert(0, path)
from linne_engine import LinneEngine

model = LinneEngine(model=path, device="cuda:0", noncausal=True)
result, _ = model(
    "My Stripe integration keeps failing. Please help ASAP.",
    {"team": {"type": "choice", "instructions": "Which team should handle this request?",
              "criteria": {"billing": "Charges and refunds", "technical_support": "Integration errors",
                           "sales": "Questions about buying a product"}}},
)
print(result["answers"]["team"])  # chosen option and a probability for every option

Run the Decision Index public suite:

PYTHONPATH=<path> python -m decision_index pipeline --engine linne_engine:LinneEngine \
  --option model=<path> --option device=cuda:0 --option noncausal=1 --out runs/linne-oak-1-0

BF16 weights are about 62 GB and fit one 80 GB GPU.

License

Apache 2.0, following the base model's license.

Configuration

Architecture
Gemma4ForConditionalGeneration
Context length (tokens)
262,144
Layers
60
Hidden size
5,376
Feed-forward size
21,504
Attention heads
32
Key/value heads
16
Head dimension
256
Vocabulary size
262,144
Sliding window (tokens)
1,024
Model type
gemma4

Identity and Version

Repository
beyoru/linne-oak-1-0
Publisher
Hert4
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
Not stated by the source
Languages
en, vi
Revision
7a9411569edbe18baa87904fdc42ab96d419e7cf
First published
2026-10-11
Last updated
2026-10-11

Files and Weights

7 files, 39.8 KB in total.

Configuration4 files · 15.5 KB
Documentation1 file · 4.0 KB
Other1 file · 18.7 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
config.jsonConfiguration4.6 KB —
generation_config.jsonConfiguration208 B —
linne_engine.pyConfiguration8.8 KB —
nc_hook.pyConfiguration1.9 KB —
README.mdDocumentation4.0 KB —
chat_template.jinjaOther18.7 KB —
.gitattributesRepository1.5 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download from Hert4

Released by Hert4 through its official repository on Hugging Face. Read the license.

Built From

Questions About linne-oak-1-0

Can I use linne-oak-1-0 commercially?

Yes. linne-oak-1-0 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is linne-oak-1-0's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Non-uniform GGUF quantizations of a 512-expert MoE, produced with GSQ and RCO, with a vision projector for multimodal use. This repository provides GGUF quantizations of Qwen3.8-Flash-Next at four sizes, together with the model's vision projector (mmproj) for multimodal use. In contrast to uniform quantization, which applies a single quantization type to all weight tensors, each model here assigns a separate quantization type to every tensor. The assignment is obtained by a gradient-based search that allocates precision according to per-tensor sensitivity, subject to a total size budget. The resulting files are standard GGUF and run unmodified in llama.cpp, Ollama, and LM Studio. A…

Open weights apache-2.0 gguf

Model · Image and text to text

Qwen3.8-27B-iMatrix-NVFP4-MTP-GGUF

Michał Piszczek

I built this quant because the ready-made FP4 file answered the wrong question. It was fast, but on my short WikiText-2 control it scored 6.4949 PPL. Plain Q40 scored 6.3798. The first higher-quality hybrid went too far the other way: good perplexity, 34.19 tok/s, and no comfortable room for 256K plus vision. This is the build that survived both gates. It is a 17.1 GB, 5.01 BPW mixed-precision GGUF of Qwen/Qwen3.8-27B. It keeps large, tolerant matrices in native NVFP4 and spends more bits on selected attention, Gated DeltaNet, and late FFN tensors. The trained MTP layer remains embedded in the same GGUF. This is not a fine-tune. I built the private calibration workload from 5,472 messages…

Open weights apache-2.0

Model · Image and text to text

Huihui-Qwen3.8-27B-abliterated-GGUF

Huihui.ai

This is an uncensored version of Qwen/Qwen3.8-27B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. The newly added Huihui-Qwen3.8-27B-abliterated-Underdog-Saluki series come from ConwayResearch/Underdog-Saluki-27B-1.0 and ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF. Only layers 22 to 52 (0-based indexing) have been ablated, while the other layers remain unablated. It may come with a small disclaimer warning. Due to ConwayResearch/Underdog-Saluki-27B-1.0 not providing an imatrix file, we will attempt to perform ablation by mixing the GGUF…

Open weights apache-2.0 transformers

Qwen3.8-27B uncensored by HauhauCS 0/465 Refusals. This is the Aggressive variant: direct answers, no refusal behavior, and minimal preamble on hard prompts. Every text GGUF preserves Qwen3.8's native NextN head, and this release adds HauhauCS FastMTP: a specific acceleration sidecar qualified across the complete quant lineup at maximum native context. Vision is included through the separate BF16 projector. No changes to datasets or intended capabilities. This release preserves Qwen3.8-27B's text, reasoning, agentic, image, and video capabilities while applying the HauhauCS Aggressive uncensoring profile. Pick Aggressive when you specifically want the model to get to the answer without…

Open weights apache-2.0

Model · Image and text to text

Qwen3.8-27B-GGUF

GGML Org

Run with https://llama.app - https://huggingface.co/Qwen/Qwen3.8-27B - https://huggingface.co/incoai/Qwen3.8-27B-DFlash2 - add info

Open weights apache-2.0

Model · Image and text to text

Tiel-Coder-35B-A3B-GGUF-MTP

Saga

Tiel is the fast coder of the arsenal. At 4-bit quantization and 23 GB it fixes real codebase issues at the rate (and speed, with the right GPU) of Opus 4.6 medium, while holding the best multi-turn conversation of any local model we have measured. It is also cheerfully bad at trivia. Pick it for work. Pick something else for exams. Where it sits against the other local builds Multi-turn conversation Reasoning and knowledge Where it stands. On 25 SWE-bench-Live problems Tiel fixes 12 — the same as Opus 4.6 (medium), four more than Ornith-1.5 itself, three more than Nail, and four more than Sonnet 5 (medium). Among models of its own class it is first; the ones ahead are dense 27Bs and Opus…

Open weights mit gguf