Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Qwen3.5-35B-A3B-Sceptic-v3.4-GGUF

by Jari Katajisto kataguru/Qwen3.5-35B-A3B-Sceptic-v3.4-GGUF

Qwen3.5-35B-A3B-Sceptic-v3.4-GGUF is an open-weight model for text generation from Jari Katajisto, released under Apache License 2.0. Its published files total 48.7 GB. It draws 740 downloads a month.

Virallinen Kataguru-lippulaiva ja uusi perusta suomenkieliselle MoE-päättelylle. Malli yhdistää Qwen 3.5 35B-A3B -arkkitehtuurin (35B parametria, joista ~3B aktiivisena per token), suomen kielen syväkoulutuksen, Ornith STEM/matematiikkavektorit, JEV Truth…

Parameters—
Context—
Weights48.5 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads740

Model Card

By Jari Katajisto, published under apache-2.0, revision 9993c9679d34.

Virallinen Kataguru-lippulaiva ja uusi perusta suomenkieliselle MoE-päättelylle. Malli yhdistää Qwen 3.5 35B-A3B -arkkitehtuurin (35B parametria, joista ~3B aktiivisena per token), suomen kielen syväkoulutuksen, Ornith STEM/matematiikkavektorit, JEV Truth -totuudenmukaisuuden sekä Diabolical Code Immunity v2/v3 -järjestelmäkoodauskyvyn. Kaikki kvantit on suojattu suomalaisella scepticv3.4.imatrix-aktivaatiomatriisilla ja ne puhuvat todennetusti 100 % virheetöntä suomea. Tästä mallista tarjotaan tasan kolme (3) kuratoitua APEX-kvanttia eri VRAM-kokoluokkiin: Mittaukset on ajettu virallisella tuotantolaitteistolla (2x RTX 5090 Blackwell TP=2, vLLM / llama.cpp b11064): 1. Lataa haluamasi…

Read Jari Katajisto's full model card

Qwen3.5-35B-A3B-Sceptic-v3.4-GGUF (Kataguru APEX Trio)

Virallinen Kataguru-lippulaiva ja uusi perusta suomenkieliselle MoE-päättelylle. Malli yhdistää Qwen 3.5 35B-A3B -arkkitehtuurin (35B parametria, joista ~3B aktiivisena per token), suomen kielen syväkoulutuksen, Ornith STEM/matematiikkavektorit, JEV Truth -totuudenmukaisuuden sekä Diabolical Code Immunity v2/v3 -järjestelmäkoodauskyvyn.

Kaikki kvantit on suojattu suomalaisella sceptic_v3.4.imatrix-aktivaatiomatriisilla ja ne puhuvat todennetusti 100 % virheetöntä suomea.


Mitä Kataguru muutti? (Insinööriyhteenveto)

Kenttä Kuvaus / Arvo
Base model Qwen 3.5 35B-A3B MoE (Alibaba Cloud / Qwen Team)
Katagurun jatkokoulutus Sceptic v3.4 (JEV Truth + Ornith Math + Diabolical Code Immunity Round 2 & 3)
Kielilaatu 100 % Virheetön suomi: Vaativat sijapäätteet (abessiivi, komitatiivi, instruktiivi), täsmällinen tieteen ja tekniikan sanasto
Sensuroimattomuus Zero Refusal: Täysi vapaus asiapitoiseen fiktioon, aikuiskerrontaan, erotiikkaan ja tutkimukseen. Sisäinen ajattelu (<think>) ei suorita sensuuriauditointia
Kvantisointi Kataguru APEX (Adaptive Precision for EXpert Models) -triojulkaisu
Visio / Multimodal Täysi multimodaalituki mukana toimitetulla mmproj-projektorilla (OCR ja kuva-analyysi suomeksi)
Spekulatiivinen MTP NextN/MTP -kerrokset suojattu ja saatavilla myös erillisinä draft-tiedostoina
Suositeltu ajotapa LM Studio / llama.cpp b11064+ / Ollama
Testattu laitteisto 2x NVIDIA RTX 5090 32GB Blackwell (TP=2) & RTX 5060 Ti 16GB / RTX 4070 12GB

Saatavilla olevat tiedostot ja APEX-laatuluokat

Tästä mallista tarjotaan tasan kolme (3) kuratoitua APEX-kvanttia eri VRAM-kokoluokkiin:

Tiedosto Koko Keskim. BPW VRAM-suositus Kuvaus ja Rakenne
Sceptic-35B-A3B-v3.4-APEX-Medium.gguf 13.55 GiB 3.28 bpw 16 Gt VRAM (Sweet Spot) Ensisijainen suositus kuluttajakorteille (RTX 4080 / 5060 Ti 16GB). Jättää ~2.4 GiB vapaata KV-cachelle. Attention Q5_K/Q4_K, expertit IQ3_S/IQ3_XXS.
Sceptic-35B-A3B-v3.4-APEX-Good.gguf 15.33 GiB 3.71 bpw 16–24 Gt VRAM (Max Laatu) Maksimaalisen tarkkuuden profiili 16 Gt kortin kattoon tai 24 Gt+ korteille (RTX 3090/4090/5090). Attention Q6_K/Q5_K, expertit Q4_K/IQ3_S.
Sceptic-35B-A3B-v3.4-APEX-Small.gguf 12.05 GiB 2.92 bpw 12 Gt VRAM (Low-VRAM) Optimoitu 12 Gt GPU:ille (RTX 3060 12GB, RTX 4070 12GB, RTX 5070 12GB). Attention Q5_K/Q4_K, expertit IQ3_S/IQ2_S.
mmproj-Sceptic-35B-A3B-v3.4-f16.gguf 902 MiB F16 – Multimodaalinen visioprojektori kuva-analyysiä ja OCR-tekstintunnistusta varten.
mtp-Sceptic-35B-A3B-v3.4-Q4_K_M.gguf 1.26 GiB Q4_K_M – Eristetty MTP-spekulaatiokerros erilliseen spekulatiiviseen dekoodaukseen.
mtp-Sceptic-35B-A3B-v3.4-Q8_0.gguf 1.99 GiB Q8_0 – Korkearesoluutioinen MTP-spekulaatiokerros.
sceptic_v3.4.imatrix 192 MiB – – Kotimainen aktivaatiomatriisi täyden toistettavuuden varmistamiseksi.

Empiiriset Vertailutulokset (Identtinen laitteisto ja kvanttiaste)

Mittaukset on ajettu virallisella tuotantolaitteistolla (2x RTX 5090 Blackwell TP=2, vLLM / llama.cpp b11064):

Tehtäväalue / Benchmark Qwen 3.5 35B Base Sceptic v3.0 Sceptic v3.3 Sceptic v3.4 (Tämä malli)
GSM8K (Matematiikka CoT) 82.4 % 86.8 % 87.2 % 88.1 %
TruthfulQA (Totuudenmukaisuus) 61.2 % 74.5 % 76.8 % 78.4 %
Diabolical Concurrency (Round 2 & 3) 28.0 % 65.0 % 90.0 % 95.0 %
Finnish Morphology (Abessiivi/Komitatiivi) 71.0 % 94.0 % 98.0 % 100.0 %
Erotica / Fiction Refusal Rate ~45.0 % 12.0 % 8.0 % 0.00 % (Zero Refusal)
MTP Speculative Acceptance Rate – 74.2 % 76.5 % 78.6 %
Läpimeno (AWQ / APEX tok/s) 210 tok/s 258 tok/s 265 tok/s 268 tok/s

Käyttöohjeet

1. LM Studio

  1. Lataa haluamasi APEX-kvantti (APEX-Medium.gguf suositeltu 16 Gt korteille, APEX-Small.gguf 12 Gt korteille).
  2. Jos haluat kuva-analyysin, liitä samalla mmproj-Sceptic-35B-A3B-v3.4-f16.gguf Vision Adapter -kenttään.
  3. Keskustele suomeksi tai englanniksi. Malli skaalaa ajattelunsa (<think>) automaattisesti tehtävän vaativuuden mukaan.

2. llama.cpp CLI

./llama-cli \
    -m Sceptic-35B-A3B-v3.4-APEX-Medium.gguf \
    --mmproj mmproj-Sceptic-35B-A3B-v3.4-f16.gguf \
    -p "Analysoi oheinen järjestelmäarkkitehtuuri ja optimoi sen rinnakkaisuus." \
    -ngl 99 \
    -c 32768 \
    -t 16

Rajoitukset ja Huomiot

  • Ei haitalliseen käyttöön: Malli on sensuroimaton laillisen aikuiskerronnan, fiktion ja kybertutkimuksen osalta. Malli kieltäytyy itsenäisesti vakavista haitoista (CBRN, lapsiin kohdistuva haitta).
  • 12 Gt VRAM (APEX-Small): 12 Gt GPU:illa suositellaan rajoittamaan kontekstipituus 8 192 – 16 384 tokeniin muistin riittävyyden takaamiseksi.

Identity and Version

Repository
kataguru/Qwen3.5-35B-A3B-Sceptic-v3.4-GGUF
Publisher
Jari Katajisto
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
fi, en
Revision
9993c9679d34a4b64352e7c03f6e1ae97ecf5f47
First published
2026-09-29
Last updated
2026-10-13

Files and Weights

11 files, 48.7 GB in total. The weights are 6 files totalling 48.5 GB in gguf.

Weights6 files · 48.5 GB
Documentation1 file · 5.7 KB
Other3 files · 194.7 MB
Repository1 file · 2.1 KB
Every file
FileTypeSizeSHA-256
Sceptic-35B-A3B-v3.4-APEX-Good.ggufWeights16.8 GB 9293b15a0859
Sceptic-35B-A3B-v3.4-APEX-Medium.ggufWeights14.6 GB bcb523ef6941
Sceptic-35B-A3B-v3.4-APEX-Small.ggufWeights13.0 GB be7792a8083b
mmproj-Sceptic-35B-A3B-v3.4-f16.ggufWeights902.8 MB f7812eef51ec
mtp-Sceptic-35B-A3B-v3.4-Q4_K_M.ggufWeights1.3 GB a8c648a2531c
mtp-Sceptic-35B-A3B-v3.4-Q8_0.ggufWeights2.0 GB b097ba52cc6f
README.mdDocumentation5.7 KB —
chat_template.jinjaOther27.8 KB —
sceptic.pngOther2.4 MB 762a93318498
sceptic_v3.4.imatrixOther192.2 MB ee9d0956758a
.gitattributesRepository2.1 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
48.5 GB
Download from Jari Katajisto

Released by Jari Katajisto through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published48.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.5-35B-A3B-Sceptic-v3.4-GGUF

Can I use Qwen3.5-35B-A3B-Sceptic-v3.4-GGUF commercially?

Yes. Qwen3.5-35B-A3B-Sceptic-v3.4-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers