Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

GLM-5.3-Flash-GGUF

by Unsloth AI unsloth/GLM-5.3-Flash-GGUF

GLM-5.3-Flash-GGUF is an open-weight model for text generation from Unsloth AI, released under MIT License. Its published files total 2.5 TB. It draws 976.3k downloads a month.

Join our WeChat or Discord community. Check out the GLM-5.3-Flash blog and GLM-5 Technical report. Use GLM-5.3-Flash API services on Z.ai API Platform. We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series.

Parameters—
Context—
Weights2.5 TB
Licensemit
AccessOpen weights
Monthly Downloads976.3k

Model Card

By Unsloth AI, published under mit, revision a38483c8cd5d.

Join our WeChat or Discord community. Check out the GLM-5.3-Flash blog and GLM-5 Technical report. Use GLM-5.3-Flash API services on Z.ai API Platform. We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters, it outperforms GLM-5.2 across benchmarks and real-world workloads at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks. GLM-5.3-Flash starts from a newly trained base model, with its architecture and training recipe redesigned around capability and efficiency. For the first time in the GLM series, we introduce a hybrid architecture combining sparse and linear…

Read Unsloth AI's full model card

Read our How to Run GLM-5.3-Flash Guide!

Unsloth Dynamic 3.0 achieves superior accuracy & outperforms other leading quants.

  • To run, please use our llama.cpp PR or use the Unsloth Desktop app.
  • You can now run GLM-5.3-Flash in our Unsloth Desktop UI.
  • See below for 1-bit GLM-5.3-Flash (Low) run inside of Unsloth Desktop:

GLM-5.3-Flash

Join ourWeChat or Discord community.
Check out the GLM-5.3-Flashblog and GLM-5 Technical report.
Use GLM-5.3-Flash API services onZ.ai API Platform.

Introduction

We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters, it outperforms GLM-5.2 across benchmarks and real-world workloads at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks.

GLM-5.3-Flash starts from a newly trained base model, with its architecture and training recipe redesigned around capability and efficiency. For the first time in the GLM series, we introduce a hybrid architecture combining sparse and linear attention, sharply reducing long-context serving costs while preserving precise long-context capabilities. The model also adopts Manifold-Constrained Hyper-Connections (mHC) to further improve scaling efficiency. Together with our latest 30T-token multimodal pre-training corpus, these changes enable GLM-5.3-Flash to deliver more intelligence with less compute.

Footnotes

  • HLE w/ tools (full set): We use sampling parameters of temperature=1.0 and top_p=0.95 for evaluation, with a maximum generation length of 163,840 tokens. The evaluation is conducted with a maximum context length of 300,000 tokens, using a context management strategy. We use GPT-5.6-luna (medium) as the judge model.
  • NL2Repo: We evaluated NL2Repo with temperature=1.0, top_p=1.0, and max_new_tokens=64k under 1M context. To prevent hacking, we use rule-based and a LLM-based judgement to prevent malicious behaviors (e.g., unauthorized pip or curl operations).
  • DeepSWE: We run DeepSWE using the mini-swe-agent harness with temperature=0.95, top_p=1.0, timeout=6h and 400K context.
  • Terminal-Bench 2.1: We evaluate in Claude Code 2.1.207 with temperature=1.0, top_p=1, max_new_tokens=65536 with 6h timeout.
  • Agent’s Last Exam:
  • Toolathlon Verified: We obtain all results via the official evaluation service and report pass@1 averaged over 3 independent runs.
  • AutomationBench: We evaluate on AutomationBench v1.0.6, incorporating the fix for the null-type handling issue introduced in PR #13.
  • GDPval-AA v2: Models are evaluated by Artificial Analysis.
  • BabyVision: We use temperature=1.0, top_p=0.95, and a maximum context length of 164K tokens. We resize the input images such that their shorter side is at least 1.5K pixels, consistent with other baselines.

Citation

If you find GLM-5.3-Flash useful in your research, please cite our technical report:

@misc{glm5team2026glm5vibecodingagentic,
      title={GLM-5: from Vibe Coding to Agentic Engineering},
      author={GLM-5-Team and : and Aohan Zeng and Xin Lv and Zhenyu Hou and Zhengxiao Du and Qinkai Zheng and Bin Chen and Da Yin and Chendi Ge and Chenghua Huang and Chengxing Xie and Chenzheng Zhu and Congfeng Yin and Cunxiang Wang and Gengzheng Pan and Hao Zeng and Haoke Zhang and Haoran Wang and Huilong Chen and Jiajie Zhang and Jian Jiao and Jiaqi Guo and Jingsen Wang and Jingzhao Du and Jinzhu Wu and Kedong Wang and Lei Li and Lin Fan and Lucen Zhong and Mingdao Liu and Mingming Zhao and Pengfan Du and Qian Dong and Rui Lu and Shuang-Li and Shulin Cao and Song Liu and Ting Jiang and Xiaodong Chen and Xiaohan Zhang and Xuancheng Huang and Xuezhen Dong and Yabo Xu and Yao Wei and Yifan An and Yilin Niu and Yitong Zhu and Yuanhao Wen and Yukuo Cen and Yushi Bai and Zhongpei Qiao and Zihan Wang and Zikang Wang and Zilin Zhu and Ziqiang Liu and Zixuan Li and Bojie Wang and Bosi Wen and Can Huang and Changpeng Cai and Chao Yu and Chen Li and Chengwei Hu and Chenhui Zhang and Dan Zhang and Daoyan Lin and Dayong Yang and Di Wang and Ding Ai and Erle Zhu and Fangzhou Yi and Feiyu Chen and Guohong Wen and Hailong Sun and Haisha Zhao and Haiyi Hu and Hanchen Zhang and Hanrui Liu and Hanyu Zhang and Hao Peng and Hao Tai and Haobo Zhang and He Liu and Hongwei Wang and Hongxi Yan and Hongyu Ge and Huan Liu and Huanpeng Chu and Jia'ni Zhao and Jiachen Wang and Jiajing Zhao and Jiamin Ren and Jiapeng Wang and Jiaxin Zhang and Jiayi Gui and Jiayue Zhao and Jijie Li and Jing An and Jing Li and Jingwei Yuan and Jinhua Du and Jinxin Liu and Junkai Zhi and Junwen Duan and Kaiyue Zhou and Kangjian Wei and Ke Wang and Keyun Luo and Laiqiang Zhang and Leigang Sha and Liang Xu and Lindong Wu and Lintao Ding and Lu Chen and Minghao Li and Nianyi Lin and Pan Ta and Qiang Zou and Rongjun Song and Ruiqi Yang and Shangqing Tu and Shangtong Yang and Shaoxiang Wu and Shengyan Zhang and Shijie Li and Shuang Li and Shuyi Fan and Wei Qin and Wei Tian and Weining Zhang and Wenbo Yu and Wenjie Liang and Xiang Kuang and Xiangmeng Cheng and Xiangyang Li and Xiaoquan Yan and Xiaowei Hu and Xiaoying Ling and Xing Fan and Xingye Xia and Xinyuan Zhang and Xinze Zhang and Xirui Pan and Xu Zou and Xunkai Zhang and Yadi Liu and Yandong Wu and Yanfu Li and Yidong Wang and Yifan Zhu and Yijun Tan and Yilin Zhou and Yiming Pan and Ying Zhang and Yinpei Su and Yipeng Geng and Yong Yan and Yonglin Tan and Yuean Bi and Yuhan Shen and Yuhao Yang and Yujiang Li and Yunan Liu and Yunqing Wang and Yuntao Li and Yurong Wu and Yutao Zhang and Yuxi Duan and Yuxuan Zhang and Zezhen Liu and Zhengtao Jiang and Zhenhe Yan and Zheyu Zhang and Zhixiang Wei and Zhuo Chen and Zhuoer Feng and Zijun Yao and Ziwei Chai and Ziyuan Wang and Zuzhou Zhang and Bin Xu and Minlie Huang and Hongning Wang and Juanzi Li and Yuxiao Dong and Jie Tang},
      year={2026},
      eprint={2602.15763},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2602.15763},
}

Identity and Version

Repository
unsloth/GLM-5.3-Flash-GGUF
Publisher
Unsloth AI
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
en, zh
Revision
a38483c8cd5df544f53d70fb281afe97369d5ab6
First published
2026-08-26
Last updated
2026-10-05

Files and Weights

87 files, 2.5 TB in total. The weights are 70 files totalling 2.5 TB in gguf.

Weights70 files · 2.5 TB
Documentation1 file · 8.4 KB
Other15 files · 2.9 GB
Repository1 file · 9.5 KB
Every file
FileTypeSizeSHA-256
BF16/GLM-5.3-Flash-BF16-00001-of-00014.ggufWeights9.4 MB 95a1129a1a92
BF16/GLM-5.3-Flash-BF16-00002-of-00014.ggufWeights48.2 GB 9cc585be5199
BF16/GLM-5.3-Flash-BF16-00003-of-00014.ggufWeights49.3 GB 2e2042b9ced1
BF16/GLM-5.3-Flash-BF16-00004-of-00014.ggufWeights49.3 GB 9ee483074b94
BF16/GLM-5.3-Flash-BF16-00005-of-00014.ggufWeights50.0 GB df779fcbd5c7
BF16/GLM-5.3-Flash-BF16-00006-of-00014.ggufWeights49.5 GB 06c35b31c602
BF16/GLM-5.3-Flash-BF16-00007-of-00014.ggufWeights49.3 GB 48d497ce1bbb
BF16/GLM-5.3-Flash-BF16-00008-of-00014.ggufWeights49.6 GB 219e96d774f8
BF16/GLM-5.3-Flash-BF16-00009-of-00014.ggufWeights49.3 GB 01deeaa4f6cd
BF16/GLM-5.3-Flash-BF16-00010-of-00014.ggufWeights49.3 GB 8ae81821be0c
BF16/GLM-5.3-Flash-BF16-00011-of-00014.ggufWeights49.6 GB bae93e277539
BF16/GLM-5.3-Flash-BF16-00012-of-00014.ggufWeights49.3 GB 4d3cb10c7daa
BF16/GLM-5.3-Flash-BF16-00013-of-00014.ggufWeights49.4 GB fbf5c3a84f5e
BF16/GLM-5.3-Flash-BF16-00014-of-00014.ggufWeights49.6 GB 15e05268e702
Q8_0/GLM-5.3-Flash-Q8_0-00001-of-00008.ggufWeights9.4 MB 5dc239a59cbd
Q8_0/GLM-5.3-Flash-Q8_0-00002-of-00008.ggufWeights49.7 GB 8aabbbc0a92c
Q8_0/GLM-5.3-Flash-Q8_0-00003-of-00008.ggufWeights49.8 GB 7b50941b404f
Q8_0/GLM-5.3-Flash-Q8_0-00004-of-00008.ggufWeights49.8 GB ff27fb4536d5
Q8_0/GLM-5.3-Flash-Q8_0-00005-of-00008.ggufWeights50.0 GB c088636854c5
Q8_0/GLM-5.3-Flash-Q8_0-00006-of-00008.ggufWeights49.8 GB 4bece55cb9e9
Q8_0/GLM-5.3-Flash-Q8_0-00007-of-00008.ggufWeights49.8 GB a9f792204b0b
Q8_0/GLM-5.3-Flash-Q8_0-00008-of-00008.ggufWeights42.0 GB a6cb6887c004
UD-IQ1_M/GLM-5.3-Flash-UD-IQ1_M-00001-of-00003.ggufWeights9.4 MB a3f31b5ba1ec
UD-IQ1_M/GLM-5.3-Flash-UD-IQ1_M-00002-of-00003.ggufWeights50.0 GB 6bcfc2210cce
UD-IQ1_M/GLM-5.3-Flash-UD-IQ1_M-00003-of-00003.ggufWeights47.6 GB 07e252723e98
UD-IQ1_S/GLM-5.3-Flash-UD-IQ1_S-00001-of-00003.ggufWeights9.4 MB 909a8a2dedb4
UD-IQ1_S/GLM-5.3-Flash-UD-IQ1_S-00002-of-00003.ggufWeights49.6 GB b99c4dd92960
UD-IQ1_S/GLM-5.3-Flash-UD-IQ1_S-00003-of-00003.ggufWeights43.5 GB 9bb0ff754968
UD-IQ2_XXS/GLM-5.3-Flash-UD-IQ2_XXS-00001-of-00004.ggufWeights9.4 MB 337870cefce5
UD-IQ2_XXS/GLM-5.3-Flash-UD-IQ2_XXS-00002-of-00004.ggufWeights49.9 GB d51a3d9ca050
UD-IQ2_XXS/GLM-5.3-Flash-UD-IQ2_XXS-00003-of-00004.ggufWeights49.2 GB 89180f13784d
UD-IQ2_XXS/GLM-5.3-Flash-UD-IQ2_XXS-00004-of-00004.ggufWeights2.7 GB 9e0ef47daa1f
UD-IQ3_XXS/GLM-5.3-Flash-UD-IQ3_XXS-00001-of-00004.ggufWeights9.4 MB 632f4fabe03e
UD-IQ3_XXS/GLM-5.3-Flash-UD-IQ3_XXS-00002-of-00004.ggufWeights49.3 GB a4dba331fe92
UD-IQ3_XXS/GLM-5.3-Flash-UD-IQ3_XXS-00003-of-00004.ggufWeights49.1 GB 5b728b5b263c
UD-IQ3_XXS/GLM-5.3-Flash-UD-IQ3_XXS-00004-of-00004.ggufWeights22.0 GB 4b6d16e0d138
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00001-of-00005.ggufWeights9.4 MB c2f3b6ab98d3
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00002-of-00005.ggufWeights50.0 GB 7d64cf039567
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00003-of-00005.ggufWeights49.6 GB 7c2c63c9c30f
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00004-of-00005.ggufWeights49.5 GB 06c90f191871
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00005-of-00005.ggufWeights7.7 GB 66ebf9ec85e0
UD-Q2_K_XL/GLM-5.3-Flash-UD-Q2_K_XL-00001-of-00004.ggufWeights9.4 MB 2f32eba33ebc
UD-Q2_K_XL/GLM-5.3-Flash-UD-Q2_K_XL-00002-of-00004.ggufWeights49.3 GB f4a9e1ab13d5
UD-Q2_K_XL/GLM-5.3-Flash-UD-Q2_K_XL-00003-of-00004.ggufWeights49.9 GB 330a8ad76c78
UD-Q2_K_XL/GLM-5.3-Flash-UD-Q2_K_XL-00004-of-00004.ggufWeights9.5 GB 5c294f42edc5
UD-Q3_K_XL/GLM-5.3-Flash-UD-Q3_K_XL-00001-of-00004.ggufWeights9.4 MB be89305a221c
UD-Q3_K_XL/GLM-5.3-Flash-UD-Q3_K_XL-00002-of-00004.ggufWeights49.6 GB 310b5bef056c
UD-Q3_K_XL/GLM-5.3-Flash-UD-Q3_K_XL-00003-of-00004.ggufWeights49.6 GB eacaab11505a
UD-Q3_K_XL/GLM-5.3-Flash-UD-Q3_K_XL-00004-of-00004.ggufWeights48.3 GB c650640c9f94
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.ggufWeights9.4 MB b59c030090f0
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00002-of-00006.ggufWeights49.2 GB d3ecb6ff3957
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00003-of-00006.ggufWeights50.0 GB 328073c004e7
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00004-of-00006.ggufWeights48.7 GB 6803ab7effa6
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00005-of-00006.ggufWeights49.0 GB 852f3df9dacd
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00006-of-00006.ggufWeights2.8 GB c6ba510fafc1
UD-Q5_K_XL/GLM-5.3-Flash-UD-Q5_K_XL-00001-of-00006.ggufWeights9.4 MB cb792ba9c8db
UD-Q5_K_XL/GLM-5.3-Flash-UD-Q5_K_XL-00002-of-00006.ggufWeights48.8 GB fd2a37a8d00a
UD-Q5_K_XL/GLM-5.3-Flash-UD-Q5_K_XL-00003-of-00006.ggufWeights48.6 GB 298edf5776b9
UD-Q5_K_XL/GLM-5.3-Flash-UD-Q5_K_XL-00004-of-00006.ggufWeights49.3 GB 97b097efd8c1
UD-Q5_K_XL/GLM-5.3-Flash-UD-Q5_K_XL-00005-of-00006.ggufWeights49.3 GB 17a5ef81a355
UD-Q5_K_XL/GLM-5.3-Flash-UD-Q5_K_XL-00006-of-00006.ggufWeights44.3 GB 47435d0287b2
UD-Q6_K_XL/GLM-5.3-Flash-UD-Q6_K_XL-00001-of-00007.ggufWeights9.4 MB 7d7bd899640a
UD-Q6_K_XL/GLM-5.3-Flash-UD-Q6_K_XL-00002-of-00007.ggufWeights49.4 GB c65caeffd822
UD-Q6_K_XL/GLM-5.3-Flash-UD-Q6_K_XL-00003-of-00007.ggufWeights48.1 GB 491f13fb641e
UD-Q6_K_XL/GLM-5.3-Flash-UD-Q6_K_XL-00004-of-00007.ggufWeights49.5 GB 1db71efa40ba
UD-Q6_K_XL/GLM-5.3-Flash-UD-Q6_K_XL-00005-of-00007.ggufWeights48.9 GB 41acb75b5105
UD-Q6_K_XL/GLM-5.3-Flash-UD-Q6_K_XL-00006-of-00007.ggufWeights49.1 GB 3f669d880bfc
UD-Q6_K_XL/GLM-5.3-Flash-UD-Q6_K_XL-00007-of-00007.ggufWeights46.8 GB 3623f4af825e
mmproj-BF16.ggufWeights1.2 GB 82b7adb44411
mmproj-F16.ggufWeights1.1 GB 922b809664d6
README.mdDocumentation8.4 KB —
Shard_Rewrite/GLM-5.3-Flash-BF16-00001-of-00014.gguf_fileOther9.4 MB 95a1129a1a92
Shard_Rewrite/GLM-5.3-Flash-Q8_0-00001-of-00008.gguf_fileOther9.4 MB 5dc239a59cbd
Shard_Rewrite/GLM-5.3-Flash-UD-IQ1_M-00001-of-00003.gguf_fileOther9.4 MB a3f31b5ba1ec
Shard_Rewrite/GLM-5.3-Flash-UD-IQ1_S-00001-of-00003.gguf_fileOther9.4 MB 909a8a2dedb4
Shard_Rewrite/GLM-5.3-Flash-UD-IQ2_XXS-00001-of-00004.gguf_fileOther9.4 MB 337870cefce5
Shard_Rewrite/GLM-5.3-Flash-UD-IQ3_XXS-00001-of-00004.gguf_fileOther9.4 MB 632f4fabe03e
Shard_Rewrite/GLM-5.3-Flash-UD-IQ4_XS-00001-of-00005.gguf_fileOther9.4 MB c2f3b6ab98d3
Shard_Rewrite/GLM-5.3-Flash-UD-Q2_K_XL-00001-of-00004.gguf_fileOther9.4 MB 2f32eba33ebc
Shard_Rewrite/GLM-5.3-Flash-UD-Q3_K_XL-00001-of-00004.gguf_fileOther9.4 MB be89305a221c
Shard_Rewrite/GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf_fileOther9.4 MB b59c030090f0
Shard_Rewrite/GLM-5.3-Flash-UD-Q5_K_XL-00001-of-00006.gguf_fileOther9.4 MB cb792ba9c8db
Shard_Rewrite/GLM-5.3-Flash-UD-Q6_K_XL-00001-of-00007.gguf_fileOther9.4 MB 7d7bd899640a
Shard_Rewrite/mmproj-BF16.gguf_fileOther1.2 GB 82b7adb44411
Shard_Rewrite/mmproj-F16.gguf_fileOther1.1 GB 922b809664d6
imatrix_unsloth.gguf_fileOther512.7 MB 27d2ef6b6be0
.gitattributesRepository9.5 KB —

License and Download

License
mit
Access
Open weights, no gate
Download size
2.5 TB
Download from Unsloth AI

Released by Unsloth AI through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published2.5 TB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About GLM-5.3-Flash-GGUF

Can I use GLM-5.3-Flash-GGUF commercially?

Yes. GLM-5.3-Flash-GGUF is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers