Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

gpt-oss-120b-blackhole-fast

by Jashan Pratap Singh jashansinghTT/gpt-oss-120b-blackhole-fast

gpt-oss-120b-blackhole-fast is an open-weight model for text generation from Jashan Pratap Singh, released under Apache License 2.0. Its published files total 1.3 GB.

gpt-oss-120b served with vLLM on four Blackhole chips (a QuietBox 2, P150x4, tensor parallel 4).

Parameters—
Context—
Weights1.3 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Jashan Pratap Singh, published under apache-2.0, revision 330bff85cc36.

gpt-oss-120b served with vLLM on four Blackhole chips (a QuietBox 2, P150x4, tensor parallel 4). A lone request decodes through a fused batch-1 decode: DRAM-streaming expert matmuls that read the 128 BFP4 experts in place (one ND-sharded copy shared with prefill and the batched decode), on-core top-4 routing over the 128 router logits, and all-reduces fused into the producing kernels. Batches of 2-32, prefill, prefix caching and requests that need penalties, log-probs, top-k > 32, logit bias or grammars run the batched paths. Status: round-2 release candidate (stage 14): measured on p150x4 against tt-hous/gpt-oss-120b-p150x4 on the same day: c=1 decode 3.8x, GSM8K-250 and IFEval-100 above…

Read Jashan Pratap Singh's full model card

Derived from openai/gpt-oss-120b. Weights revision b5c939de. This represents the model implementation on Tenstorrent hardware. See the original model card for license, training, and evaluation details.

gpt-oss-120b served with vLLM on four Blackhole chips (a QuietBox 2, P150x4, tensor parallel 4). A lone request decodes through a fused batch-1 decode: DRAM-streaming expert matmuls that read the 128 BFP4 experts in place (one ND-sharded copy shared with prefill and the batched decode), on-core top-4 routing over the 128 router logits, and all-reduces fused into the producing kernels. Batches of 2-32, prefill, prefix caching and requests that need penalties, log-probs, top-k > 32, logit bias or grammars run the batched paths.

Status: round-2 release candidate (stage 14): measured on p150x4 against tt-hous/gpt-oss-120b-p150x4 on the same day: c=1 decode 3.8x, GSM8K-250 and IFEval-100 above it.

Quickstart

tt-model pull jashansinghTT/gpt-oss-120b-blackhole-fast
tt-model serve jashansinghTT/gpt-oss-120b-blackhole-fast --profile p150x4
tt-model curl "What is the capital of France?"
tt-model stop jashansinghTT/gpt-oss-120b-blackhole-fast

Requests use the OpenAI API (/v1/chat/completions, /v1/completions, /v1/models); pass "model": "openai/gpt-oss-120b". The first boot converts the checkpoint into a ~75 GB tensor cache (about 15 minutes); later boots load it.

Profiles

Profile Hardware Description
p150x4 P150x4 Interactive: 8,192-token prefill chunks, 8 decode steps between prefill chunks
p150x4-throughput P150x4 Throughput: 32,768-token prefill chunks

Performance (same box, same client)

Baseline: the tt-hous/gpt-oss-120b-p150x4 package measured the same way on the same QuietBox 2. API rows use the vLLM benchmark client inside the serving container (128 output tokens, one run per row); the device step is a traced batch-1 decode replay. Both packages' API rows ran on a quiet host (1-minute load average below 3) on the same day. For reference, tt-lab's own gpt-oss-120b runtime (32 tiles over the same four chips, BFP8 experts) measured 6.54 ms/token at ISL 128 and 18.19 ms at ISL 4096 on this box (device command time).

Metric tt-hous/gpt-oss-120b-p150x4 gpt-oss-120b-blackhole-fast Unit
c=1 decode, ISL 128 (TPOT) 15.28 ms (65.4 tok/s/u) 4.06 ms (246.1 tok/s/u) API
c=1 TTFT, ISL 128 252 ms 248 ms API
c=1 decode, ISL 1024 (TPOT) 15.45 ms (64.7 tok/s/u) 4.20 ms (237.9 tok/s/u) API
c=1 TTFT, ISL 1024 400 ms 313 ms API
c=1 decode, ISL 4096 (TPOT) 15.64 ms (63.9 tok/s/u) 4.43 ms (225.6 tok/s/u) API
c=1 TTFT, ISL 4096 785 ms 738 ms API
c=8 output throughput, ISL 128 212 tok/s 211 tok/s API
c=32 output throughput, ISL 128 556 tok/s 562 tok/s API
Device decode step, batch 1, ISL 128 — 4.09 ms traced replay
Device decode step, batch 1, ISL 4096 — 4.40 ms traced replay

Accuracy

Teacher-forced against an HF fp32 reference of gpt-oss-120b (4 harmony prompts x 128 positions): top-1 93.95 % / top-5 99.80 % / PCC 0.9884 (mean of 2 runs) vs tt-hous/gpt-oss-120b-p150x4 92.58 % / 99.80 % / 0.9862.

Quality subsets (lm-eval through the served API, both packages on the same UTC day; tt-hous package at c=32, this package at c=1 so every decode step takes the fused batch-1 path): GSM8K (250, flexible) 87.6 % vs 86.8 %; IFEval (100, prompt-strict) 89.0 % vs 84.0 %. The gpt-oss chat template writes the current date into the system prompt, so runs on different days send different prompts: the day before, the same two packages scored GSM8K 89.2 % vs 88.8 % and IFEval 87.0 % vs 85.0 %. A 250-question subset moves by about 2 points between such runs.

Precision

Experts BFP4 (the same packing as tt-hous/gpt-oss-120b-p150x4), attention and LM head BFP8, KV cache BFP8; router BFP8 in the fused batch-1 decode and BF16 in the batched paths.

Limitations

  • Four chips only (P150x4): the 128 BFP4 experts take about 17 GB per chip.
  • The fused path serves batch 1 with on-device top-k sampling (k <= 32); other requests use the batched paths.

Provenance

  • Image tt-model/gpt-oss-120b-fast:42f539e33e0c = tt-model/gpt-oss-20b-fast:e5e84232a967 (TT-Metal runtime ee5703cefab, vLLM 2bbd2a6d9, plugin 30e9b8ea) with Python and kernel-source overlays at commit 42f539e33e0c.
  • Model code: the GPT-OSS autoport of tt-hous/gpt-oss-20b-p150 (Adam Housman) with a model-size switch (GPT_OSS_MODEL_SIZE=120b); fused decode derived from tenstorrent/tt-metal#60161 (Jerry Wang).

Identity and Version

Repository
jashansinghTT/gpt-oss-120b-blackhole-fast
Publisher
Jashan Pratap Singh
Task
Text generation
Modality
Text
Library
vllm
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
330bff85cc3649aee580941f49f70aa0f7e2c0fd
First published
2026-10-16
Last updated
2026-10-16

Files and Weights

143 files, 1.3 GB in total.

Configuration56 files · 1.1 MB
Documentation2 files · 10.0 KB
Other84 files · 1.3 GB
Repository1 file · 3.9 KB
Every file
FileTypeSizeSHA-256
STAGED.jsonConfiguration2.4 KB —
code/models/autoports/openai_gpt_oss_20b/__init__.pyConfiguration48 B —
code/models/autoports/openai_gpt_oss_20b/doc/datatype_sweep/selected_precision_config.jsonConfiguration1.4 KB —
code/models/autoports/openai_gpt_oss_20b/doc/datatype_sweep/selected_precision_config_120b.jsonConfiguration1.3 KB —
code/models/autoports/openai_gpt_oss_20b/tt/__init__.pyConfiguration83 B —
code/models/autoports/openai_gpt_oss_20b/tt/contract.pyConfiguration6.0 KB —
code/models/autoports/openai_gpt_oss_20b/tt/functional_decoder.pyConfiguration19.5 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/__init__.pyConfiguration1.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/boundary.pyConfiguration23.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/check_ilv.pyConfiguration8.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/check_nd.pyConfiguration10.9 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/check_ops.pyConfiguration13.0 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/check_tp1_boundary.pyConfiguration3.5 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/check_tp1_linear.pyConfiguration6.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/check_tp1_terminal.pyConfiguration4.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/config.pyConfiguration10.0 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/debug_attn.pyConfiguration11.3 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/debug_layers.pyConfiguration6.0 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/decoder.pyConfiguration31.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/ilv.pyConfiguration10.4 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/inputs.pyConfiguration4.7 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/nd.pyConfiguration18.0 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/sampling.pyConfiguration2.7 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/stream.pyConfiguration28.2 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/terminal.pyConfiguration31.3 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_decoder.pyConfiguration53.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/generator.pyConfiguration70.2 KB —
code/models/autoports/openai_gpt_oss_20b/tt/generator_vllm.pyConfiguration68.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/model.pyConfiguration65.7 KB —
code/models/autoports/openai_gpt_oss_20b/tt/multichip_decoder.pyConfiguration187.2 KB —
code/models/autoports/openai_gpt_oss_20b/tt/optimized_decoder.pyConfiguration46.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/precision.pyConfiguration15.7 KB —
code/models/autoports/openai_gpt_oss_20b/tt/sliding_ring.pyConfiguration1.7 KB —
code/models/common/sampling/tt_sampling.pyConfiguration59.0 KB —
code/models/demos/gpt_oss/tt/attention/operations.pyConfiguration13.4 KB —
code/models/demos/gpt_oss/tt/model.pyConfiguration68.2 KB —
code/models/tt_transformers/tt/generator.pyConfiguration167.5 KB —
code/packaging/gpt-oss-120b/entrypoint.pyConfiguration6.5 KB —
code/packaging/gpt-oss-120b/hub_entrypoint.pyConfiguration815 B —
code/packaging/gpt-oss-120b/tests/test_offline.pyConfiguration6.7 KB —
code/packaging/gpt-oss-120b/vllm_models/gpt-oss-120b/vllm_metadata.jsonConfiguration133 B —
evidence/code-sha256.jsonConfiguration101 B —
evidence/results/package2/big120/boot.jsonConfiguration414 B —
evidence/results/package2/big120/ladder_c1/summary.jsonConfiguration2.0 KB —
evidence/results/package2/big120/ladder_conc/summary.jsonConfiguration1.4 KB —
evidence/results/package2/big120/quality_gsm8k/summary.jsonConfiguration180 B —
evidence/results/package2/big120/quality_ifeval/summary.jsonConfiguration234 B —
evidence/results/package2/big120/smoke/smoke.jsonConfiguration4.3 KB —
evidence/results/package2/big120_base/ladder_c1/summary.jsonConfiguration2.0 KB —
evidence/results/package2/big120_base/ladder_conc/summary.jsonConfiguration1.4 KB —
evidence/results/package2/big120_base/quality_gsm8k/summary.jsonConfiguration185 B —
evidence/results/package2/big120_base/quality_ifeval/summary.jsonConfiguration239 B —
evidence/summary.big.jsonConfiguration3.9 KB —
image/index.jsonConfiguration383 B —
image/manifest.jsonConfiguration4.1 KB —
tt_kernel_manifest.jsonConfiguration7.8 KB —
README.mdDocumentation5.0 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/README.mdDocumentation5.0 KB —
SHA256SUMSOther10.7 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/boundary_compute.cppOther8.3 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/boundary_notify.cppOther1.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/boundary_reader.cppOther4.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/boundary_sender.cppOther5.5 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/boundary_to_rows.cppOther1.9 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/custom_mm_compat.hppOther1.4 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/decode_inputs.cppOther5.2 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/ilv_compute.cppOther7.9 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/ilv_reader.cppOther5.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/ilv_writer.cppOther4.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/nd_compute.cppOther8.4 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/nd_reader.cppOther4.6 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/nd_stream.hppOther4.0 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/nd_writer.cppOther9.7 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/router_topk.hppOther3.3 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/stream_down_reader.cppOther5.6 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/stream_down_writer.cppOther4.4 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/stream_gate_up_compute.cppOther5.2 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/stream_gate_up_reader.cppOther5.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/stream_gate_up_writer.cppOther4.0 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/stream_linear_reader.cppOther3.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/stream_linear_writer.cppOther11.7 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/stream_matmul_compute.cppOther1.8 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/terminal_exchange.cppOther7.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/terminal_merge.cppOther5.1 KB —
code/models/autoports/openai_gpt_oss_20b/tt/fused_b1/kernels/terminal_pick.cppOther2.8 KB —
image/blobs/sha256/00b6bb4555e3598bd082ca1c0d5fbecce2d697670ba372419b8e04305713fc34Other222 B —
image/blobs/sha256/03022d09674b0f1500cb747f8b12caf46a06354483747c575c0f8e4e2f18e620Other5.4 KB —
image/blobs/sha256/09726c458fb1fee5f32e4dd918a2da026965c57c3bd2a5ef4d6c89a3917249caOther29.7 KB —
image/blobs/sha256/106e23b8b41a0accbb267b143d9d00a6809a7099e8120758216582fa7603b2b8Other16.3 KB —
image/blobs/sha256/15c600b30690be90f120daa960e02e8cae3de9aa56074460717f186401590ba1Other18.7 MB 15c600b30690
image/blobs/sha256/1d23ad4342856b8725a2f7f5f5c8d45995f807cc629d3fe25a9d4c5e8b9fd7aaOther896.2 KB 1d23ad434285
image/blobs/sha256/1e8f45441bdb351c1c40cb4f6a2532ca7242a68234f00fb2f761fe75d62a016dOther4.6 KB —
image/blobs/sha256/20c3783cc497b5b0df1fc5f92bd64c3d2fbb24057c88692c8fda205b6ea8a2f2Other29.8 MB 20c3783cc497
image/blobs/sha256/228ac1a452d00d7002bc62ef56270b293aa6807eeac6a551cce70fe320edd6bbOther856 B —
image/blobs/sha256/238e33159fa813376f8ab3b4db9c37abf6681e22831bc1ae1e025f4eba1fcc63Other69.5 MB 238e33159fa8
image/blobs/sha256/27320c80414c38d6ef1ad5473ace6e8b8ead9622850350ae18216db230cf5a13Other4.4 KB —
image/blobs/sha256/361b108ce55cb2875645d9d64274e47dbe0088e300fd3ec38e77b8b6c19db357Other2.7 KB —
image/blobs/sha256/385d0a4ce9fd5a8ffeedba4edecd32c0e386f0e7bed795b0a9a6f056db97ab78Other618 B —
image/blobs/sha256/38c6f18b3c63b6f2799669c84a759963a41033af09e6658093a1c365002b810dOther37.2 MB 38c6f18b3c63
image/blobs/sha256/3c3f3464f419ad36a096f2515e29d0136598919a7636bd33f128bf3b07be1342Other564 B —
image/blobs/sha256/3c78527db6a1d28dc5c41bf21fd3580061c1dd634a038bb1c28dc9bdb18db3eaOther223 B —
image/blobs/sha256/3e912e1ca71fbd4d79cc8035b3119ae13a0158ff3df1780fa5970c5f4230cd1eOther672.3 MB 3e912e1ca71f
image/blobs/sha256/433532f88608ee987c522eb27e70771d43402f690b3dc5004f4c178f4b07990dOther67.1 KB —
image/blobs/sha256/4457353bad49b652d6060cee08a7735e4780780dd02b7b741af18bea61c7f805Other37.2 MB 4457353bad49
image/blobs/sha256/476a4648be04f7e99534bac6e0dd2bdb74aff8d8a9bc5df643f08e4fb28dce3eOther110.4 KB 476a4648be04
image/blobs/sha256/4cde77313eff2032fa8f57b5897bbdbce2c742943320fa9cdd526e50fb129d4aOther139.1 MB 4cde77313eff
image/blobs/sha256/4cf2c578099934df3e94c132658acb5e775ea1c3eb1e06d85274d692b9c5708bOther200.1 KB 4cf2c5780999
image/blobs/sha256/4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1Other32 B —
image/blobs/sha256/52b45c727143285d553ff6fd53da8f748596eb1d34092bc42000bccd325548bfOther57.9 MB 52b45c727143
image/blobs/sha256/55b1f7b5c7e918f16762cf5b3f1035a921344f96c0e8c330fe9a4345386f10abOther204.3 KB 55b1f7b5c7e9
image/blobs/sha256/782741d395a17aac5531b4a3deb1e205dc532a1bb54046700926a325f3f167d1Other1.3 KB —
image/blobs/sha256/78955b9407e3439ccd1afcf1ec87db51fad586cc7d23bfb184eae4016837f50cOther36.1 KB —
image/blobs/sha256/819443afd783ec3250c4c7e5bc93a1c35a4bf1ddcff02836ba7398c3bb6c0b8dOther1.6 MB 819443afd783
image/blobs/sha256/87ddbc0813f394bb6c1b4d54db6799f5787c3266c5f6dcfd83bbab6281215f36Other4.5 MB 87ddbc0813f3
image/blobs/sha256/8ca31ea85b2de4c8e40c6a90104f0f2a0208cfb9e568f10dd1f846516d8edea4Other304 B —
image/blobs/sha256/94a0a19c92209697b20d66b540c0a7affbd80cb927fa90e02b4f81b2c278762aOther138.9 MB 94a0a19c9220
image/blobs/sha256/9d2d95029f35dd217e4202ef1b04655ac1e2d9ff5b341d6a9f606e25da911e1aOther1.1 KB —
image/blobs/sha256/9f4210c20a06e1385847961d6ed706bd4866f191e7310b25cf4998230d3410d0Other36.1 KB —
image/blobs/sha256/a0b26682bce2cf3320c274905d208bac66de7d89d8aee01c19c8cb0207f44f03Other15.7 KB —
image/blobs/sha256/a18e17e5184c86df555740b1c9165f2ed9acd8b243c81b5cd3db5a9b10ca9979Other6.6 KB —
image/blobs/sha256/ab143c1e1e3850d0008eed0c3766924dfe6c03c79b3c7b235578c186640ac284Other229.7 KB ab143c1e1e38
image/blobs/sha256/ad98468488a82212095d841f28bdd12e078a69468f84dc00ac2a6618cf08a5dfOther642 B —
image/blobs/sha256/ba55df5a5bbca90381d47832b9fcc5ef2e1aacb1d5b04dc997549b51292236ccOther15.7 KB —
image/blobs/sha256/c21184fbcfd471c421e08219200e710fa0b29f03230cf263a9079a3ad01c6c5cOther4.6 KB —
image/blobs/sha256/c7fdf5f30af72eff0971b257ee0dbd5d32d26380de87d0901667bd5d6a84a25dOther9.6 KB —
image/blobs/sha256/ccb93205c32408664bc87fa7f250dac12c0d2c1fa21452beb2aab133a8694d2aOther9.6 MB ccb93205c324
image/blobs/sha256/cd5c1f275867a47861734f267a028621b133afa4eee0cd72b8a8d0e8bb37b893Other219.6 KB cd5c1f275867
image/blobs/sha256/cfba690fd35818e7cdbcca62f94f78128cf71256450ac80e6a6f4e6a09069d05Other1.5 KB —
image/blobs/sha256/d31ad8641e8f9a6629f99b47541d06e6707b4df621bc50ed414a0d2843e9041bOther4.6 KB —
image/blobs/sha256/d6b8a4847505f420cee245d1d5f64d9a5ba802a759b5cdab101a1007ab6f9f01Other3.9 KB —
image/blobs/sha256/dcaf812f65311bd5bb6bb48c3b4337d09d0ec9f80cc9c2a895579ae95f763b43Other29.4 MB dcaf812f6531
image/blobs/sha256/e400de07223518fad5b1b7f444f093c7a0a747fff4f1ce04a0aa3bed54a6c997Other67.1 KB —
image/blobs/sha256/e469e038766a39dc7c89c711a7dfdf9b1f9e85c4f88de74409810429da1895bfOther31.0 MB e469e038766a
image/blobs/sha256/eff6430e983607e581f7b4083843dfcd12f1a59f16186a6963561d609e1a1276Other117 B —
image/blobs/sha256/f13cefcd5965c2e1ebd5cf426429d30356684243c01698a5c2806eee40aa7015Other16.3 KB —
image/blobs/sha256/f5d0d5d89fa2833af68ddf1cb028e81651d910b06c8a557ece0fc7e37bea60d7Other15.7 KB —
image/blobs/sha256/f72ad127ec8f79ea74843cdec2f0bafda41f79c1c0236cc282a4cc290f67c466Other1.9 KB —
image/blobs/sha256/fa5e803cbb780910a555a5a9c6e7cbb9872d178f4b3f03b8f6c8d8363335d5f4Other16.3 KB —
image/blobs/sha256/fab5475a62cf0c82e04bd9b56e77b515ae242b0b76ddba66e85eb8a65442d54fOther36.1 KB —
image/blobs/sha256/faefa5cb8af28cdfdd55d5fd81b938eb6c482cfa9058c262398f094848e8dcb8Other167 B —
image/oci-layoutOther30 B —
requirements.lockOther3.6 KB —
.gitattributesRepository3.9 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download from Jashan Pratap Singh

Released by Jashan Pratap Singh through its official repository on Hugging Face. Read the license.

Built From

Questions About gpt-oss-120b-blackhole-fast

Can I use gpt-oss-120b-blackhole-fast commercially?

Yes. gpt-oss-120b-blackhole-fast is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers