qwen3.8-27b-p150x8 is an open-weight model from Hyunggi Chang. Its published files total 2.0 GB.
Qwen/Qwen3.8-27B served on a Tenstorrent P150x8 (8 Blackhole chips, 8-way tensor parallel) through one vLLM with speculative decoding, lossless for greedy requests: by default a hybrid of the DFlash2 block drafter (1–4 users, contexts up to 12K) and the…
Model Card
Qwen/Qwen3.8-27B served on a Tenstorrent P150x8 (8 Blackhole chips, 8-way tensor parallel) through one vLLM with speculative decoding, lossless for greedy requests: by default a hybrid of the DFlash2 block drafter (1–4 users, contexts up to 12K) and the checkpoint's own MTP head (5–8 users, longer contexts); up to 32 concurrent users, full sampling support, 262K context. Single-user decode ~10 ms/token on natural text (12.5 ms on random tokens) and the fastest long-prompt first token on this hardware (1.1 s at 8K, 2.0 s at 16K, 4.0 s at 32K, 21 s at 131K). The low-concurrency / long-document sibling of the prefill/decode-disaggregated changh95/qwen3.8-27b-pd4x4-p150x8 and the eight-chip…
Excerpt from the card by Hyunggi Chang.
Identity and Version
- Repository
- changh95/qwen3.8-27b-p150x8
- Publisher
- Hyunggi Chang
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 8ad66c5772df755bba7ff3632c813f5011f1d502
- First published
- 2026-09-21
- Last updated
- 2026-09-30
Files and Weights
725 files, 2.0 GB in total.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| code/models/common/auto_compose.py | Configuration | 5.9 KB | — |
| code/models/common/device_utils.py | Configuration | 1.5 KB | — |
| code/models/common/distribute_as.py | Configuration | 4.9 KB | — |
| code/models/common/generation_utils.py | Configuration | 11.4 KB | — |
| code/models/common/helper_funcs.py | Configuration | 1.2 KB | — |
| code/models/common/lightweightmodule.py | Configuration | 405 B | — |
| code/models/common/llama_models.py | Configuration | 7.0 KB | — |
| code/models/common/llm_runtime/config.py | Configuration | 5.8 KB | — |
| code/models/common/llm_runtime/decode.py | Configuration | 40.2 KB | — |
| code/models/common/llm_runtime/execution.py | Configuration | 29.4 KB | — |
| code/models/common/llm_runtime/lane_group.py | Configuration | 36.0 KB | — |
| code/models/common/llm_runtime/output_reader.py | Configuration | 8.7 KB | — |
| code/models/common/llm_runtime/paged_kv_cache.py | Configuration | 16.7 KB | — |
| code/models/common/llm_runtime/prefill/config.py | Configuration | 12.0 KB | — |
| code/models/common/llm_runtime/prefill/inputs.py | Configuration | 14.0 KB | — |
| code/models/common/llm_runtime/prefill/plan.py | Configuration | 20.6 KB | — |
| code/models/common/llm_runtime/prefill/postprocess.py | Configuration | 12.9 KB | — |
| code/models/common/llm_runtime/prefill/result_collector.py | Configuration | 7.8 KB | — |
| code/models/common/llm_runtime/prefill/runtime.py | Configuration | 15.1 KB | — |
| code/models/common/llm_runtime/prefill/sampling_helpers.py | Configuration | 3.4 KB | — |
| code/models/common/llm_runtime/prefill/sequence_runner.py | Configuration | 5.5 KB | — |
| code/models/common/llm_runtime/prefill/signatures.py | Configuration | 5.9 KB | — |
| code/models/common/llm_runtime/prefill/trace.py | Configuration | 11.7 KB | — |
| code/models/common/llm_runtime/program_compiler.py | Configuration | 12.2 KB | — |
| code/models/common/llm_runtime/tensor_resources.py | Configuration | 3.5 KB | — |
| code/models/common/llm_runtime/trace_compiler.py | Configuration | 18.2 KB | — |
| code/models/common/llm_runtime/vllm_adapter.py | Configuration | 14.6 KB | — |
| code/models/common/llm_runtime/warmup.py | Configuration | 33.0 KB | — |
| code/models/common/metrics.py | Configuration | 20.3 KB | — |
| code/models/common/model_capabilities.py | Configuration | 3.2 KB | — |
| code/models/common/models/deepseek_r1_distill_qwen_14b/__init__.py | Configuration | 1.3 KB | — |
| code/models/common/models/deepseek_r1_distill_qwen_14b/executor.py | Configuration | 27.1 KB | — |
| code/models/common/models/deepseek_r1_distill_qwen_14b/generator.py | Configuration | 18.0 KB | — |
| code/models/common/models/deepseek_r1_distill_qwen_14b/hf_adaptor.py | Configuration | 13.0 KB | — |
| code/models/common/models/deepseek_r1_distill_qwen_14b/model.py | Configuration | 46.8 KB | — |
| code/models/common/models/deepseek_r1_distill_qwen_14b/weight_utils.py | Configuration | 8.8 KB | — |
| code/models/common/models/llama32_1b/__init__.py | Configuration | 785 B | — |
| code/models/common/models/llama32_1b/executor.py | Configuration | 26.6 KB | — |
| code/models/common/models/llama32_1b/generator.py | Configuration | 17.5 KB | — |
| code/models/common/models/llama32_1b/hf_adaptor.py | Configuration | 10.5 KB | — |
| code/models/common/models/llama32_1b/model.py | Configuration | 45.0 KB | — |
| code/models/common/models/llama32_1b/weight_utils.py | Configuration | 3.9 KB | — |
| code/models/common/models/llama32_3b/__init__.py | Configuration | 785 B | — |
| code/models/common/models/llama32_3b/executor.py | Configuration | 26.6 KB | — |
| code/models/common/models/llama32_3b/generator.py | Configuration | 17.5 KB | — |
| code/models/common/models/llama32_3b/hf_adaptor.py | Configuration | 10.6 KB | — |
| code/models/common/models/llama32_3b/model.py | Configuration | 44.6 KB | — |
| code/models/common/models/llama32_3b/weight_utils.py | Configuration | 7.0 KB | — |
| code/models/common/models/llama33_70b/__init__.py | Configuration | 1.6 KB | — |
| code/models/common/models/llama33_70b/executor.py | Configuration | 27.1 KB | — |
| code/models/common/models/llama33_70b/generator.py | Configuration | 18.8 KB | — |
| code/models/common/models/llama33_70b/hf_adaptor.py | Configuration | 11.5 KB | — |
| code/models/common/models/llama33_70b/model.py | Configuration | 45.8 KB | — |
| code/models/common/models/llama33_70b/weight_utils.py | Configuration | 7.0 KB | — |
| code/models/common/models/llama3_8b/executor.py | Configuration | 24.0 KB | — |
| code/models/common/models/llama3_8b/generator.py | Configuration | 17.5 KB | — |
| code/models/common/models/llama3_8b/hf_adaptor.py | Configuration | 19.5 KB | — |
| code/models/common/models/llama3_8b/model.py | Configuration | 69.4 KB | — |
| code/models/common/models/mistral_7b/__init__.py | Configuration | 1.2 KB | — |
| code/models/common/models/mistral_7b/executor.py | Configuration | 26.9 KB | — |
| code/models/common/models/mistral_7b/generator.py | Configuration | 17.7 KB | — |
| code/models/common/models/mistral_7b/hf_adaptor.py | Configuration | 12.8 KB | — |
| code/models/common/models/mistral_7b/model.py | Configuration | 38.4 KB | — |
| code/models/common/models/mistral_7b/weight_utils.py | Configuration | 7.1 KB | — |
| code/models/common/models/phi4/__init__.py | Configuration | 1.1 KB | — |
| code/models/common/models/phi4/executor.py | Configuration | 26.8 KB | — |
| code/models/common/models/phi4/generator.py | Configuration | 17.6 KB | — |
| code/models/common/models/phi4/hf_adaptor.py | Configuration | 12.6 KB | — |
| code/models/common/models/phi4/model.py | Configuration | 38.0 KB | — |
| code/models/common/models/phi4/weight_utils.py | Configuration | 9.2 KB | — |
| code/models/common/models/qwen25_72b/__init__.py | Configuration | 1.2 KB | — |
| code/models/common/models/qwen25_72b/executor.py | Configuration | 21.6 KB | — |
| code/models/common/models/qwen25_72b/generator.py | Configuration | 13.7 KB | — |
| code/models/common/models/qwen25_72b/hf_adaptor.py | Configuration | 13.4 KB | — |
| code/models/common/models/qwen25_72b/model.py | Configuration | 50.9 KB | — |
| code/models/common/models/qwen25_72b/weight_utils.py | Configuration | 9.0 KB | — |
| code/models/common/models/qwen25_72b/weights.py | Configuration | 383 B | — |
| code/models/common/models/qwen25_7b/__init__.py | Configuration | 923 B | — |
| code/models/common/models/qwen25_7b/executor.py | Configuration | 26.8 KB | — |
| code/models/common/models/qwen25_7b/generator.py | Configuration | 17.6 KB | — |
| code/models/common/models/qwen25_7b/hf_adaptor.py | Configuration | 11.1 KB | — |
| code/models/common/models/qwen25_7b/model.py | Configuration | 47.4 KB | — |
| code/models/common/models/qwen25_7b/weight_utils.py | Configuration | 8.6 KB | — |
| code/models/common/models/qwen25_coder_32b/__init__.py | Configuration | 1.6 KB | — |
| code/models/common/models/qwen25_coder_32b/demo.py | Configuration | 23.8 KB | — |
| code/models/common/models/qwen25_coder_32b/executor.py | Configuration | 23.9 KB | — |
| code/models/common/models/qwen25_coder_32b/generator.py | Configuration | 13.9 KB | — |
| code/models/common/models/qwen25_coder_32b/hf_adaptor.py | Configuration | 13.5 KB | — |
| code/models/common/models/qwen25_coder_32b/model.py | Configuration | 57.4 KB | — |
| code/models/common/models/qwen25_coder_32b/weight_utils.py | Configuration | 8.8 KB | — |
| code/models/common/models/qwen2_7b/__init__.py | Configuration | 895 B | — |
| code/models/common/models/qwen2_7b/executor.py | Configuration | 26.8 KB | — |
| code/models/common/models/qwen2_7b/generator.py | Configuration | 17.6 KB | — |
| code/models/common/models/qwen2_7b/hf_adaptor.py | Configuration | 11.1 KB | — |
| code/models/common/models/qwen2_7b/model.py | Configuration | 48.4 KB | — |
| code/models/common/models/qwen2_7b/weight_utils.py | Configuration | 8.6 KB | — |
| code/models/common/models/qwen3_32b/__init__.py | Configuration | 896 B | — |
| code/models/common/models/qwen3_32b/demo.py | Configuration | 23.7 KB | — |
| code/models/common/models/qwen3_32b/executor.py | Configuration | 24.1 KB | — |
| code/models/common/models/qwen3_32b/generator.py | Configuration | 13.7 KB | — |
| code/models/common/models/qwen3_32b/hf_adaptor.py | Configuration | 10.3 KB | — |
| code/models/common/models/qwen3_32b/model.py | Configuration | 52.4 KB | — |
| code/models/common/models/qwen3_32b/weight_utils.py | Configuration | 11.0 KB | — |
| code/models/common/modules/attention/attention_1d.py | Configuration | 112.8 KB | — |
| code/models/common/modules/embedding/embedding_1d.py | Configuration | 9.7 KB | — |
| code/models/common/modules/lazy_buffer.py | Configuration | 7.0 KB | — |
| code/models/common/modules/lazy_weight.py | Configuration | 13.5 KB | — |
| code/models/common/modules/lm_head/lm_head_1d.py | Configuration | 15.0 KB | — |
| code/models/common/modules/mlp/mlp_1d.py | Configuration | 44.3 KB | — |
| code/models/common/modules/mlp/mlp_2d.py | Configuration | 33.3 KB | — |
| code/models/common/modules/moe/configs/deepseek_ocr.yaml | Configuration | 934 B | — |
| code/models/common/modules/moe/configs/deepseek_v3.yaml | Configuration | 740 B | — |
| code/models/common/modules/moe/configs/deepseek_v3_single_glx.yaml | Configuration | 739 B | — |
| code/models/common/modules/moe/configs/deepseek_v4_flash.yaml | Configuration | 1.1 KB | — |
| code/models/common/modules/moe/configs/deepseek_v4_pro.yaml | Configuration | 1.1 KB | — |
| code/models/common/modules/moe/configs/gemma_4_26b.yaml | Configuration | 1.7 KB | — |
| code/models/common/modules/moe/configs/glm5.yaml | Configuration | 935 B | — |
| code/models/common/modules/moe/configs/glm_47.yaml | Configuration | 1.1 KB | — |
| code/models/common/modules/moe/configs/gpt_oss.yaml | Configuration | 1.2 KB | — |
| code/models/common/modules/moe/configs/kimi_k25.yaml | Configuration | 968 B | — |
| code/models/common/modules/moe/configs/ling_1t.yaml | Configuration | 834 B | — |
| code/models/common/modules/moe/configs/mistral_large_3.yaml | Configuration | 846 B | — |
| code/models/common/modules/moe/configs/qwen35_35b.yaml | Configuration | 814 B | — |
| code/models/common/modules/moe/configs/qwen35_397b.yaml | Configuration | 1.1 KB | — |
| code/models/common/modules/moe/configs/qwen3_235b.yaml | Configuration | 970 B | — |
| code/models/common/modules/moe/configs/qwen3_omni_talker.yaml | Configuration | 1.1 KB | — |
| code/models/common/modules/moe/configs/qwen3_omni_thinker.yaml | Configuration | 986 B | — |
| code/models/common/modules/moe/tt_moe_decode.py | Configuration | 47.0 KB | — |
| code/models/common/modules/moe/tt_moe_decode_config.py | Configuration | 35.4 KB | — |
| code/models/common/modules/moe/tt_moe_decode_config_schemas.py | Configuration | 4.1 KB | — |
| code/models/common/modules/moe/tt_moe_gate.py | Configuration | 49.3 KB | — |
| code/models/common/modules/moe/tt_moe_gate_config.py | Configuration | 5.2 KB | — |
| code/models/common/modules/rmsnorm/rmsnorm_1d.py | Configuration | 26.1 KB | — |
| code/models/common/modules/rmsnorm/rmsnorm_2d.py | Configuration | 18.7 KB | — |
| code/models/common/modules/rope/rope_1d.py | Configuration | 19.4 KB | — |
| code/models/common/modules/sampling/penalties_1d.py | Configuration | 24.2 KB | — |
| code/models/common/modules/sampling/sampling_1d.py | Configuration | 36.2 KB | — |
| code/models/common/modules/tt_ccl.py | Configuration | 6.9 KB | — |
| code/models/common/reference_rope.py | Configuration | 3.2 KB | — |
| code/models/common/rmsnorm.py | Configuration | 10.7 KB | — |
| code/models/common/sampling/__init__.py | Configuration | 941 B | — |
| code/models/common/sampling/_utils.py | Configuration | 1.3 KB | — |
| code/models/common/sampling/generator.py | Configuration | 50.2 KB | — |
| code/models/common/sampling/sampling_params.py | Configuration | 731 B | — |
| code/models/common/sampling/tt_log_probs.py | Configuration | 34.6 KB | — |
| code/models/common/sampling/tt_penalties.py | Configuration | 19.2 KB | — |
| code/models/common/sampling/tt_sampling.py | Configuration | 60.9 KB | — |
| code/models/common/sampling/vocab_padding.py | Configuration | 5.6 KB | — |
| code/models/common/tensor_utils.py | Configuration | 8.1 KB | — |
| code/models/common/tests/conftest.py | Configuration | 13.6 KB | — |
| code/models/common/tests/demos/cleanup_utils.py | Configuration | 3.1 KB | — |
| code/models/common/tests/demos/deepseek_r1_distill_qwen_14b/__init__.py | Configuration | 94 B | — |
| code/models/common/tests/demos/deepseek_r1_distill_qwen_14b/demo.py | Configuration | 63.2 KB | — |
| code/models/common/tests/demos/deepseek_r1_distill_qwen_14b/generate_book_refpt.py | Configuration | 6.0 KB | — |
| code/models/common/tests/demos/llama32_1b/__init__.py | Configuration | 91 B | — |
| code/models/common/tests/demos/llama32_1b/demo.py | Configuration | 52.8 KB | — |
| code/models/common/tests/demos/llama32_3b/__init__.py | Configuration | 91 B | — |
| code/models/common/tests/demos/llama32_3b/demo.py | Configuration | 53.2 KB | — |
| code/models/common/tests/demos/llama33_70b/__init__.py | Configuration | 91 B | — |
| code/models/common/tests/demos/llama33_70b/demo.py | Configuration | 44.6 KB | — |
| code/models/common/tests/demos/llama3_8b/demo.py | Configuration | 40.7 KB | — |
| code/models/common/tests/demos/llama3_8b/demo_utils.py | Configuration | 4.7 KB | — |
| code/models/common/tests/demos/llama3_8b/sample_prompts/input_data_questions_prefill_128.json | Configuration | 12.6 KB | — |
| code/models/common/tests/demos/mistral_7b/demo.py | Configuration | 54.8 KB | — |
| code/models/common/tests/demos/phi4/__init__.py | Configuration | 94 B | — |
| code/models/common/tests/demos/phi4/demo.py | Configuration | 58.9 KB | — |
| code/models/common/tests/demos/qwen25_72b/demo.py | Configuration | 58.2 KB | — |
| code/models/common/tests/demos/qwen25_72b/generate_controlled_refpt.py | Configuration | 6.9 KB | — |
| code/models/common/tests/demos/qwen25_7b/demo.py | Configuration | 65.1 KB | — |
| code/models/common/tests/demos/qwen25_coder_32b/demo.py | Configuration | 58.5 KB | — |
| code/models/common/tests/demos/qwen2_7b/__init__.py | Configuration | 91 B | — |
| code/models/common/tests/demos/qwen2_7b/demo.py | Configuration | 64.2 KB | — |
| code/models/common/tests/demos/qwen2_7b/generate_controlled_refpt.py | Configuration | 5.4 KB | — |
| code/models/common/tests/demos/qwen3_32b/demo.py | Configuration | 62.6 KB | — |
| code/models/common/tests/demos/run_helpers.py | Configuration | 30.6 KB | — |
| code/models/common/tests/demos/test_cleanup_utils.py | Configuration | 5.6 KB | — |
| code/models/common/tests/demos/test_run_helpers.py | Configuration | 14.6 KB | — |
| code/models/common/tests/host/test_metrics_pytorch_only.py | Configuration | 2.5 KB | — |
| code/models/common/tests/host/test_utility_functions_imports.py | Configuration | 1.3 KB | — |
| code/models/common/tests/llm_runtime/test_config.py | Configuration | 4.5 KB | — |
| code/models/common/tests/llm_runtime/test_decode_runtime.py | Configuration | 24.8 KB | — |
| code/models/common/tests/llm_runtime/test_execution.py | Configuration | 31.8 KB | — |
| code/models/common/tests/llm_runtime/test_executor_integration.py | Configuration | 58.5 KB | — |
| code/models/common/tests/llm_runtime/test_lane_group.py | Configuration | 34.7 KB | — |
| code/models/common/tests/llm_runtime/test_llama3_8b_integration.py | Configuration | 33.1 KB | — |
| code/models/common/tests/llm_runtime/test_llama3_8b_model_contract.py | Configuration | 12.6 KB | — |
| code/models/common/tests/llm_runtime/test_model_contract.py | Configuration | 36.1 KB | — |
| code/models/common/tests/llm_runtime/test_output_reader.py | Configuration | 7.1 KB | — |
| code/models/common/tests/llm_runtime/test_paged_kv_cache.py | Configuration | 14.3 KB | — |
| code/models/common/tests/llm_runtime/test_prefill_inputs.py | Configuration | 5.9 KB | — |
| code/models/common/tests/llm_runtime/test_prefill_runtime.py | Configuration | 102.0 KB | — |
| code/models/common/tests/llm_runtime/test_program_compiler.py | Configuration | 9.2 KB | — |
| code/models/common/tests/llm_runtime/test_tensor_resources.py | Configuration | 2.3 KB | — |
| code/models/common/tests/llm_runtime/test_trace_compiler.py | Configuration | 17.8 KB | — |
| code/models/common/tests/llm_runtime/test_vllm_adapter.py | Configuration | 31.4 KB | — |
| code/models/common/tests/llm_runtime/test_warmup.py | Configuration | 36.4 KB | — |
| code/models/common/tests/models/deepseek_r1_distill_qwen_14b/test_demo_contract.py | Configuration | 17.6 KB | — |
| code/models/common/tests/models/deepseek_r1_distill_qwen_14b/test_hf_adaptor.py | Configuration | 11.2 KB | — |
| code/models/common/tests/models/deepseek_r1_distill_qwen_14b/test_prefill_last_token_contract.py | Configuration | 2.5 KB | — |
| code/models/common/tests/models/llama32_1b/test_batched_prefill_postprocess.py | Configuration | 3.3 KB | — |
| code/models/common/tests/models/llama32_1b/test_demo_warmup.py | Configuration | 5.2 KB | — |
| code/models/common/tests/models/llama32_1b/test_hf_adaptor.py | Configuration | 10.0 KB | — |
| code/models/common/tests/models/llama32_3b/test_batched_prefill_postprocess.py | Configuration | 3.3 KB | — |
| code/models/common/tests/models/llama32_3b/test_demo_warmup.py | Configuration | 8.3 KB | — |
| code/models/common/tests/models/llama32_3b/test_hf_adaptor.py | Configuration | 11.8 KB | — |
| code/models/common/tests/models/llama33_70b/logits_oracle.py | Configuration | 5.9 KB | — |
| code/models/common/tests/models/llama33_70b/test_demo_contract.py | Configuration | 5.9 KB | — |
| code/models/common/tests/models/llama33_70b/test_hf_adaptor.py | Configuration | 11.4 KB | — |
| code/models/common/tests/models/llama33_70b/test_logits_oracle.py | Configuration | 3.2 KB | — |
| code/models/common/tests/models/llama33_70b/test_t3k_batched_prefill_correctness.py | Configuration | 28.5 KB | — |
| code/models/common/tests/models/mistral_7b/test_demo_contract.py | Configuration | 10.0 KB | — |
| code/models/common/tests/models/mistral_7b/test_hf_adaptor.py | Configuration | 6.4 KB | — |
| code/models/common/tests/models/mistral_7b/test_prefill_last_token_contract.py | Configuration | 2.3 KB | — |
| code/models/common/tests/models/phi4/test_demo_contract.py | Configuration | 14.9 KB | — |
| code/models/common/tests/models/phi4/test_hf_adaptor.py | Configuration | 7.5 KB | — |
| code/models/common/tests/models/qwen25_72b/test_demo_contract.py | Configuration | 5.5 KB | — |
| code/models/common/tests/models/qwen25_72b/test_hf_adaptor.py | Configuration | 6.9 KB | — |
| code/models/common/tests/models/qwen25_72b/test_model_runtime_surface.py | Configuration | 5.2 KB | — |
| code/models/common/tests/models/qwen25_7b/test_demo_contract.py | Configuration | 16.2 KB | — |
| code/models/common/tests/models/qwen25_7b/test_hf_adaptor.py | Configuration | 10.2 KB | — |
| code/models/common/tests/models/qwen25_coder_32b/test_demo_contract.py | Configuration | 4.4 KB | — |
| code/models/common/tests/models/qwen25_coder_32b/test_hf_adaptor.py | Configuration | 7.0 KB | — |
| code/models/common/tests/models/qwen25_coder_32b/test_model_runtime_surface.py | Configuration | 5.2 KB | — |
| code/models/common/tests/models/qwen2_7b/test_demo_contract.py | Configuration | 16.1 KB | — |
| code/models/common/tests/models/qwen2_7b/test_hf_adaptor.py | Configuration | 10.1 KB | — |
| code/models/common/tests/models/qwen3_32b/test_demo_contract.py | Configuration | 5.6 KB | — |
| code/models/common/tests/models/qwen3_32b/test_hf_adaptor.py | Configuration | 4.4 KB | — |
| code/models/common/tests/models/qwen3_32b/test_model_runtime_surface.py | Configuration | 5.2 KB | — |
| code/models/common/tests/modules/attention/profiling/test_attention_1d_profiling.py | Configuration | 35.1 KB | — |
| code/models/common/tests/modules/attention/test_attention_1d.py | Configuration | 118.7 KB | — |
| code/models/common/tests/modules/embedding/test_embedding_1d.py | Configuration | 26.5 KB | — |
| code/models/common/tests/modules/lm_head/test_lm_head_1d.py | Configuration | 16.6 KB | — |
| code/models/common/tests/modules/mlp/test_mlp_1d.py | Configuration | 62.2 KB | — |
| code/models/common/tests/modules/mlp/test_mlp_2d.py | Configuration | 18.3 KB | — |
| code/models/common/tests/modules/moe/test_generalized_moe_gate.py | Configuration | 26.9 KB | — |
| code/models/common/tests/modules/moe/test_tt_moe_decode.py | Configuration | 26.6 KB | — |
| code/models/common/tests/modules/moe/test_tt_moe_gate.py | Configuration | 11.4 KB | — |
| code/models/common/tests/modules/rmsnorm/test_rmsnorm_1d.py | Configuration | 58.1 KB | — |
| code/models/common/tests/modules/rmsnorm/test_rmsnorm_2d.py | Configuration | 11.6 KB | — |
| code/models/common/tests/modules/rope/test_rope_1d.py | Configuration | 43.6 KB | — |
| code/models/common/tests/modules/sampling/test_penalties_1d.py | Configuration | 73.5 KB | — |
| code/models/common/tests/modules/sampling/test_sampling_1d.py | Configuration | 71.4 KB | — |
| code/models/common/tests/modules/sampling/test_sampling_1d_release.py | Configuration | 8.5 KB | — |
| code/models/common/tests/modules/test_lazy_buffer.py | Configuration | 8.3 KB | — |
| code/models/common/tests/modules/test_tensor_utils.py | Configuration | 11.7 KB | — |
| code/models/common/tests/test_auto_compose.py | Configuration | 16.5 KB | — |
| code/models/common/tests/test_device_lock.py | Configuration | 4.0 KB | — |
| code/models/common/tests/test_distribute_as.py | Configuration | 8.6 KB | — |
| code/models/common/tests/test_lazy_weight.py | Configuration | 38.5 KB | — |
| code/models/common/tests/test_llama3_8b_hf_adaptor.py | Configuration | 3.6 KB | — |
| code/models/common/tests/test_mesh_fixture_policy.py | Configuration | 1.4 KB | — |
| code/models/common/tests/test_metrics.py | Configuration | 27.4 KB | — |
| code/models/common/tests/test_resume_offset_alignment.py | Configuration | 7.7 KB | — |
| code/models/common/tests/test_sampling.py | Configuration | 70.7 KB | — |
| code/models/common/tests/test_sampling_vocab_padding.py | Configuration | 3.7 KB | — |
| code/models/common/tests/test_tt_sampling.py | Configuration | 96.1 KB | — |
| code/models/common/tests/test_utils.py | Configuration | 1.7 KB | — |
| code/models/common/tests/test_validation_tools.py | Configuration | 24.6 KB | — |
| code/models/common/tests/utils.py | Configuration | 682 B | — |
| code/models/common/utility_functions.py | Configuration | 46.6 KB | — |
| code/models/common/utils.py | Configuration | 2.6 KB | — |
| code/models/common/validation_tools.py | Configuration | 29.1 KB | — |
| code/models/common/warmup/__init__.py | Configuration | 175 B | — |
| code/models/common/warmup/warmup_utils.py | Configuration | 5.3 KB | — |
| code/models/common/weight_cache.py | Configuration | 20.7 KB | — |
| code/models/demos/blackhole/qwen36/__init__.py | Configuration | — | |
| code/models/demos/blackhole/qwen36/demo/__init__.py | Configuration | — | |
| code/models/demos/blackhole/qwen36/demo/benchmark_vision.py | Configuration | 8.5 KB | — |
| code/models/demos/blackhole/qwen36/demo/sample_prompts/eval_frankenstein_long.json | Configuration | 1.3 KB | — |
| code/models/demos/blackhole/qwen36/demo/sample_prompts/input_data_long_4k.json | Configuration | 15.9 KB | — |
| code/models/demos/blackhole/qwen36/demo/sample_prompts/vision_demo.json | Configuration | 346 B | — |
| code/models/demos/blackhole/qwen36/demo/sample_prompts/vision_multi_image.json | Configuration | 554 B | — |
| code/models/demos/blackhole/qwen36/demo/sample_prompts/vision_text_only.json | Configuration | 180 B | — |
| code/models/demos/blackhole/qwen36/demo/sample_prompts/vision_video.json | Configuration | 386 B | — |
| code/models/demos/blackhole/qwen36/demo/text_demo.py | Configuration | 53.9 KB | — |
| code/models/demos/blackhole/qwen36/demo/vision_demo.py | Configuration | 28.0 KB | — |
| code/models/demos/blackhole/qwen36/server/__init__.py | Configuration | 94 B | — |
| code/models/demos/blackhole/qwen36/server/pd_app.py | Configuration | 46.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/__init__.py | Configuration | — | |
| code/models/demos/blackhole/qwen36/tests/conftest.py | Configuration | 1.9 KB | — |
| code/models/demos/blackhole/qwen36/tests/dflash2_stub.py | Configuration | 5.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/hist_device_pack_canary.py | Configuration | 7.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/hist_device_pack_scratch.py | Configuration | 12.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/pcc_thresholds.json | Configuration | 781 B | — |
| code/models/demos/blackhole/qwen36/tests/pd_dflash2_transfer_repro.py | Configuration | 19.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_export_paths_scratch.py | Configuration | 8.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_export_piecewise_check.py | Configuration | 5.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_hist_parity_flip_scratch.py | Configuration | 3.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_import_bitexact_check.py | Configuration | 13.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_kv_import_bitexact_check.py | Configuration | 7.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_mtp_transfer_repro.py | Configuration | 21.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_prefill_determinism.py | Configuration | 3.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_serving_repro.py | Configuration | 6.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/pd_transfer_repro.py | Configuration | 8.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/plain_bucket_repro.py | Configuration | 6.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/profile_prefill_decode.py | Configuration | 13.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_agmm_bench_scratch.py | Configuration | 5.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_agmm_grid_scratch.py | Configuration | 8.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_agmm_outproj_scratch.py | Configuration | 5.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_agmm_roofline_scratch.py | Configuration | 10.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_attention_decode_layout_bitexact.py | Configuration | 13.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_attention_tp.py | Configuration | 21.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_conv1d_blockmajor_scratch.py | Configuration | 7.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_decode_bucketing.py | Configuration | 40.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_decode_ccl_bench_scratch.py | Configuration | 8.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_decode_fused_all_reduce_pcc.py | Configuration | 11.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_decode_profile_scratch.py | Configuration | 6.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_decode_proj_dram_sharded_bench_scratch.py | Configuration | 10.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_decode_proj_dram_sharded_ref.py | Configuration | 10.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_dflash2_cpu.py | Configuration | 6.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_dflash2_spec_scratch.py | Configuration | 33.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_dflash2_window_op.py | Configuration | 4.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_factory.py | Configuration | 10.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_fused_all_reduce_scratch.py | Configuration | 12.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_fused_all_reduce_scratch2.py | Configuration | 8.5 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_decode_batched_scratch.py | Configuration | 6.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_bitexact_scratch.py | Configuration | 8.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_debug_scratch.py | Configuration | 3.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_multitoken_scratch.py | Configuration | 14.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_multitoken_timing_scratch.py | Configuration | 5.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_scratch.py | Configuration | 11.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_timing_scratch.py | Configuration | 4.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_gated_norm_scratch.py | Configuration | 6.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_glue_scratch.py | Configuration | 7.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_kda_masked_scratch.py | Configuration | 24.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_paths_scratch.py | Configuration | 6.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_prep_bitexact_scratch.py | Configuration | 8.9 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_scan_bench_scratch.py | Configuration | 3.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_gdn_tp.py | Configuration | 28.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_generate_tp.py | Configuration | 2.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_masked_bucket_trace_helpers_scratch.py | Configuration | 12.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_masked_bucket_trace_scratch.py | Configuration | 12.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_mlp.py | Configuration | 3.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_mlp_tp.py | Configuration | 4.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_model.py | Configuration | 7.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_model_tp.py | Configuration | 44.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_mtp_cpu.py | Configuration | 10.5 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_mtp_spec_scratch.py | Configuration | 31.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_outcol_cache_scratch.py | Configuration | 2.5 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_patch_merger.py | Configuration | 3.5 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_pd_app.py | Configuration | 16.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_pd_export_pieces.py | Configuration | 8.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_prefill.py | Configuration | 16.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_prefill_grouped_trace.py | Configuration | 21.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_prefill_kernels_ref_scratch.py | Configuration | 9.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_prefill_profile_scratch.py | Configuration | 5.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_prefill_smallm_ref_scratch.py | Configuration | 10.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_reduce_max_wide_row_repro_scratch.py | Configuration | 5.9 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_rope_tp.py | Configuration | 6.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_rs_bench_scratch.py | Configuration | 3.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_sampling.py | Configuration | 4.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_sampling_topk_vs_argmax.py | Configuration | 20.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_sdpa_chunked_bench_scratch.py | Configuration | 8.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_small_m_prefill_helpers.py | Configuration | 3.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_smallm_ag_bench_scratch.py | Configuration | 5.5 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_smallm_prefill_matmul_bench_scratch.py | Configuration | 15.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_spec_adapt_scratch.py | Configuration | 28.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_spec_serving_cpu.py | Configuration | 67.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_spec_serving_scratch.py | Configuration | 28.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_attn_batched_scratch.py | Configuration | 19.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_attn_modes_scratch.py | Configuration | 15.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_aux_scratch.py | Configuration | 11.5 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_grid.py | Configuration | 6.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_probe_scratch.py | Configuration | 11.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_rowdiag_scratch.py | Configuration | 3.9 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_rowpos_probe_scratch.py | Configuration | 9.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_rs_probe_scratch.py | Configuration | 5.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_step1_scratch.py | Configuration | 8.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_step_scratch.py | Configuration | 33.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_verify_w32_isolation_scratch.py | Configuration | 15.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_vision_attention.py | Configuration | 6.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_vision_block.py | Configuration | 7.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_weight_mapping.py | Configuration | 9.5 KB | — |
| code/models/demos/blackhole/qwen36/tests/test_wrapped_model.py | Configuration | 4.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/__init__.py | Configuration | — | |
| code/models/demos/blackhole/qwen36/tests/unit/conftest.py | Configuration | 2.0 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_attention.py | Configuration | 3.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_embedding.py | Configuration | 1.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_gdn.py | Configuration | 3.6 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_layer.py | Configuration | 4.2 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_lm_head.py | Configuration | 2.3 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_mlp.py | Configuration | 1.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_model.py | Configuration | 8.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_rms_norm.py | Configuration | 4.9 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_rope.py | Configuration | 7.9 KB | — |
| code/models/demos/blackhole/qwen36/tests/unit/test_substate.py | Configuration | 740 B | — |
| code/models/demos/blackhole/qwen36/tt-model.yaml | Configuration | 10.1 KB | — |
| code/models/demos/blackhole/qwen36/tt/__init__.py | Configuration | — | |
| code/models/demos/blackhole/qwen36/tt/attention/__init__.py | Configuration | 536 B | — |
| code/models/demos/blackhole/qwen36/tt/attention/config.py | Configuration | 568 B | — |
| code/models/demos/blackhole/qwen36/tt/attention/decode.py | Configuration | 1.5 KB | — |
| code/models/demos/blackhole/qwen36/tt/attention/gated_attention.py | Configuration | 4.6 KB | — |
| code/models/demos/blackhole/qwen36/tt/attention/prefill.py | Configuration | 3.1 KB | — |
| code/models/demos/blackhole/qwen36/tt/attention/rope_tp.py | Configuration | 17.2 KB | — |
| code/models/demos/blackhole/qwen36/tt/attention/tp.py | Configuration | 62.0 KB | — |
| code/models/demos/blackhole/qwen36/tt/attention/weights.py | Configuration | 1.5 KB | — |
| code/models/demos/blackhole/qwen36/tt/aux_hidden.py | Configuration | 28.4 KB | — |
| code/models/demos/blackhole/qwen36/tt/common.py | Configuration | 2.6 KB | — |
| code/models/demos/blackhole/qwen36/tt/dflash2_head.py | Configuration | 79.4 KB | — |
| code/models/demos/blackhole/qwen36/tt/gdn/__init__.py | Configuration | 521 B | — |
| code/models/demos/blackhole/qwen36/tt/gdn/config.py | Configuration | 968 B | — |
| code/models/demos/blackhole/qwen36/tt/gdn/decode.py | Configuration | 5.6 KB | — |
| code/models/demos/blackhole/qwen36/tt/gdn/fused_chunk.py | Configuration | 10.3 KB | — |
| code/models/demos/blackhole/qwen36/tt/gdn/gated_deltanet.py | Configuration | 5.0 KB | — |
| code/models/demos/blackhole/qwen36/tt/gdn/state.py | Configuration | 1.9 KB | — |
| code/models/demos/blackhole/qwen36/tt/gdn/tp.py | Configuration | 139.6 KB | — |
| code/models/demos/blackhole/qwen36/tt/gdn/weights.py | Configuration | 12.6 KB | — |
| code/models/demos/blackhole/qwen36/tt/generator_interface.py | Configuration | 6.3 KB | — |
| code/models/demos/blackhole/qwen36/tt/layer.py | Configuration | 18.8 KB | — |
| code/models/demos/blackhole/qwen36/tt/masked_bucket_trace.py | Configuration | 14.0 KB | — |
| code/models/demos/blackhole/qwen36/tt/mlp.py | Configuration | 25.9 KB | — |
| code/models/demos/blackhole/qwen36/tt/model.py | Configuration | 278.0 KB | — |
| code/models/demos/blackhole/qwen36/tt/model_config.py | Configuration | 31.0 KB | — |
| code/models/demos/blackhole/qwen36/tt/mtp_head.py | Configuration | 59.3 KB | — |
| code/models/demos/blackhole/qwen36/tt/pd_transfer.py | Configuration | 86.6 KB | — |
| code/models/demos/blackhole/qwen36/tt/qwen36_vllm.py | Configuration | 47.9 KB | — |
| code/models/demos/blackhole/qwen36/tt/rms_norm.py | Configuration | 738 B | — |
| code/models/demos/blackhole/qwen36/tt/rope.py | Configuration | 11.2 KB | — |
| code/models/demos/blackhole/qwen36/tt/spec_decoder.py | Configuration | 36.0 KB | — |
| code/models/demos/blackhole/qwen36/tt/spec_serving.py | Configuration | 53.1 KB | — |
| code/models/demos/blackhole/qwen36/tt/tp_common.py | Configuration | 62.7 KB | — |
| code/models/demos/blackhole/qwen36/tt/verify_grid.py | Configuration | 13.4 KB | — |
| code/models/demos/blackhole/qwen36/tt/verify_step.py | Configuration | 50.2 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/__init__.py | Configuration | 91 B | — |
| code/models/demos/blackhole/qwen36/tt/vision/functional.py | Configuration | 7.4 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/model.py | Configuration | 13.8 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/patch_merger.py | Configuration | 9.2 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/vision_attention.py | Configuration | 18.9 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/vision_block.py | Configuration | 4.2 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/vision_distributed_layernorm.py | Configuration | 3.4 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/vision_layernorm.py | Configuration | 4.6 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/vision_mlp.py | Configuration | 7.6 KB | — |
| code/models/demos/blackhole/qwen36/tt/vision/vision_model_config.py | Configuration | 7.0 KB | — |
| code/models/demos/blackhole/qwen36/tt/weight_mapping.py | Configuration | 11.1 KB | — |
| code/models/demos/blackhole/qwen36/utils/__init__.py | Configuration | — | |
| code/models/demos/blackhole/qwen36/utils/substate.py | Configuration | 1.1 KB | — |
| code/models/demos/qwen3_vl/tt/common.py | Configuration | 24.4 KB | — |
| code/models/demos/utils/common_demo_utils.py | Configuration | 20.7 KB | — |
| code/models/demos/utils/device_sku.py | Configuration | 1.4 KB | — |
| code/models/demos/utils/llm_demo_utils.py | Configuration | 14.9 KB | — |
| code/models/demos/utils/model_targets.py | Configuration | 7.2 KB | — |
| code/models/demos/utils/qa_pipeline_compat.py | Configuration | 22.6 KB | — |
| code/models/demos/utils/trace_region_sizes.py | Configuration | 7.5 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tests/__init__.py | Configuration | — | |
| code/models/experimental/gated_attention_gated_deltanet/tests/bench_concat_heads.py | Configuration | 6.4 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tests/sweep_seq_len.py | Configuration | 8.4 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tests/test_gated_attention.py | Configuration | 6.4 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tests/test_gated_deltanet.py | Configuration | 8.8 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tests/test_ttnn_validation.py | Configuration | 21.4 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/torch_functional/__init__.py | Configuration | — | |
| code/models/experimental/gated_attention_gated_deltanet/torch_functional/delta_rule_ops.py | Configuration | 8.2 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/torch_functional/gated_attention.py | Configuration | 6.8 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/torch_functional/gated_deltanet.py | Configuration | 6.8 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tt/__init__.py | Configuration | — | |
| code/models/experimental/gated_attention_gated_deltanet/tt/ttnn_delta_rule_ops.py | Configuration | 18.5 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tt/ttnn_delta_rule_seq.py | Configuration | 31.7 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tt/ttnn_gated_attention.py | Configuration | 26.2 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/tt/ttnn_gated_deltanet.py | Configuration | 29.3 KB | — |
| code/models/model_targets.yaml | Configuration | 52.1 KB | — |
| code/models/model_trace_region_sizes.yaml | Configuration | 10.7 KB | — |
| code/models/perf/benchmarking_utils.py | Configuration | 8.4 KB | — |
| code/models/perf/device_perf_utils.py | Configuration | 18.2 KB | — |
| code/models/perf/merge_device_perf_results.py | Configuration | 2.3 KB | — |
| code/models/perf/merge_perf_results.py | Configuration | 2.1 KB | — |
| code/models/perf/perf_utils.py | Configuration | 10.2 KB | — |
| code/models/tt_dit/utils/tensor.py | Configuration | 35.8 KB | — |
| code/models/tt_transformers/conftest.py | Configuration | 1.4 KB | — |
| code/models/tt_transformers/demo/config_16_decoders.json | Configuration | 2.8 KB | — |
| code/models/tt_transformers/demo/conftest.py | Configuration | 4.3 KB | — |
| code/models/tt_transformers/demo/input_data_questions_reasoning.json | Configuration | 922 B | — |
| code/models/tt_transformers/demo/multimodal_demo_chat.py | Configuration | 3.1 KB | — |
| code/models/tt_transformers/demo/multimodal_demo_text.py | Configuration | 3.7 KB | — |
| code/models/tt_transformers/demo/sample_prompts/eval_repeat_prompts_batch1.json | Configuration | 10.4 KB | — |
| code/models/tt_transformers/demo/sample_prompts/eval_repeat_prompts_batch32.json | Configuration | 11.6 KB | — |
| code/models/tt_transformers/demo/sample_prompts/expected_vision_input_data_llama32_11B.json | Configuration | 3.1 KB | — |
| code/models/tt_transformers/demo/sample_prompts/expected_vision_input_data_llama32_90B.json | Configuration | 2.7 KB | — |
| code/models/tt_transformers/demo/sample_prompts/expected_vision_input_data_w_text_only_llama32_11B.json | Configuration | 3.6 KB | — |
| code/models/tt_transformers/demo/sample_prompts/expected_vision_input_data_w_text_only_llama32_90B.json | Configuration | 2.8 KB | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_128k.json | Configuration | 493 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_16k.json | Configuration | 522 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_1k.json | Configuration | 521 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_256k.json | Configuration | 522 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_2k.json | Configuration | 521 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_32k.json | Configuration | 523 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_4k.json | Configuration | 522 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_64k.json | Configuration | 523 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_long_8k.json | Configuration | 522 B | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_prefill_128.json | Configuration | 30.2 KB | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_questions_prefill_128.json | Configuration | 12.6 KB | — |
| code/models/tt_transformers/demo/sample_prompts/input_data_questions_prefill_256.json | Configuration | 24.2 KB | — |
| code/models/tt_transformers/demo/sample_prompts/vision_input_data.json | Configuration | 968 B | — |
| code/models/tt_transformers/demo/sample_prompts/vision_input_data_trace.json | Configuration | 914 B | — |
| code/models/tt_transformers/demo/sample_prompts/vision_input_data_w_text_only.json | Configuration | 670 B | — |
| code/models/tt_transformers/demo/simple_text_demo.py | Configuration | 83.4 KB | — |
| code/models/tt_transformers/demo/simple_vision_demo.py | Configuration | 28.8 KB | — |
| code/models/tt_transformers/demo/trace_region_config.py | Configuration | 4.2 KB | — |
| code/models/tt_transformers/host_mem_profiler.py | Configuration | 7.3 KB | — |
| code/models/tt_transformers/model_params/LFM2.5-VL-1.6B/config.json | Configuration | 2.4 KB | — |
| code/models/tt_transformers/model_params/Llama-3.1-70B-Instruct/config.json | Configuration | 855 B | — |
| code/models/tt_transformers/model_params/Llama-3.1-70B-Instruct/params.json | Configuration | 226 B | — |
| code/models/tt_transformers/model_params/Llama-3.1-70B-Instruct/tensor_states.json | Configuration | 80.9 KB | — |
| code/models/tt_transformers/model_params/Llama-3.1-8B-Instruct/config.json | Configuration | 855 B | — |
| code/models/tt_transformers/model_params/Llama-3.1-8B-Instruct/params.json | Configuration | 226 B | — |
| code/models/tt_transformers/model_params/Llama-3.1-8B-Instruct/performance_decoder_config.json | Configuration | 221 B | — |
| code/models/tt_transformers/model_params/Llama-3.2-11B-Vision-Instruct/config.json | Configuration | 5.1 KB | — |
| code/models/tt_transformers/model_params/Llama-3.2-11B-Vision-Instruct/params.json | Configuration | 350 B | — |
| code/models/tt_transformers/model_params/Llama-3.2-1B-Instruct/config.json | Configuration | 877 B | — |
| code/models/tt_transformers/model_params/Llama-3.2-1B-Instruct/params.json | Configuration | 250 B | — |
| code/models/tt_transformers/model_params/Llama-3.2-3B-Instruct/config.json | Configuration | 878 B | — |
| code/models/tt_transformers/model_params/Llama-3.2-3B-Instruct/params.json | Configuration | 250 B | — |
| code/models/tt_transformers/model_params/Llama-3.2-90B-Instruct/accuracy_decoder_config.json | Configuration | 40.8 KB | — |
| code/models/tt_transformers/model_params/Llama-3.2-90B-Instruct/performance_decoder_config.json | Configuration | 40.8 KB | — |
| code/models/tt_transformers/model_params/Llama-3.2-90B-Vision-Instruct/config.json | Configuration | 5.2 KB | — |
| code/models/tt_transformers/model_params/Llama-3.2-90B-Vision-Instruct/params.json | Configuration | 323 B | — |
| code/models/tt_transformers/model_params/Llama-3.2-90B-Vision-Instruct/tensor_states.json | Configuration | 196.5 KB | — |
| code/models/tt_transformers/model_params/Meta-Llama-3-8B/config.json | Configuration | 654 B | — |
| code/models/tt_transformers/model_params/Mistral-7B-Instruct-v0.3/config.json | Configuration | 1.8 KB | — |
| code/models/tt_transformers/model_params/Qwen2.5-32B-Instruct/config.json | Configuration | 664 B | — |
| code/models/tt_transformers/model_params/Qwen2.5-72B-Instruct/config.json | Configuration | 663 B | — |
| code/models/tt_transformers/model_params/Qwen2.5-7B-Instruct/accuracy_decoder_config.json | Configuration | 10.9 KB | — |
| code/models/tt_transformers/model_params/Qwen2.5-7B-Instruct/performance_decoder_config.json | Configuration | 10.9 KB | — |
| code/models/tt_transformers/model_params/Qwen2.5-VL-32B-Instruct/config.json | Configuration | 1.2 KB | — |
| code/models/tt_transformers/model_params/Qwen2.5-VL-3B-Instruct/config.json | Configuration | 1.4 KB | — |
| code/models/tt_transformers/model_params/Qwen2.5-VL-72B-Instruct/config.json | Configuration | 1.4 KB | — |
| code/models/tt_transformers/model_params/Qwen2.5-VL-7B-Instruct/performance_decoder_config.json | Configuration | 10.9 KB | — |
| code/models/tt_transformers/model_params/Qwen3-32B/config.json | Configuration | 729 B | — |
| code/models/tt_transformers/model_params/Qwen3-VL-32B-Instruct/config.json | Configuration | 1.5 KB | — |
| code/models/tt_transformers/model_params/Qwen3.6-27B/config.json | Configuration | 4.3 KB | — |
| code/models/tt_transformers/model_params/gemma-3-27b-it/accuracy_decoder_config.json | Configuration | 6.7 KB | — |
| code/models/tt_transformers/model_params/phi-4/accuracy_decoder_config.json | Configuration | 232 B | — |
| code/models/tt_transformers/model_params/phi-4/config.json | Configuration | 826 B | — |
| code/models/tt_transformers/model_params/phi-4/params.json | Configuration | 190 B | — |
| code/models/tt_transformers/scripts/op_perf_results.py | Configuration | 7.8 KB | — |
| code/models/tt_transformers/scripts/repack_weights_70b.py | Configuration | 3.8 KB | — |
| code/models/tt_transformers/scripts/repack_weights_90b.py | Configuration | 7.6 KB | — |
| code/models/tt_transformers/tests/configurations/conf0.json | Configuration | 5.9 KB | — |
| code/models/tt_transformers/tests/configurations/conf1.json | Configuration | 5.9 KB | — |
| code/models/tt_transformers/tests/configurations/conf2.json | Configuration | 5.9 KB | — |
| code/models/tt_transformers/tests/configurations/conf3.json | Configuration | 5.8 KB | — |
| code/models/tt_transformers/tests/conftest.py | Configuration | 1.9 KB | — |
| code/models/tt_transformers/tests/decode_test_helpers.py | Configuration | 1.1 KB | — |
| code/models/tt_transformers/tests/generate_reference_hf.py | Configuration | 6.6 KB | — |
| code/models/tt_transformers/tests/generate_reference_outputs.py | Configuration | 7.9 KB | — |
| code/models/tt_transformers/tests/mixtral/test_mixtral_decoder.py | Configuration | 6.6 KB | — |
| code/models/tt_transformers/tests/mixtral/test_mixtral_decoder_prefill.py | Configuration | 7.4 KB | — |
| code/models/tt_transformers/tests/mixtral/test_mixtral_mlp.py | Configuration | 5.3 KB | — |
| code/models/tt_transformers/tests/mixtral/test_mixtral_model.py | Configuration | 18.1 KB | — |
| code/models/tt_transformers/tests/mixtral/test_mixtral_model_prefill.py | Configuration | 10.8 KB | — |
| code/models/tt_transformers/tests/mixtral/test_mixtral_moe.py | Configuration | 5.5 KB | — |
| code/models/tt_transformers/tests/mixtral/test_mixtral_rms_norm.py | Configuration | 3.0 KB | — |
| code/models/tt_transformers/tests/mixtral/utils.py | Configuration | 2.0 KB | — |
| code/models/tt_transformers/tests/multimodal/mistral_24b/test_conv2d.py | Configuration | 3.4 KB | — |
| code/models/tt_transformers/tests/multimodal/mistral_24b/test_patch_rot_emb.py | Configuration | 2.5 KB | — |
| code/models/tt_transformers/tests/multimodal/mistral_24b/test_pixtral_transformer.py | Configuration | 3.9 KB | — |
| code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_attention.py | Configuration | 3.9 KB | — |
| code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_mlp.py | Configuration | 2.6 KB | — |
| code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_model.py | Configuration | 3.3 KB | — |
| code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_rms.py | Configuration | 2.6 KB | — |
| code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_tower.py | Configuration | 2.5 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_class_embedding.py | Configuration | 4.3 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_conv2d_patch.py | Configuration | 4.2 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_cross_attention.py | Configuration | 12.2 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_cross_attention_transformer_text.py | Configuration | 18.3 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_cross_attention_transformer_vision.py | Configuration | 7.3 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_cross_block.py | Configuration | 13.5 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_image_attention.py | Configuration | 5.2 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_image_block.py | Configuration | 5.3 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_image_mlp.py | Configuration | 3.7 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_image_transformer.py | Configuration | 7.0 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_layernorm.py | Configuration | 3.1 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_positional_embedding.py | Configuration | 5.2 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_tile_position_embedding.py | Configuration | 6.0 KB | — |
| code/models/tt_transformers/tests/multimodal/test_llama_vision_encoder.py | Configuration | 4.5 KB | — |
| code/models/tt_transformers/tests/multimodal/utils.py | Configuration | 1.3 KB | — |
| code/models/tt_transformers/tests/test_attention.py | Configuration | 12.1 KB | — |
| code/models/tt_transformers/tests/test_attention_prefill.py | Configuration | 10.5 KB | — |
| code/models/tt_transformers/tests/test_attention_utils.py | Configuration | 4.1 KB | — |
| code/models/tt_transformers/tests/test_batched_prefill_slots.py | Configuration | 5.5 KB | — |
| code/models/tt_transformers/tests/test_ccl_utils.py | Configuration | 2.8 KB | — |
| code/models/tt_transformers/tests/test_chunked_generation.py | Configuration | 6.8 KB | — |
| code/models/tt_transformers/tests/test_ci_dispatch.py | Configuration | 1.9 KB | — |
| code/models/tt_transformers/tests/test_decode_test_helpers.py | Configuration | 1.8 KB | — |
| code/models/tt_transformers/tests/test_decoder.py | Configuration | 9.4 KB | — |
| code/models/tt_transformers/tests/test_decoder_prefill.py | Configuration | 8.4 KB | — |
| code/models/tt_transformers/tests/test_device_perf.py | Configuration | 15.9 KB | — |
| code/models/tt_transformers/tests/test_distributed_norm_utils.py | Configuration | 1.6 KB | — |
| code/models/tt_transformers/tests/test_embedding.py | Configuration | 3.4 KB | — |
| code/models/tt_transformers/tests/test_hybrid_attention_for_causal_lm.py | Configuration | 6.0 KB | — |
| code/models/tt_transformers/tests/test_interleaved_to_sharded.py | Configuration | 3.1 KB | — |
| code/models/tt_transformers/tests/test_llama90b_decoder_json.py | Configuration | 2.9 KB | — |
| code/models/tt_transformers/tests/test_lm_head.py | Configuration | 3.6 KB | — |
| code/models/tt_transformers/tests/test_lm_head_cache.py | Configuration | 1.1 KB | — |
| code/models/tt_transformers/tests/test_load_checkpoints.py | Configuration | 3.7 KB | — |
| code/models/tt_transformers/tests/test_mha_wo_sharding.py | Configuration | 2.5 KB | — |
| code/models/tt_transformers/tests/test_mlp.py | Configuration | 4.4 KB | — |
| code/models/tt_transformers/tests/test_model.py | Configuration | 21.9 KB | — |
| code/models/tt_transformers/tests/test_model_config_utils.py | Configuration | 6.5 KB | — |
| code/models/tt_transformers/tests/test_model_prefill.py | Configuration | 13.2 KB | — |
| code/models/tt_transformers/tests/test_ref.py | Configuration | 3.2 KB | — |
| code/models/tt_transformers/tests/test_rms_norm.py | Configuration | 3.8 KB | — |
| code/models/tt_transformers/tests/test_rope.py | Configuration | 6.4 KB | — |
| code/models/tt_transformers/tests/test_rope_utils.py | Configuration | 653 B | — |
| code/models/tt_transformers/tests/test_torch.py | Configuration | 2.6 KB | — |
| code/models/tt_transformers/tests/test_trace_region_sizes.py | Configuration | 8.2 KB | — |
| code/models/tt_transformers/tests/test_utils.py | Configuration | 17.2 KB | — |
| code/models/tt_transformers/tests/test_vllm_kv_cache.py | Configuration | 5.5 KB | — |
| code/models/tt_transformers/tests/test_warm_cache_marker.py | Configuration | 19.4 KB | — |
| code/models/tt_transformers/tt/attention.py | Configuration | 63.3 KB | — |
| code/models/tt_transformers/tt/ccl.py | Configuration | 18.0 KB | — |
| code/models/tt_transformers/tt/common.py | Configuration | 40.7 KB | — |
| code/models/tt_transformers/tt/decoder.py | Configuration | 16.1 KB | — |
| code/models/tt_transformers/tt/distributed_norm.py | Configuration | 8.4 KB | — |
| code/models/tt_transformers/tt/embedding.py | Configuration | 3.5 KB | — |
| code/models/tt_transformers/tt/generator.py | Configuration | 174.6 KB | — |
| code/models/tt_transformers/tt/generator_sglang.py | Configuration | 10.9 KB | — |
| code/models/tt_transformers/tt/generator_vllm.py | Configuration | 47.4 KB | — |
| code/models/tt_transformers/tt/lm_head.py | Configuration | 13.4 KB | — |
| code/models/tt_transformers/tt/load_checkpoints.py | Configuration | 42.1 KB | — |
| code/models/tt_transformers/tt/mixtral_mlp.py | Configuration | 6.7 KB | — |
| code/models/tt_transformers/tt/mixtral_moe.py | Configuration | 6.8 KB | — |
| code/models/tt_transformers/tt/mlp.py | Configuration | 18.8 KB | — |
| code/models/tt_transformers/tt/model.py | Configuration | 44.0 KB | — |
| code/models/tt_transformers/tt/model_config.py | Configuration | 244.5 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_class_embedding.py | Configuration | 1.5 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_conv2d_patch.py | Configuration | 3.7 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_cross_attention.py | Configuration | 16.2 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_cross_attention_transformer_text.py | Configuration | 14.7 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_cross_attention_transformer_vision.py | Configuration | 4.5 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_cross_block.py | Configuration | 5.9 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_image_attention.py | Configuration | 11.8 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_image_block.py | Configuration | 3.8 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_image_mlp.py | Configuration | 5.0 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_image_transformer.py | Configuration | 1.9 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_layernorm.py | Configuration | 4.7 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_positional_embedding.py | Configuration | 5.0 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_tile_position_embedding.py | Configuration | 4.3 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_vision_encoder.py | Configuration | 9.8 KB | — |
| code/models/tt_transformers/tt/multimodal/llama_vision_model.py | Configuration | 47.3 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/mistral_e2e_model.py | Configuration | 5.5 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/mistral_vision_tower.py | Configuration | 5.9 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/rmsnorm.py | Configuration | 7.9 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/vision_attention.py | Configuration | 10.1 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/vision_conv2d.py | Configuration | 3.3 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/vision_mlp.py | Configuration | 3.0 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/vision_mmp.py | Configuration | 6.6 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/vision_model.py | Configuration | 1.7 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/vision_pixtral_image_block.py | Configuration | 2.9 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/vision_pixtral_transformer.py | Configuration | 2.1 KB | — |
| code/models/tt_transformers/tt/multimodal/mistral_24b/vision_rope.py | Configuration | 3.9 KB | — |
| code/models/tt_transformers/tt/prefetcher.py | Configuration | 25.8 KB | — |
| code/models/tt_transformers/tt/prefetcher/prefetcher_config.yaml | Configuration | 1.3 KB | — |
| code/models/tt_transformers/tt/rope.py | Configuration | 43.1 KB | — |
| image/index.json | Configuration | 384 B | — |
| image/manifest.json | Configuration | 1.9 KB | — |
| tt_kernel_manifest.json | Configuration | 8.6 KB | — |
| README.md | Documentation | 26.0 KB | — |
| code/models/common/LICENSE-Llama-3.1 | Documentation | 7.7 KB | — |
| code/models/common/README.md | Documentation | 11.7 KB | — |
| code/models/common/llm_runtime/README.md | Documentation | 23.7 KB | — |
| code/models/common/llm_runtime/prefill/README.md | Documentation | 13.2 KB | — |
| code/models/common/llm_runtime/tttv2_demo_to_vllm_integration_skill.md | Documentation | 23.9 KB | — |
| code/models/common/models/llama3_8b/README.md | Documentation | 16.6 KB | — |
| code/models/common/modules/README.md | Documentation | 11.9 KB | — |
| code/models/common/modules/moe/configs/models_table.md | Documentation | 3.3 KB | — |
| code/models/common/sampling/README.md | Documentation | 5.8 KB | — |
| code/models/common/tests/modules/attention/low_pcc_notes.md | Documentation | 6.5 KB | — |
| code/models/demos/blackhole/qwen36/BENCHMARKS.md | Documentation | 7.0 KB | — |
| code/models/demos/blackhole/qwen36/README.md | Documentation | 8.9 KB | — |
| code/models/demos/blackhole/qwen36/tests/DFLASH2_RESULTS.md | Documentation | 58.1 KB | — |
| code/models/demos/blackhole/qwen36/tests/DFLASH2_TRANSPORT_RESULTS.md | Documentation | 12.4 KB | — |
| code/models/demos/blackhole/qwen36/tests/GROUPED_PREFILL_RESULTS.md | Documentation | 25.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/MONO_SPEC_RESULTS.md | Documentation | 17.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/MTP_SPEC_RESULTS.md | Documentation | 13.8 KB | — |
| code/models/demos/blackhole/qwen36/tests/TP8_SPEC_RESULTS.md | Documentation | 22.7 KB | — |
| code/models/demos/blackhole/qwen36/tests/VERIFY_W32_AUDIT.md | Documentation | 25.5 KB | — |
| code/models/demos/utils/PERF_TARGET_VALIDATION.md | Documentation | 1.8 KB | — |
| code/models/experimental/gated_attention_gated_deltanet/README.md | Documentation | 36.2 KB | — |
| code/models/perf/README.md | Documentation | 516 B | — |
| code/models/tt_transformers/Host_Mem_Profile.md | Documentation | 7.8 KB | — |
| code/models/tt_transformers/PERF.md | Documentation | 18.7 KB | — |
| code/models/tt_transformers/README.md | Documentation | 35.2 KB | — |
| wheels/README.md | Documentation | 657 B | — |
| code/models/common/tests/requirements.txt | Other | 11 B | — |
| code/models/common/tests/setup.cfg | Other | 224 B | — |
| code/models/demos/utils/coco.names | Other | 625 B | — |
| code/models/perf/images/example_perf_report.png | Other | 431.6 KB | cad3f92bb517 |
| code/models/tt_transformers/demo/sample_prompts/llama_models/clutter.jpeg | Other | 406.7 KB | 8506697c4f59 |
| code/models/tt_transformers/demo/sample_prompts/llama_models/dog.jpg | Other | 40.2 KB | — |
| code/models/tt_transformers/demo/sample_prompts/llama_models/ocr_image.jpeg | Other | 208.1 KB | 605f22ef100a |
| code/models/tt_transformers/demo/sample_prompts/llama_models/pasta.jpeg | Other | 448.6 KB | 8fbcd57e3160 |
| code/models/tt_transformers/tests/generate_reference_outputs.sh | Other | 2.8 KB | — |
| code/models/tt_transformers/tests/tale-of-two-cities.txt.bz2 | Other | 220.3 KB | 25d33cc39a17 |
| image/blobs/sha256/06d09bba9141d71ba9cfef79f15856e2ee282eec016c20980b2f05dcc1e64e19 | Other | 117 B | — |
| image/blobs/sha256/187059930e3dac53e513636e22d9da5542b892cd617554c6c4b5e37df2345f79 | Other | 4.1 MB | 187059930e3d |
| image/blobs/sha256/1b4f3f871f03dfe123dac0232fd71039468e9b811235ec14fed16a617db08482 | Other | 1.7 MB | 1b4f3f871f03 |
| image/blobs/sha256/20c3783cc497b5b0df1fc5f92bd64c3d2fbb24057c88692c8fda205b6ea8a2f2 | Other | 29.8 MB | 20c3783cc497 |
| image/blobs/sha256/295e9765634ff84d5a73fb7a197702148819e0629e2d52237d5a7bdae0a49b9c | Other | 1.9 KB | — |
| image/blobs/sha256/2abf777469cb9a6666a2849294fcb37805e6f2ff9b73f9a338c1f78e0111f0d9 | Other | 856 B | — |
| image/blobs/sha256/39baa03fb94a271d831062b426ce9ca4dcd086865fcac7ecf537c6eb7eba0dd4 | Other | 1.0 KB | — |
| image/blobs/sha256/3defbdfc2f4eae64093a80b52f0868d81eafdeb3da57d11b39d54f1d3ff25def | Other | 65.9 MB | 3defbdfc2f4e |
| image/blobs/sha256/41cd59bd2c7e757e6d2bb904b8fe8eee7950f81c6af5c1a7d88d30bf8c5838fe | Other | 1.5 KB | — |
| image/blobs/sha256/4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1 | Other | 32 B | — |
| image/blobs/sha256/50edcbeb9c98efece3a0c9cf4e86dd97fefd2f5830b569b06f51522972a675b8 | Other | 564 B | — |
| image/blobs/sha256/5d712d04611b182a79870738a11ed1ba1345954650d847180210e354bfaa734b | Other | 4.4 KB | — |
| image/blobs/sha256/614ebe9ff4c662d56fc9cbd1e910afb433ebdf14ff83fb1d19558605b9e379ab | Other | 11.5 MB | 614ebe9ff4c6 |
| image/blobs/sha256/697b443a9af0062b61fa8290d609d6292c9705d938635c40840e5b5923a47e8a | Other | 58.1 MB | 697b443a9af0 |
| image/blobs/sha256/7a8208d1b5ccf5b5fa86423ab4ffa9e92c25a1aaff3e7df4ba53e1d349ff8385 | Other | 167 B | — |
| image/blobs/sha256/9002d2cd12eec1998ac120f636141afccf54af4dd5d9e228434a768e3a6f365a | Other | 864.1 KB | 9002d2cd12ee |
| image/blobs/sha256/937d1ef3b968106a5fd53d94e90300399e1d70bb7272f9130f9c1246ea99704b | Other | 38.4 MB | 937d1ef3b968 |
| image/blobs/sha256/9a656c7774cd92ab6782920d78dab44bf55ea86d19bfe3f47a604dfc4e445b78 | Other | 139.1 MB | 9a656c7774cd |
| image/blobs/sha256/9de168b8aa2924610c92b81dcbeba520cb9822604e7ad8eee07642ae1ce401cf | Other | 6.6 KB | — |
| image/blobs/sha256/b1c223d8a80f7d0b09caad9e620fbfb262b8ec491824c89c0da1fb851eec4eb2 | Other | 4.3 KB | — |
| image/blobs/sha256/bedec7e229d6c492ed2f9aa2ab3abe166288795edd614ae46742743efac9a908 | Other | 38.4 MB | bedec7e229d6 |
| image/blobs/sha256/bf689ede870f44a3631f32fc8ffe76e69146a37a3f15039d58541856bb6891e4 | Other | 138.9 MB | bf689ede870f |
| image/blobs/sha256/cb4b6974570f47f8f4f0995a4a3cfc863c4ec511bdce06d91e5d5ef655531524 | Other | 4.5 KB | — |
| image/blobs/sha256/d5213289cbbc8b2af848c92d7a1887dc692967e673bb439cafd1d3f9d29fef96 | Other | 9.6 MB | d5213289cbbc |
| image/blobs/sha256/de857d09640b19782c1cf8f4ddbe4f6d5bb28aebdf4f86863905d8cde25295fc | Other | 1.3 GB | de857d09640b |
| image/blobs/sha256/f5d4d182e58ff875e808c411e1da409851c09c1dda426ffb0b8c1fb4b8412be0 | Other | 14.5 KB | — |
| image/blobs/sha256/fab07404a6227d7e1d02a8f4536e86fda0592554def3ffcfcc4f365686057707 | Other | 1.1 KB | — |
| image/blobs/sha256/fe45b9e64b92f129f38df95c5e5a3da2519a51bbb2dcb0ff4a31416d3cd5e620 | Other | 69.5 MB | fe45b9e64b92 |
| image/oci-layout | Other | 30 B | — |
| requirements.lock | Other | 6.2 KB | — |
| wheels/vllm-0.26.0+empty-cp312-cp312-linux_x86_64.whl | Other | 8.2 MB | cc6342644067 |
| .gitattributes | Repository | 3.7 KB | — |
| code/models/tt_transformers/demo/.gitignore | Repository | 23 B | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
Released by Hyunggi Chang through its official repository on Hugging Face.