Skip to page content
SAVRN
Search Plan a project

Open-weight model

qwen3.8-27b-p150x8

by Hyunggi Chang changh95/qwen3.8-27b-p150x8

qwen3.8-27b-p150x8 is an open-weight model from Hyunggi Chang. Its published files total 2.0 GB.

Qwen/Qwen3.8-27B served on a Tenstorrent P150x8 (8 Blackhole chips, 8-way tensor parallel) through one vLLM with speculative decoding, lossless for greedy requests: by default a hybrid of the DFlash2 block drafter (1–4 users, contexts up to 12K) and the…

Parameters—
Context—
Weights2.0 GB
License—
AccessOpen weights
Monthly Downloads—

Model Card

Qwen/Qwen3.8-27B served on a Tenstorrent P150x8 (8 Blackhole chips, 8-way tensor parallel) through one vLLM with speculative decoding, lossless for greedy requests: by default a hybrid of the DFlash2 block drafter (1–4 users, contexts up to 12K) and the checkpoint's own MTP head (5–8 users, longer contexts); up to 32 concurrent users, full sampling support, 262K context. Single-user decode ~10 ms/token on natural text (12.5 ms on random tokens) and the fastest long-prompt first token on this hardware (1.1 s at 8K, 2.0 s at 16K, 4.0 s at 32K, 21 s at 131K). The low-concurrency / long-document sibling of the prefill/decode-disaggregated changh95/qwen3.8-27b-pd4x4-p150x8 and the eight-chip…

Excerpt from the card by Hyunggi Chang.

Identity and Version

Repository
changh95/qwen3.8-27b-p150x8
Publisher
Hyunggi Chang
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
8ad66c5772df755bba7ff3632c813f5011f1d502
First published
2026-09-21
Last updated
2026-09-30

Files and Weights

725 files, 2.0 GB in total.

Configuration655 files · 10.2 MB
Documentation27 files · 442.9 KB
Other41 files · 1.9 GB
Repository2 files · 3.7 KB
Every file
FileTypeSizeSHA-256
code/models/common/auto_compose.pyConfiguration5.9 KB —
code/models/common/device_utils.pyConfiguration1.5 KB —
code/models/common/distribute_as.pyConfiguration4.9 KB —
code/models/common/generation_utils.pyConfiguration11.4 KB —
code/models/common/helper_funcs.pyConfiguration1.2 KB —
code/models/common/lightweightmodule.pyConfiguration405 B —
code/models/common/llama_models.pyConfiguration7.0 KB —
code/models/common/llm_runtime/config.pyConfiguration5.8 KB —
code/models/common/llm_runtime/decode.pyConfiguration40.2 KB —
code/models/common/llm_runtime/execution.pyConfiguration29.4 KB —
code/models/common/llm_runtime/lane_group.pyConfiguration36.0 KB —
code/models/common/llm_runtime/output_reader.pyConfiguration8.7 KB —
code/models/common/llm_runtime/paged_kv_cache.pyConfiguration16.7 KB —
code/models/common/llm_runtime/prefill/config.pyConfiguration12.0 KB —
code/models/common/llm_runtime/prefill/inputs.pyConfiguration14.0 KB —
code/models/common/llm_runtime/prefill/plan.pyConfiguration20.6 KB —
code/models/common/llm_runtime/prefill/postprocess.pyConfiguration12.9 KB —
code/models/common/llm_runtime/prefill/result_collector.pyConfiguration7.8 KB —
code/models/common/llm_runtime/prefill/runtime.pyConfiguration15.1 KB —
code/models/common/llm_runtime/prefill/sampling_helpers.pyConfiguration3.4 KB —
code/models/common/llm_runtime/prefill/sequence_runner.pyConfiguration5.5 KB —
code/models/common/llm_runtime/prefill/signatures.pyConfiguration5.9 KB —
code/models/common/llm_runtime/prefill/trace.pyConfiguration11.7 KB —
code/models/common/llm_runtime/program_compiler.pyConfiguration12.2 KB —
code/models/common/llm_runtime/tensor_resources.pyConfiguration3.5 KB —
code/models/common/llm_runtime/trace_compiler.pyConfiguration18.2 KB —
code/models/common/llm_runtime/vllm_adapter.pyConfiguration14.6 KB —
code/models/common/llm_runtime/warmup.pyConfiguration33.0 KB —
code/models/common/metrics.pyConfiguration20.3 KB —
code/models/common/model_capabilities.pyConfiguration3.2 KB —
code/models/common/models/deepseek_r1_distill_qwen_14b/__init__.pyConfiguration1.3 KB —
code/models/common/models/deepseek_r1_distill_qwen_14b/executor.pyConfiguration27.1 KB —
code/models/common/models/deepseek_r1_distill_qwen_14b/generator.pyConfiguration18.0 KB —
code/models/common/models/deepseek_r1_distill_qwen_14b/hf_adaptor.pyConfiguration13.0 KB —
code/models/common/models/deepseek_r1_distill_qwen_14b/model.pyConfiguration46.8 KB —
code/models/common/models/deepseek_r1_distill_qwen_14b/weight_utils.pyConfiguration8.8 KB —
code/models/common/models/llama32_1b/__init__.pyConfiguration785 B —
code/models/common/models/llama32_1b/executor.pyConfiguration26.6 KB —
code/models/common/models/llama32_1b/generator.pyConfiguration17.5 KB —
code/models/common/models/llama32_1b/hf_adaptor.pyConfiguration10.5 KB —
code/models/common/models/llama32_1b/model.pyConfiguration45.0 KB —
code/models/common/models/llama32_1b/weight_utils.pyConfiguration3.9 KB —
code/models/common/models/llama32_3b/__init__.pyConfiguration785 B —
code/models/common/models/llama32_3b/executor.pyConfiguration26.6 KB —
code/models/common/models/llama32_3b/generator.pyConfiguration17.5 KB —
code/models/common/models/llama32_3b/hf_adaptor.pyConfiguration10.6 KB —
code/models/common/models/llama32_3b/model.pyConfiguration44.6 KB —
code/models/common/models/llama32_3b/weight_utils.pyConfiguration7.0 KB —
code/models/common/models/llama33_70b/__init__.pyConfiguration1.6 KB —
code/models/common/models/llama33_70b/executor.pyConfiguration27.1 KB —
code/models/common/models/llama33_70b/generator.pyConfiguration18.8 KB —
code/models/common/models/llama33_70b/hf_adaptor.pyConfiguration11.5 KB —
code/models/common/models/llama33_70b/model.pyConfiguration45.8 KB —
code/models/common/models/llama33_70b/weight_utils.pyConfiguration7.0 KB —
code/models/common/models/llama3_8b/executor.pyConfiguration24.0 KB —
code/models/common/models/llama3_8b/generator.pyConfiguration17.5 KB —
code/models/common/models/llama3_8b/hf_adaptor.pyConfiguration19.5 KB —
code/models/common/models/llama3_8b/model.pyConfiguration69.4 KB —
code/models/common/models/mistral_7b/__init__.pyConfiguration1.2 KB —
code/models/common/models/mistral_7b/executor.pyConfiguration26.9 KB —
code/models/common/models/mistral_7b/generator.pyConfiguration17.7 KB —
code/models/common/models/mistral_7b/hf_adaptor.pyConfiguration12.8 KB —
code/models/common/models/mistral_7b/model.pyConfiguration38.4 KB —
code/models/common/models/mistral_7b/weight_utils.pyConfiguration7.1 KB —
code/models/common/models/phi4/__init__.pyConfiguration1.1 KB —
code/models/common/models/phi4/executor.pyConfiguration26.8 KB —
code/models/common/models/phi4/generator.pyConfiguration17.6 KB —
code/models/common/models/phi4/hf_adaptor.pyConfiguration12.6 KB —
code/models/common/models/phi4/model.pyConfiguration38.0 KB —
code/models/common/models/phi4/weight_utils.pyConfiguration9.2 KB —
code/models/common/models/qwen25_72b/__init__.pyConfiguration1.2 KB —
code/models/common/models/qwen25_72b/executor.pyConfiguration21.6 KB —
code/models/common/models/qwen25_72b/generator.pyConfiguration13.7 KB —
code/models/common/models/qwen25_72b/hf_adaptor.pyConfiguration13.4 KB —
code/models/common/models/qwen25_72b/model.pyConfiguration50.9 KB —
code/models/common/models/qwen25_72b/weight_utils.pyConfiguration9.0 KB —
code/models/common/models/qwen25_72b/weights.pyConfiguration383 B —
code/models/common/models/qwen25_7b/__init__.pyConfiguration923 B —
code/models/common/models/qwen25_7b/executor.pyConfiguration26.8 KB —
code/models/common/models/qwen25_7b/generator.pyConfiguration17.6 KB —
code/models/common/models/qwen25_7b/hf_adaptor.pyConfiguration11.1 KB —
code/models/common/models/qwen25_7b/model.pyConfiguration47.4 KB —
code/models/common/models/qwen25_7b/weight_utils.pyConfiguration8.6 KB —
code/models/common/models/qwen25_coder_32b/__init__.pyConfiguration1.6 KB —
code/models/common/models/qwen25_coder_32b/demo.pyConfiguration23.8 KB —
code/models/common/models/qwen25_coder_32b/executor.pyConfiguration23.9 KB —
code/models/common/models/qwen25_coder_32b/generator.pyConfiguration13.9 KB —
code/models/common/models/qwen25_coder_32b/hf_adaptor.pyConfiguration13.5 KB —
code/models/common/models/qwen25_coder_32b/model.pyConfiguration57.4 KB —
code/models/common/models/qwen25_coder_32b/weight_utils.pyConfiguration8.8 KB —
code/models/common/models/qwen2_7b/__init__.pyConfiguration895 B —
code/models/common/models/qwen2_7b/executor.pyConfiguration26.8 KB —
code/models/common/models/qwen2_7b/generator.pyConfiguration17.6 KB —
code/models/common/models/qwen2_7b/hf_adaptor.pyConfiguration11.1 KB —
code/models/common/models/qwen2_7b/model.pyConfiguration48.4 KB —
code/models/common/models/qwen2_7b/weight_utils.pyConfiguration8.6 KB —
code/models/common/models/qwen3_32b/__init__.pyConfiguration896 B —
code/models/common/models/qwen3_32b/demo.pyConfiguration23.7 KB —
code/models/common/models/qwen3_32b/executor.pyConfiguration24.1 KB —
code/models/common/models/qwen3_32b/generator.pyConfiguration13.7 KB —
code/models/common/models/qwen3_32b/hf_adaptor.pyConfiguration10.3 KB —
code/models/common/models/qwen3_32b/model.pyConfiguration52.4 KB —
code/models/common/models/qwen3_32b/weight_utils.pyConfiguration11.0 KB —
code/models/common/modules/attention/attention_1d.pyConfiguration112.8 KB —
code/models/common/modules/embedding/embedding_1d.pyConfiguration9.7 KB —
code/models/common/modules/lazy_buffer.pyConfiguration7.0 KB —
code/models/common/modules/lazy_weight.pyConfiguration13.5 KB —
code/models/common/modules/lm_head/lm_head_1d.pyConfiguration15.0 KB —
code/models/common/modules/mlp/mlp_1d.pyConfiguration44.3 KB —
code/models/common/modules/mlp/mlp_2d.pyConfiguration33.3 KB —
code/models/common/modules/moe/configs/deepseek_ocr.yamlConfiguration934 B —
code/models/common/modules/moe/configs/deepseek_v3.yamlConfiguration740 B —
code/models/common/modules/moe/configs/deepseek_v3_single_glx.yamlConfiguration739 B —
code/models/common/modules/moe/configs/deepseek_v4_flash.yamlConfiguration1.1 KB —
code/models/common/modules/moe/configs/deepseek_v4_pro.yamlConfiguration1.1 KB —
code/models/common/modules/moe/configs/gemma_4_26b.yamlConfiguration1.7 KB —
code/models/common/modules/moe/configs/glm5.yamlConfiguration935 B —
code/models/common/modules/moe/configs/glm_47.yamlConfiguration1.1 KB —
code/models/common/modules/moe/configs/gpt_oss.yamlConfiguration1.2 KB —
code/models/common/modules/moe/configs/kimi_k25.yamlConfiguration968 B —
code/models/common/modules/moe/configs/ling_1t.yamlConfiguration834 B —
code/models/common/modules/moe/configs/mistral_large_3.yamlConfiguration846 B —
code/models/common/modules/moe/configs/qwen35_35b.yamlConfiguration814 B —
code/models/common/modules/moe/configs/qwen35_397b.yamlConfiguration1.1 KB —
code/models/common/modules/moe/configs/qwen3_235b.yamlConfiguration970 B —
code/models/common/modules/moe/configs/qwen3_omni_talker.yamlConfiguration1.1 KB —
code/models/common/modules/moe/configs/qwen3_omni_thinker.yamlConfiguration986 B —
code/models/common/modules/moe/tt_moe_decode.pyConfiguration47.0 KB —
code/models/common/modules/moe/tt_moe_decode_config.pyConfiguration35.4 KB —
code/models/common/modules/moe/tt_moe_decode_config_schemas.pyConfiguration4.1 KB —
code/models/common/modules/moe/tt_moe_gate.pyConfiguration49.3 KB —
code/models/common/modules/moe/tt_moe_gate_config.pyConfiguration5.2 KB —
code/models/common/modules/rmsnorm/rmsnorm_1d.pyConfiguration26.1 KB —
code/models/common/modules/rmsnorm/rmsnorm_2d.pyConfiguration18.7 KB —
code/models/common/modules/rope/rope_1d.pyConfiguration19.4 KB —
code/models/common/modules/sampling/penalties_1d.pyConfiguration24.2 KB —
code/models/common/modules/sampling/sampling_1d.pyConfiguration36.2 KB —
code/models/common/modules/tt_ccl.pyConfiguration6.9 KB —
code/models/common/reference_rope.pyConfiguration3.2 KB —
code/models/common/rmsnorm.pyConfiguration10.7 KB —
code/models/common/sampling/__init__.pyConfiguration941 B —
code/models/common/sampling/_utils.pyConfiguration1.3 KB —
code/models/common/sampling/generator.pyConfiguration50.2 KB —
code/models/common/sampling/sampling_params.pyConfiguration731 B —
code/models/common/sampling/tt_log_probs.pyConfiguration34.6 KB —
code/models/common/sampling/tt_penalties.pyConfiguration19.2 KB —
code/models/common/sampling/tt_sampling.pyConfiguration60.9 KB —
code/models/common/sampling/vocab_padding.pyConfiguration5.6 KB —
code/models/common/tensor_utils.pyConfiguration8.1 KB —
code/models/common/tests/conftest.pyConfiguration13.6 KB —
code/models/common/tests/demos/cleanup_utils.pyConfiguration3.1 KB —
code/models/common/tests/demos/deepseek_r1_distill_qwen_14b/__init__.pyConfiguration94 B —
code/models/common/tests/demos/deepseek_r1_distill_qwen_14b/demo.pyConfiguration63.2 KB —
code/models/common/tests/demos/deepseek_r1_distill_qwen_14b/generate_book_refpt.pyConfiguration6.0 KB —
code/models/common/tests/demos/llama32_1b/__init__.pyConfiguration91 B —
code/models/common/tests/demos/llama32_1b/demo.pyConfiguration52.8 KB —
code/models/common/tests/demos/llama32_3b/__init__.pyConfiguration91 B —
code/models/common/tests/demos/llama32_3b/demo.pyConfiguration53.2 KB —
code/models/common/tests/demos/llama33_70b/__init__.pyConfiguration91 B —
code/models/common/tests/demos/llama33_70b/demo.pyConfiguration44.6 KB —
code/models/common/tests/demos/llama3_8b/demo.pyConfiguration40.7 KB —
code/models/common/tests/demos/llama3_8b/demo_utils.pyConfiguration4.7 KB —
code/models/common/tests/demos/llama3_8b/sample_prompts/input_data_questions_prefill_128.jsonConfiguration12.6 KB —
code/models/common/tests/demos/mistral_7b/demo.pyConfiguration54.8 KB —
code/models/common/tests/demos/phi4/__init__.pyConfiguration94 B —
code/models/common/tests/demos/phi4/demo.pyConfiguration58.9 KB —
code/models/common/tests/demos/qwen25_72b/demo.pyConfiguration58.2 KB —
code/models/common/tests/demos/qwen25_72b/generate_controlled_refpt.pyConfiguration6.9 KB —
code/models/common/tests/demos/qwen25_7b/demo.pyConfiguration65.1 KB —
code/models/common/tests/demos/qwen25_coder_32b/demo.pyConfiguration58.5 KB —
code/models/common/tests/demos/qwen2_7b/__init__.pyConfiguration91 B —
code/models/common/tests/demos/qwen2_7b/demo.pyConfiguration64.2 KB —
code/models/common/tests/demos/qwen2_7b/generate_controlled_refpt.pyConfiguration5.4 KB —
code/models/common/tests/demos/qwen3_32b/demo.pyConfiguration62.6 KB —
code/models/common/tests/demos/run_helpers.pyConfiguration30.6 KB —
code/models/common/tests/demos/test_cleanup_utils.pyConfiguration5.6 KB —
code/models/common/tests/demos/test_run_helpers.pyConfiguration14.6 KB —
code/models/common/tests/host/test_metrics_pytorch_only.pyConfiguration2.5 KB —
code/models/common/tests/host/test_utility_functions_imports.pyConfiguration1.3 KB —
code/models/common/tests/llm_runtime/test_config.pyConfiguration4.5 KB —
code/models/common/tests/llm_runtime/test_decode_runtime.pyConfiguration24.8 KB —
code/models/common/tests/llm_runtime/test_execution.pyConfiguration31.8 KB —
code/models/common/tests/llm_runtime/test_executor_integration.pyConfiguration58.5 KB —
code/models/common/tests/llm_runtime/test_lane_group.pyConfiguration34.7 KB —
code/models/common/tests/llm_runtime/test_llama3_8b_integration.pyConfiguration33.1 KB —
code/models/common/tests/llm_runtime/test_llama3_8b_model_contract.pyConfiguration12.6 KB —
code/models/common/tests/llm_runtime/test_model_contract.pyConfiguration36.1 KB —
code/models/common/tests/llm_runtime/test_output_reader.pyConfiguration7.1 KB —
code/models/common/tests/llm_runtime/test_paged_kv_cache.pyConfiguration14.3 KB —
code/models/common/tests/llm_runtime/test_prefill_inputs.pyConfiguration5.9 KB —
code/models/common/tests/llm_runtime/test_prefill_runtime.pyConfiguration102.0 KB —
code/models/common/tests/llm_runtime/test_program_compiler.pyConfiguration9.2 KB —
code/models/common/tests/llm_runtime/test_tensor_resources.pyConfiguration2.3 KB —
code/models/common/tests/llm_runtime/test_trace_compiler.pyConfiguration17.8 KB —
code/models/common/tests/llm_runtime/test_vllm_adapter.pyConfiguration31.4 KB —
code/models/common/tests/llm_runtime/test_warmup.pyConfiguration36.4 KB —
code/models/common/tests/models/deepseek_r1_distill_qwen_14b/test_demo_contract.pyConfiguration17.6 KB —
code/models/common/tests/models/deepseek_r1_distill_qwen_14b/test_hf_adaptor.pyConfiguration11.2 KB —
code/models/common/tests/models/deepseek_r1_distill_qwen_14b/test_prefill_last_token_contract.pyConfiguration2.5 KB —
code/models/common/tests/models/llama32_1b/test_batched_prefill_postprocess.pyConfiguration3.3 KB —
code/models/common/tests/models/llama32_1b/test_demo_warmup.pyConfiguration5.2 KB —
code/models/common/tests/models/llama32_1b/test_hf_adaptor.pyConfiguration10.0 KB —
code/models/common/tests/models/llama32_3b/test_batched_prefill_postprocess.pyConfiguration3.3 KB —
code/models/common/tests/models/llama32_3b/test_demo_warmup.pyConfiguration8.3 KB —
code/models/common/tests/models/llama32_3b/test_hf_adaptor.pyConfiguration11.8 KB —
code/models/common/tests/models/llama33_70b/logits_oracle.pyConfiguration5.9 KB —
code/models/common/tests/models/llama33_70b/test_demo_contract.pyConfiguration5.9 KB —
code/models/common/tests/models/llama33_70b/test_hf_adaptor.pyConfiguration11.4 KB —
code/models/common/tests/models/llama33_70b/test_logits_oracle.pyConfiguration3.2 KB —
code/models/common/tests/models/llama33_70b/test_t3k_batched_prefill_correctness.pyConfiguration28.5 KB —
code/models/common/tests/models/mistral_7b/test_demo_contract.pyConfiguration10.0 KB —
code/models/common/tests/models/mistral_7b/test_hf_adaptor.pyConfiguration6.4 KB —
code/models/common/tests/models/mistral_7b/test_prefill_last_token_contract.pyConfiguration2.3 KB —
code/models/common/tests/models/phi4/test_demo_contract.pyConfiguration14.9 KB —
code/models/common/tests/models/phi4/test_hf_adaptor.pyConfiguration7.5 KB —
code/models/common/tests/models/qwen25_72b/test_demo_contract.pyConfiguration5.5 KB —
code/models/common/tests/models/qwen25_72b/test_hf_adaptor.pyConfiguration6.9 KB —
code/models/common/tests/models/qwen25_72b/test_model_runtime_surface.pyConfiguration5.2 KB —
code/models/common/tests/models/qwen25_7b/test_demo_contract.pyConfiguration16.2 KB —
code/models/common/tests/models/qwen25_7b/test_hf_adaptor.pyConfiguration10.2 KB —
code/models/common/tests/models/qwen25_coder_32b/test_demo_contract.pyConfiguration4.4 KB —
code/models/common/tests/models/qwen25_coder_32b/test_hf_adaptor.pyConfiguration7.0 KB —
code/models/common/tests/models/qwen25_coder_32b/test_model_runtime_surface.pyConfiguration5.2 KB —
code/models/common/tests/models/qwen2_7b/test_demo_contract.pyConfiguration16.1 KB —
code/models/common/tests/models/qwen2_7b/test_hf_adaptor.pyConfiguration10.1 KB —
code/models/common/tests/models/qwen3_32b/test_demo_contract.pyConfiguration5.6 KB —
code/models/common/tests/models/qwen3_32b/test_hf_adaptor.pyConfiguration4.4 KB —
code/models/common/tests/models/qwen3_32b/test_model_runtime_surface.pyConfiguration5.2 KB —
code/models/common/tests/modules/attention/profiling/test_attention_1d_profiling.pyConfiguration35.1 KB —
code/models/common/tests/modules/attention/test_attention_1d.pyConfiguration118.7 KB —
code/models/common/tests/modules/embedding/test_embedding_1d.pyConfiguration26.5 KB —
code/models/common/tests/modules/lm_head/test_lm_head_1d.pyConfiguration16.6 KB —
code/models/common/tests/modules/mlp/test_mlp_1d.pyConfiguration62.2 KB —
code/models/common/tests/modules/mlp/test_mlp_2d.pyConfiguration18.3 KB —
code/models/common/tests/modules/moe/test_generalized_moe_gate.pyConfiguration26.9 KB —
code/models/common/tests/modules/moe/test_tt_moe_decode.pyConfiguration26.6 KB —
code/models/common/tests/modules/moe/test_tt_moe_gate.pyConfiguration11.4 KB —
code/models/common/tests/modules/rmsnorm/test_rmsnorm_1d.pyConfiguration58.1 KB —
code/models/common/tests/modules/rmsnorm/test_rmsnorm_2d.pyConfiguration11.6 KB —
code/models/common/tests/modules/rope/test_rope_1d.pyConfiguration43.6 KB —
code/models/common/tests/modules/sampling/test_penalties_1d.pyConfiguration73.5 KB —
code/models/common/tests/modules/sampling/test_sampling_1d.pyConfiguration71.4 KB —
code/models/common/tests/modules/sampling/test_sampling_1d_release.pyConfiguration8.5 KB —
code/models/common/tests/modules/test_lazy_buffer.pyConfiguration8.3 KB —
code/models/common/tests/modules/test_tensor_utils.pyConfiguration11.7 KB —
code/models/common/tests/test_auto_compose.pyConfiguration16.5 KB —
code/models/common/tests/test_device_lock.pyConfiguration4.0 KB —
code/models/common/tests/test_distribute_as.pyConfiguration8.6 KB —
code/models/common/tests/test_lazy_weight.pyConfiguration38.5 KB —
code/models/common/tests/test_llama3_8b_hf_adaptor.pyConfiguration3.6 KB —
code/models/common/tests/test_mesh_fixture_policy.pyConfiguration1.4 KB —
code/models/common/tests/test_metrics.pyConfiguration27.4 KB —
code/models/common/tests/test_resume_offset_alignment.pyConfiguration7.7 KB —
code/models/common/tests/test_sampling.pyConfiguration70.7 KB —
code/models/common/tests/test_sampling_vocab_padding.pyConfiguration3.7 KB —
code/models/common/tests/test_tt_sampling.pyConfiguration96.1 KB —
code/models/common/tests/test_utils.pyConfiguration1.7 KB —
code/models/common/tests/test_validation_tools.pyConfiguration24.6 KB —
code/models/common/tests/utils.pyConfiguration682 B —
code/models/common/utility_functions.pyConfiguration46.6 KB —
code/models/common/utils.pyConfiguration2.6 KB —
code/models/common/validation_tools.pyConfiguration29.1 KB —
code/models/common/warmup/__init__.pyConfiguration175 B —
code/models/common/warmup/warmup_utils.pyConfiguration5.3 KB —
code/models/common/weight_cache.pyConfiguration20.7 KB —
code/models/demos/blackhole/qwen36/__init__.pyConfiguration —
code/models/demos/blackhole/qwen36/demo/__init__.pyConfiguration —
code/models/demos/blackhole/qwen36/demo/benchmark_vision.pyConfiguration8.5 KB —
code/models/demos/blackhole/qwen36/demo/sample_prompts/eval_frankenstein_long.jsonConfiguration1.3 KB —
code/models/demos/blackhole/qwen36/demo/sample_prompts/input_data_long_4k.jsonConfiguration15.9 KB —
code/models/demos/blackhole/qwen36/demo/sample_prompts/vision_demo.jsonConfiguration346 B —
code/models/demos/blackhole/qwen36/demo/sample_prompts/vision_multi_image.jsonConfiguration554 B —
code/models/demos/blackhole/qwen36/demo/sample_prompts/vision_text_only.jsonConfiguration180 B —
code/models/demos/blackhole/qwen36/demo/sample_prompts/vision_video.jsonConfiguration386 B —
code/models/demos/blackhole/qwen36/demo/text_demo.pyConfiguration53.9 KB —
code/models/demos/blackhole/qwen36/demo/vision_demo.pyConfiguration28.0 KB —
code/models/demos/blackhole/qwen36/server/__init__.pyConfiguration94 B —
code/models/demos/blackhole/qwen36/server/pd_app.pyConfiguration46.0 KB —
code/models/demos/blackhole/qwen36/tests/__init__.pyConfiguration —
code/models/demos/blackhole/qwen36/tests/conftest.pyConfiguration1.9 KB —
code/models/demos/blackhole/qwen36/tests/dflash2_stub.pyConfiguration5.6 KB —
code/models/demos/blackhole/qwen36/tests/hist_device_pack_canary.pyConfiguration7.1 KB —
code/models/demos/blackhole/qwen36/tests/hist_device_pack_scratch.pyConfiguration12.4 KB —
code/models/demos/blackhole/qwen36/tests/pcc_thresholds.jsonConfiguration781 B —
code/models/demos/blackhole/qwen36/tests/pd_dflash2_transfer_repro.pyConfiguration19.0 KB —
code/models/demos/blackhole/qwen36/tests/pd_export_paths_scratch.pyConfiguration8.3 KB —
code/models/demos/blackhole/qwen36/tests/pd_export_piecewise_check.pyConfiguration5.1 KB —
code/models/demos/blackhole/qwen36/tests/pd_hist_parity_flip_scratch.pyConfiguration3.7 KB —
code/models/demos/blackhole/qwen36/tests/pd_import_bitexact_check.pyConfiguration13.1 KB —
code/models/demos/blackhole/qwen36/tests/pd_kv_import_bitexact_check.pyConfiguration7.3 KB —
code/models/demos/blackhole/qwen36/tests/pd_mtp_transfer_repro.pyConfiguration21.7 KB —
code/models/demos/blackhole/qwen36/tests/pd_prefill_determinism.pyConfiguration3.8 KB —
code/models/demos/blackhole/qwen36/tests/pd_serving_repro.pyConfiguration6.2 KB —
code/models/demos/blackhole/qwen36/tests/pd_transfer_repro.pyConfiguration8.7 KB —
code/models/demos/blackhole/qwen36/tests/plain_bucket_repro.pyConfiguration6.1 KB —
code/models/demos/blackhole/qwen36/tests/profile_prefill_decode.pyConfiguration13.2 KB —
code/models/demos/blackhole/qwen36/tests/test_agmm_bench_scratch.pyConfiguration5.7 KB —
code/models/demos/blackhole/qwen36/tests/test_agmm_grid_scratch.pyConfiguration8.7 KB —
code/models/demos/blackhole/qwen36/tests/test_agmm_outproj_scratch.pyConfiguration5.4 KB —
code/models/demos/blackhole/qwen36/tests/test_agmm_roofline_scratch.pyConfiguration10.8 KB —
code/models/demos/blackhole/qwen36/tests/test_attention_decode_layout_bitexact.pyConfiguration13.7 KB —
code/models/demos/blackhole/qwen36/tests/test_attention_tp.pyConfiguration21.0 KB —
code/models/demos/blackhole/qwen36/tests/test_conv1d_blockmajor_scratch.pyConfiguration7.4 KB —
code/models/demos/blackhole/qwen36/tests/test_decode_bucketing.pyConfiguration40.3 KB —
code/models/demos/blackhole/qwen36/tests/test_decode_ccl_bench_scratch.pyConfiguration8.2 KB —
code/models/demos/blackhole/qwen36/tests/test_decode_fused_all_reduce_pcc.pyConfiguration11.6 KB —
code/models/demos/blackhole/qwen36/tests/test_decode_profile_scratch.pyConfiguration6.1 KB —
code/models/demos/blackhole/qwen36/tests/test_decode_proj_dram_sharded_bench_scratch.pyConfiguration10.4 KB —
code/models/demos/blackhole/qwen36/tests/test_decode_proj_dram_sharded_ref.pyConfiguration10.2 KB —
code/models/demos/blackhole/qwen36/tests/test_dflash2_cpu.pyConfiguration6.1 KB —
code/models/demos/blackhole/qwen36/tests/test_dflash2_spec_scratch.pyConfiguration33.8 KB —
code/models/demos/blackhole/qwen36/tests/test_dflash2_window_op.pyConfiguration4.3 KB —
code/models/demos/blackhole/qwen36/tests/test_factory.pyConfiguration10.7 KB —
code/models/demos/blackhole/qwen36/tests/test_fused_all_reduce_scratch.pyConfiguration12.8 KB —
code/models/demos/blackhole/qwen36/tests/test_fused_all_reduce_scratch2.pyConfiguration8.5 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_decode_batched_scratch.pyConfiguration6.2 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_bitexact_scratch.pyConfiguration8.1 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_debug_scratch.pyConfiguration3.4 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_multitoken_scratch.pyConfiguration14.4 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_multitoken_timing_scratch.pyConfiguration5.1 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_scratch.pyConfiguration11.2 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_decode_step_timing_scratch.pyConfiguration4.1 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_gated_norm_scratch.pyConfiguration6.3 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_glue_scratch.pyConfiguration7.2 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_kda_masked_scratch.pyConfiguration24.3 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_paths_scratch.pyConfiguration6.1 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_prep_bitexact_scratch.pyConfiguration8.9 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_scan_bench_scratch.pyConfiguration3.3 KB —
code/models/demos/blackhole/qwen36/tests/test_gdn_tp.pyConfiguration28.6 KB —
code/models/demos/blackhole/qwen36/tests/test_generate_tp.pyConfiguration2.3 KB —
code/models/demos/blackhole/qwen36/tests/test_masked_bucket_trace_helpers_scratch.pyConfiguration12.6 KB —
code/models/demos/blackhole/qwen36/tests/test_masked_bucket_trace_scratch.pyConfiguration12.1 KB —
code/models/demos/blackhole/qwen36/tests/test_mlp.pyConfiguration3.2 KB —
code/models/demos/blackhole/qwen36/tests/test_mlp_tp.pyConfiguration4.3 KB —
code/models/demos/blackhole/qwen36/tests/test_model.pyConfiguration7.0 KB —
code/models/demos/blackhole/qwen36/tests/test_model_tp.pyConfiguration44.8 KB —
code/models/demos/blackhole/qwen36/tests/test_mtp_cpu.pyConfiguration10.5 KB —
code/models/demos/blackhole/qwen36/tests/test_mtp_spec_scratch.pyConfiguration31.2 KB —
code/models/demos/blackhole/qwen36/tests/test_outcol_cache_scratch.pyConfiguration2.5 KB —
code/models/demos/blackhole/qwen36/tests/test_patch_merger.pyConfiguration3.5 KB —
code/models/demos/blackhole/qwen36/tests/test_pd_app.pyConfiguration16.6 KB —
code/models/demos/blackhole/qwen36/tests/test_pd_export_pieces.pyConfiguration8.3 KB —
code/models/demos/blackhole/qwen36/tests/test_prefill.pyConfiguration16.0 KB —
code/models/demos/blackhole/qwen36/tests/test_prefill_grouped_trace.pyConfiguration21.8 KB —
code/models/demos/blackhole/qwen36/tests/test_prefill_kernels_ref_scratch.pyConfiguration9.6 KB —
code/models/demos/blackhole/qwen36/tests/test_prefill_profile_scratch.pyConfiguration5.8 KB —
code/models/demos/blackhole/qwen36/tests/test_prefill_smallm_ref_scratch.pyConfiguration10.0 KB —
code/models/demos/blackhole/qwen36/tests/test_reduce_max_wide_row_repro_scratch.pyConfiguration5.9 KB —
code/models/demos/blackhole/qwen36/tests/test_rope_tp.pyConfiguration6.1 KB —
code/models/demos/blackhole/qwen36/tests/test_rs_bench_scratch.pyConfiguration3.8 KB —
code/models/demos/blackhole/qwen36/tests/test_sampling.pyConfiguration4.0 KB —
code/models/demos/blackhole/qwen36/tests/test_sampling_topk_vs_argmax.pyConfiguration20.4 KB —
code/models/demos/blackhole/qwen36/tests/test_sdpa_chunked_bench_scratch.pyConfiguration8.6 KB —
code/models/demos/blackhole/qwen36/tests/test_small_m_prefill_helpers.pyConfiguration3.3 KB —
code/models/demos/blackhole/qwen36/tests/test_smallm_ag_bench_scratch.pyConfiguration5.5 KB —
code/models/demos/blackhole/qwen36/tests/test_smallm_prefill_matmul_bench_scratch.pyConfiguration15.1 KB —
code/models/demos/blackhole/qwen36/tests/test_spec_adapt_scratch.pyConfiguration28.3 KB —
code/models/demos/blackhole/qwen36/tests/test_spec_serving_cpu.pyConfiguration67.8 KB —
code/models/demos/blackhole/qwen36/tests/test_spec_serving_scratch.pyConfiguration28.7 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_attn_batched_scratch.pyConfiguration19.1 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_attn_modes_scratch.pyConfiguration15.8 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_aux_scratch.pyConfiguration11.5 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_grid.pyConfiguration6.0 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_probe_scratch.pyConfiguration11.6 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_rowdiag_scratch.pyConfiguration3.9 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_rowpos_probe_scratch.pyConfiguration9.1 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_rs_probe_scratch.pyConfiguration5.3 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_step1_scratch.pyConfiguration8.7 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_step_scratch.pyConfiguration33.3 KB —
code/models/demos/blackhole/qwen36/tests/test_verify_w32_isolation_scratch.pyConfiguration15.4 KB —
code/models/demos/blackhole/qwen36/tests/test_vision_attention.pyConfiguration6.3 KB —
code/models/demos/blackhole/qwen36/tests/test_vision_block.pyConfiguration7.0 KB —
code/models/demos/blackhole/qwen36/tests/test_weight_mapping.pyConfiguration9.5 KB —
code/models/demos/blackhole/qwen36/tests/test_wrapped_model.pyConfiguration4.2 KB —
code/models/demos/blackhole/qwen36/tests/unit/__init__.pyConfiguration —
code/models/demos/blackhole/qwen36/tests/unit/conftest.pyConfiguration2.0 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_attention.pyConfiguration3.2 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_embedding.pyConfiguration1.8 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_gdn.pyConfiguration3.6 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_layer.pyConfiguration4.2 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_lm_head.pyConfiguration2.3 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_mlp.pyConfiguration1.7 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_model.pyConfiguration8.1 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_rms_norm.pyConfiguration4.9 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_rope.pyConfiguration7.9 KB —
code/models/demos/blackhole/qwen36/tests/unit/test_substate.pyConfiguration740 B —
code/models/demos/blackhole/qwen36/tt-model.yamlConfiguration10.1 KB —
code/models/demos/blackhole/qwen36/tt/__init__.pyConfiguration —
code/models/demos/blackhole/qwen36/tt/attention/__init__.pyConfiguration536 B —
code/models/demos/blackhole/qwen36/tt/attention/config.pyConfiguration568 B —
code/models/demos/blackhole/qwen36/tt/attention/decode.pyConfiguration1.5 KB —
code/models/demos/blackhole/qwen36/tt/attention/gated_attention.pyConfiguration4.6 KB —
code/models/demos/blackhole/qwen36/tt/attention/prefill.pyConfiguration3.1 KB —
code/models/demos/blackhole/qwen36/tt/attention/rope_tp.pyConfiguration17.2 KB —
code/models/demos/blackhole/qwen36/tt/attention/tp.pyConfiguration62.0 KB —
code/models/demos/blackhole/qwen36/tt/attention/weights.pyConfiguration1.5 KB —
code/models/demos/blackhole/qwen36/tt/aux_hidden.pyConfiguration28.4 KB —
code/models/demos/blackhole/qwen36/tt/common.pyConfiguration2.6 KB —
code/models/demos/blackhole/qwen36/tt/dflash2_head.pyConfiguration79.4 KB —
code/models/demos/blackhole/qwen36/tt/gdn/__init__.pyConfiguration521 B —
code/models/demos/blackhole/qwen36/tt/gdn/config.pyConfiguration968 B —
code/models/demos/blackhole/qwen36/tt/gdn/decode.pyConfiguration5.6 KB —
code/models/demos/blackhole/qwen36/tt/gdn/fused_chunk.pyConfiguration10.3 KB —
code/models/demos/blackhole/qwen36/tt/gdn/gated_deltanet.pyConfiguration5.0 KB —
code/models/demos/blackhole/qwen36/tt/gdn/state.pyConfiguration1.9 KB —
code/models/demos/blackhole/qwen36/tt/gdn/tp.pyConfiguration139.6 KB —
code/models/demos/blackhole/qwen36/tt/gdn/weights.pyConfiguration12.6 KB —
code/models/demos/blackhole/qwen36/tt/generator_interface.pyConfiguration6.3 KB —
code/models/demos/blackhole/qwen36/tt/layer.pyConfiguration18.8 KB —
code/models/demos/blackhole/qwen36/tt/masked_bucket_trace.pyConfiguration14.0 KB —
code/models/demos/blackhole/qwen36/tt/mlp.pyConfiguration25.9 KB —
code/models/demos/blackhole/qwen36/tt/model.pyConfiguration278.0 KB —
code/models/demos/blackhole/qwen36/tt/model_config.pyConfiguration31.0 KB —
code/models/demos/blackhole/qwen36/tt/mtp_head.pyConfiguration59.3 KB —
code/models/demos/blackhole/qwen36/tt/pd_transfer.pyConfiguration86.6 KB —
code/models/demos/blackhole/qwen36/tt/qwen36_vllm.pyConfiguration47.9 KB —
code/models/demos/blackhole/qwen36/tt/rms_norm.pyConfiguration738 B —
code/models/demos/blackhole/qwen36/tt/rope.pyConfiguration11.2 KB —
code/models/demos/blackhole/qwen36/tt/spec_decoder.pyConfiguration36.0 KB —
code/models/demos/blackhole/qwen36/tt/spec_serving.pyConfiguration53.1 KB —
code/models/demos/blackhole/qwen36/tt/tp_common.pyConfiguration62.7 KB —
code/models/demos/blackhole/qwen36/tt/verify_grid.pyConfiguration13.4 KB —
code/models/demos/blackhole/qwen36/tt/verify_step.pyConfiguration50.2 KB —
code/models/demos/blackhole/qwen36/tt/vision/__init__.pyConfiguration91 B —
code/models/demos/blackhole/qwen36/tt/vision/functional.pyConfiguration7.4 KB —
code/models/demos/blackhole/qwen36/tt/vision/model.pyConfiguration13.8 KB —
code/models/demos/blackhole/qwen36/tt/vision/patch_merger.pyConfiguration9.2 KB —
code/models/demos/blackhole/qwen36/tt/vision/vision_attention.pyConfiguration18.9 KB —
code/models/demos/blackhole/qwen36/tt/vision/vision_block.pyConfiguration4.2 KB —
code/models/demos/blackhole/qwen36/tt/vision/vision_distributed_layernorm.pyConfiguration3.4 KB —
code/models/demos/blackhole/qwen36/tt/vision/vision_layernorm.pyConfiguration4.6 KB —
code/models/demos/blackhole/qwen36/tt/vision/vision_mlp.pyConfiguration7.6 KB —
code/models/demos/blackhole/qwen36/tt/vision/vision_model_config.pyConfiguration7.0 KB —
code/models/demos/blackhole/qwen36/tt/weight_mapping.pyConfiguration11.1 KB —
code/models/demos/blackhole/qwen36/utils/__init__.pyConfiguration —
code/models/demos/blackhole/qwen36/utils/substate.pyConfiguration1.1 KB —
code/models/demos/qwen3_vl/tt/common.pyConfiguration24.4 KB —
code/models/demos/utils/common_demo_utils.pyConfiguration20.7 KB —
code/models/demos/utils/device_sku.pyConfiguration1.4 KB —
code/models/demos/utils/llm_demo_utils.pyConfiguration14.9 KB —
code/models/demos/utils/model_targets.pyConfiguration7.2 KB —
code/models/demos/utils/qa_pipeline_compat.pyConfiguration22.6 KB —
code/models/demos/utils/trace_region_sizes.pyConfiguration7.5 KB —
code/models/experimental/gated_attention_gated_deltanet/tests/__init__.pyConfiguration —
code/models/experimental/gated_attention_gated_deltanet/tests/bench_concat_heads.pyConfiguration6.4 KB —
code/models/experimental/gated_attention_gated_deltanet/tests/sweep_seq_len.pyConfiguration8.4 KB —
code/models/experimental/gated_attention_gated_deltanet/tests/test_gated_attention.pyConfiguration6.4 KB —
code/models/experimental/gated_attention_gated_deltanet/tests/test_gated_deltanet.pyConfiguration8.8 KB —
code/models/experimental/gated_attention_gated_deltanet/tests/test_ttnn_validation.pyConfiguration21.4 KB —
code/models/experimental/gated_attention_gated_deltanet/torch_functional/__init__.pyConfiguration —
code/models/experimental/gated_attention_gated_deltanet/torch_functional/delta_rule_ops.pyConfiguration8.2 KB —
code/models/experimental/gated_attention_gated_deltanet/torch_functional/gated_attention.pyConfiguration6.8 KB —
code/models/experimental/gated_attention_gated_deltanet/torch_functional/gated_deltanet.pyConfiguration6.8 KB —
code/models/experimental/gated_attention_gated_deltanet/tt/__init__.pyConfiguration —
code/models/experimental/gated_attention_gated_deltanet/tt/ttnn_delta_rule_ops.pyConfiguration18.5 KB —
code/models/experimental/gated_attention_gated_deltanet/tt/ttnn_delta_rule_seq.pyConfiguration31.7 KB —
code/models/experimental/gated_attention_gated_deltanet/tt/ttnn_gated_attention.pyConfiguration26.2 KB —
code/models/experimental/gated_attention_gated_deltanet/tt/ttnn_gated_deltanet.pyConfiguration29.3 KB —
code/models/model_targets.yamlConfiguration52.1 KB —
code/models/model_trace_region_sizes.yamlConfiguration10.7 KB —
code/models/perf/benchmarking_utils.pyConfiguration8.4 KB —
code/models/perf/device_perf_utils.pyConfiguration18.2 KB —
code/models/perf/merge_device_perf_results.pyConfiguration2.3 KB —
code/models/perf/merge_perf_results.pyConfiguration2.1 KB —
code/models/perf/perf_utils.pyConfiguration10.2 KB —
code/models/tt_dit/utils/tensor.pyConfiguration35.8 KB —
code/models/tt_transformers/conftest.pyConfiguration1.4 KB —
code/models/tt_transformers/demo/config_16_decoders.jsonConfiguration2.8 KB —
code/models/tt_transformers/demo/conftest.pyConfiguration4.3 KB —
code/models/tt_transformers/demo/input_data_questions_reasoning.jsonConfiguration922 B —
code/models/tt_transformers/demo/multimodal_demo_chat.pyConfiguration3.1 KB —
code/models/tt_transformers/demo/multimodal_demo_text.pyConfiguration3.7 KB —
code/models/tt_transformers/demo/sample_prompts/eval_repeat_prompts_batch1.jsonConfiguration10.4 KB —
code/models/tt_transformers/demo/sample_prompts/eval_repeat_prompts_batch32.jsonConfiguration11.6 KB —
code/models/tt_transformers/demo/sample_prompts/expected_vision_input_data_llama32_11B.jsonConfiguration3.1 KB —
code/models/tt_transformers/demo/sample_prompts/expected_vision_input_data_llama32_90B.jsonConfiguration2.7 KB —
code/models/tt_transformers/demo/sample_prompts/expected_vision_input_data_w_text_only_llama32_11B.jsonConfiguration3.6 KB —
code/models/tt_transformers/demo/sample_prompts/expected_vision_input_data_w_text_only_llama32_90B.jsonConfiguration2.8 KB —
code/models/tt_transformers/demo/sample_prompts/input_data_long_128k.jsonConfiguration493 B —
code/models/tt_transformers/demo/sample_prompts/input_data_long_16k.jsonConfiguration522 B —
code/models/tt_transformers/demo/sample_prompts/input_data_long_1k.jsonConfiguration521 B —
code/models/tt_transformers/demo/sample_prompts/input_data_long_256k.jsonConfiguration522 B —
code/models/tt_transformers/demo/sample_prompts/input_data_long_2k.jsonConfiguration521 B —
code/models/tt_transformers/demo/sample_prompts/input_data_long_32k.jsonConfiguration523 B —
code/models/tt_transformers/demo/sample_prompts/input_data_long_4k.jsonConfiguration522 B —
code/models/tt_transformers/demo/sample_prompts/input_data_long_64k.jsonConfiguration523 B —
code/models/tt_transformers/demo/sample_prompts/input_data_long_8k.jsonConfiguration522 B —
code/models/tt_transformers/demo/sample_prompts/input_data_prefill_128.jsonConfiguration30.2 KB —
code/models/tt_transformers/demo/sample_prompts/input_data_questions_prefill_128.jsonConfiguration12.6 KB —
code/models/tt_transformers/demo/sample_prompts/input_data_questions_prefill_256.jsonConfiguration24.2 KB —
code/models/tt_transformers/demo/sample_prompts/vision_input_data.jsonConfiguration968 B —
code/models/tt_transformers/demo/sample_prompts/vision_input_data_trace.jsonConfiguration914 B —
code/models/tt_transformers/demo/sample_prompts/vision_input_data_w_text_only.jsonConfiguration670 B —
code/models/tt_transformers/demo/simple_text_demo.pyConfiguration83.4 KB —
code/models/tt_transformers/demo/simple_vision_demo.pyConfiguration28.8 KB —
code/models/tt_transformers/demo/trace_region_config.pyConfiguration4.2 KB —
code/models/tt_transformers/host_mem_profiler.pyConfiguration7.3 KB —
code/models/tt_transformers/model_params/LFM2.5-VL-1.6B/config.jsonConfiguration2.4 KB —
code/models/tt_transformers/model_params/Llama-3.1-70B-Instruct/config.jsonConfiguration855 B —
code/models/tt_transformers/model_params/Llama-3.1-70B-Instruct/params.jsonConfiguration226 B —
code/models/tt_transformers/model_params/Llama-3.1-70B-Instruct/tensor_states.jsonConfiguration80.9 KB —
code/models/tt_transformers/model_params/Llama-3.1-8B-Instruct/config.jsonConfiguration855 B —
code/models/tt_transformers/model_params/Llama-3.1-8B-Instruct/params.jsonConfiguration226 B —
code/models/tt_transformers/model_params/Llama-3.1-8B-Instruct/performance_decoder_config.jsonConfiguration221 B —
code/models/tt_transformers/model_params/Llama-3.2-11B-Vision-Instruct/config.jsonConfiguration5.1 KB —
code/models/tt_transformers/model_params/Llama-3.2-11B-Vision-Instruct/params.jsonConfiguration350 B —
code/models/tt_transformers/model_params/Llama-3.2-1B-Instruct/config.jsonConfiguration877 B —
code/models/tt_transformers/model_params/Llama-3.2-1B-Instruct/params.jsonConfiguration250 B —
code/models/tt_transformers/model_params/Llama-3.2-3B-Instruct/config.jsonConfiguration878 B —
code/models/tt_transformers/model_params/Llama-3.2-3B-Instruct/params.jsonConfiguration250 B —
code/models/tt_transformers/model_params/Llama-3.2-90B-Instruct/accuracy_decoder_config.jsonConfiguration40.8 KB —
code/models/tt_transformers/model_params/Llama-3.2-90B-Instruct/performance_decoder_config.jsonConfiguration40.8 KB —
code/models/tt_transformers/model_params/Llama-3.2-90B-Vision-Instruct/config.jsonConfiguration5.2 KB —
code/models/tt_transformers/model_params/Llama-3.2-90B-Vision-Instruct/params.jsonConfiguration323 B —
code/models/tt_transformers/model_params/Llama-3.2-90B-Vision-Instruct/tensor_states.jsonConfiguration196.5 KB —
code/models/tt_transformers/model_params/Meta-Llama-3-8B/config.jsonConfiguration654 B —
code/models/tt_transformers/model_params/Mistral-7B-Instruct-v0.3/config.jsonConfiguration1.8 KB —
code/models/tt_transformers/model_params/Qwen2.5-32B-Instruct/config.jsonConfiguration664 B —
code/models/tt_transformers/model_params/Qwen2.5-72B-Instruct/config.jsonConfiguration663 B —
code/models/tt_transformers/model_params/Qwen2.5-7B-Instruct/accuracy_decoder_config.jsonConfiguration10.9 KB —
code/models/tt_transformers/model_params/Qwen2.5-7B-Instruct/performance_decoder_config.jsonConfiguration10.9 KB —
code/models/tt_transformers/model_params/Qwen2.5-VL-32B-Instruct/config.jsonConfiguration1.2 KB —
code/models/tt_transformers/model_params/Qwen2.5-VL-3B-Instruct/config.jsonConfiguration1.4 KB —
code/models/tt_transformers/model_params/Qwen2.5-VL-72B-Instruct/config.jsonConfiguration1.4 KB —
code/models/tt_transformers/model_params/Qwen2.5-VL-7B-Instruct/performance_decoder_config.jsonConfiguration10.9 KB —
code/models/tt_transformers/model_params/Qwen3-32B/config.jsonConfiguration729 B —
code/models/tt_transformers/model_params/Qwen3-VL-32B-Instruct/config.jsonConfiguration1.5 KB —
code/models/tt_transformers/model_params/Qwen3.6-27B/config.jsonConfiguration4.3 KB —
code/models/tt_transformers/model_params/gemma-3-27b-it/accuracy_decoder_config.jsonConfiguration6.7 KB —
code/models/tt_transformers/model_params/phi-4/accuracy_decoder_config.jsonConfiguration232 B —
code/models/tt_transformers/model_params/phi-4/config.jsonConfiguration826 B —
code/models/tt_transformers/model_params/phi-4/params.jsonConfiguration190 B —
code/models/tt_transformers/scripts/op_perf_results.pyConfiguration7.8 KB —
code/models/tt_transformers/scripts/repack_weights_70b.pyConfiguration3.8 KB —
code/models/tt_transformers/scripts/repack_weights_90b.pyConfiguration7.6 KB —
code/models/tt_transformers/tests/configurations/conf0.jsonConfiguration5.9 KB —
code/models/tt_transformers/tests/configurations/conf1.jsonConfiguration5.9 KB —
code/models/tt_transformers/tests/configurations/conf2.jsonConfiguration5.9 KB —
code/models/tt_transformers/tests/configurations/conf3.jsonConfiguration5.8 KB —
code/models/tt_transformers/tests/conftest.pyConfiguration1.9 KB —
code/models/tt_transformers/tests/decode_test_helpers.pyConfiguration1.1 KB —
code/models/tt_transformers/tests/generate_reference_hf.pyConfiguration6.6 KB —
code/models/tt_transformers/tests/generate_reference_outputs.pyConfiguration7.9 KB —
code/models/tt_transformers/tests/mixtral/test_mixtral_decoder.pyConfiguration6.6 KB —
code/models/tt_transformers/tests/mixtral/test_mixtral_decoder_prefill.pyConfiguration7.4 KB —
code/models/tt_transformers/tests/mixtral/test_mixtral_mlp.pyConfiguration5.3 KB —
code/models/tt_transformers/tests/mixtral/test_mixtral_model.pyConfiguration18.1 KB —
code/models/tt_transformers/tests/mixtral/test_mixtral_model_prefill.pyConfiguration10.8 KB —
code/models/tt_transformers/tests/mixtral/test_mixtral_moe.pyConfiguration5.5 KB —
code/models/tt_transformers/tests/mixtral/test_mixtral_rms_norm.pyConfiguration3.0 KB —
code/models/tt_transformers/tests/mixtral/utils.pyConfiguration2.0 KB —
code/models/tt_transformers/tests/multimodal/mistral_24b/test_conv2d.pyConfiguration3.4 KB —
code/models/tt_transformers/tests/multimodal/mistral_24b/test_patch_rot_emb.pyConfiguration2.5 KB —
code/models/tt_transformers/tests/multimodal/mistral_24b/test_pixtral_transformer.pyConfiguration3.9 KB —
code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_attention.pyConfiguration3.9 KB —
code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_mlp.pyConfiguration2.6 KB —
code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_model.pyConfiguration3.3 KB —
code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_rms.pyConfiguration2.6 KB —
code/models/tt_transformers/tests/multimodal/mistral_24b/test_vision_tower.pyConfiguration2.5 KB —
code/models/tt_transformers/tests/multimodal/test_llama_class_embedding.pyConfiguration4.3 KB —
code/models/tt_transformers/tests/multimodal/test_llama_conv2d_patch.pyConfiguration4.2 KB —
code/models/tt_transformers/tests/multimodal/test_llama_cross_attention.pyConfiguration12.2 KB —
code/models/tt_transformers/tests/multimodal/test_llama_cross_attention_transformer_text.pyConfiguration18.3 KB —
code/models/tt_transformers/tests/multimodal/test_llama_cross_attention_transformer_vision.pyConfiguration7.3 KB —
code/models/tt_transformers/tests/multimodal/test_llama_cross_block.pyConfiguration13.5 KB —
code/models/tt_transformers/tests/multimodal/test_llama_image_attention.pyConfiguration5.2 KB —
code/models/tt_transformers/tests/multimodal/test_llama_image_block.pyConfiguration5.3 KB —
code/models/tt_transformers/tests/multimodal/test_llama_image_mlp.pyConfiguration3.7 KB —
code/models/tt_transformers/tests/multimodal/test_llama_image_transformer.pyConfiguration7.0 KB —
code/models/tt_transformers/tests/multimodal/test_llama_layernorm.pyConfiguration3.1 KB —
code/models/tt_transformers/tests/multimodal/test_llama_positional_embedding.pyConfiguration5.2 KB —
code/models/tt_transformers/tests/multimodal/test_llama_tile_position_embedding.pyConfiguration6.0 KB —
code/models/tt_transformers/tests/multimodal/test_llama_vision_encoder.pyConfiguration4.5 KB —
code/models/tt_transformers/tests/multimodal/utils.pyConfiguration1.3 KB —
code/models/tt_transformers/tests/test_attention.pyConfiguration12.1 KB —
code/models/tt_transformers/tests/test_attention_prefill.pyConfiguration10.5 KB —
code/models/tt_transformers/tests/test_attention_utils.pyConfiguration4.1 KB —
code/models/tt_transformers/tests/test_batched_prefill_slots.pyConfiguration5.5 KB —
code/models/tt_transformers/tests/test_ccl_utils.pyConfiguration2.8 KB —
code/models/tt_transformers/tests/test_chunked_generation.pyConfiguration6.8 KB —
code/models/tt_transformers/tests/test_ci_dispatch.pyConfiguration1.9 KB —
code/models/tt_transformers/tests/test_decode_test_helpers.pyConfiguration1.8 KB —
code/models/tt_transformers/tests/test_decoder.pyConfiguration9.4 KB —
code/models/tt_transformers/tests/test_decoder_prefill.pyConfiguration8.4 KB —
code/models/tt_transformers/tests/test_device_perf.pyConfiguration15.9 KB —
code/models/tt_transformers/tests/test_distributed_norm_utils.pyConfiguration1.6 KB —
code/models/tt_transformers/tests/test_embedding.pyConfiguration3.4 KB —
code/models/tt_transformers/tests/test_hybrid_attention_for_causal_lm.pyConfiguration6.0 KB —
code/models/tt_transformers/tests/test_interleaved_to_sharded.pyConfiguration3.1 KB —
code/models/tt_transformers/tests/test_llama90b_decoder_json.pyConfiguration2.9 KB —
code/models/tt_transformers/tests/test_lm_head.pyConfiguration3.6 KB —
code/models/tt_transformers/tests/test_lm_head_cache.pyConfiguration1.1 KB —
code/models/tt_transformers/tests/test_load_checkpoints.pyConfiguration3.7 KB —
code/models/tt_transformers/tests/test_mha_wo_sharding.pyConfiguration2.5 KB —
code/models/tt_transformers/tests/test_mlp.pyConfiguration4.4 KB —
code/models/tt_transformers/tests/test_model.pyConfiguration21.9 KB —
code/models/tt_transformers/tests/test_model_config_utils.pyConfiguration6.5 KB —
code/models/tt_transformers/tests/test_model_prefill.pyConfiguration13.2 KB —
code/models/tt_transformers/tests/test_ref.pyConfiguration3.2 KB —
code/models/tt_transformers/tests/test_rms_norm.pyConfiguration3.8 KB —
code/models/tt_transformers/tests/test_rope.pyConfiguration6.4 KB —
code/models/tt_transformers/tests/test_rope_utils.pyConfiguration653 B —
code/models/tt_transformers/tests/test_torch.pyConfiguration2.6 KB —
code/models/tt_transformers/tests/test_trace_region_sizes.pyConfiguration8.2 KB —
code/models/tt_transformers/tests/test_utils.pyConfiguration17.2 KB —
code/models/tt_transformers/tests/test_vllm_kv_cache.pyConfiguration5.5 KB —
code/models/tt_transformers/tests/test_warm_cache_marker.pyConfiguration19.4 KB —
code/models/tt_transformers/tt/attention.pyConfiguration63.3 KB —
code/models/tt_transformers/tt/ccl.pyConfiguration18.0 KB —
code/models/tt_transformers/tt/common.pyConfiguration40.7 KB —
code/models/tt_transformers/tt/decoder.pyConfiguration16.1 KB —
code/models/tt_transformers/tt/distributed_norm.pyConfiguration8.4 KB —
code/models/tt_transformers/tt/embedding.pyConfiguration3.5 KB —
code/models/tt_transformers/tt/generator.pyConfiguration174.6 KB —
code/models/tt_transformers/tt/generator_sglang.pyConfiguration10.9 KB —
code/models/tt_transformers/tt/generator_vllm.pyConfiguration47.4 KB —
code/models/tt_transformers/tt/lm_head.pyConfiguration13.4 KB —
code/models/tt_transformers/tt/load_checkpoints.pyConfiguration42.1 KB —
code/models/tt_transformers/tt/mixtral_mlp.pyConfiguration6.7 KB —
code/models/tt_transformers/tt/mixtral_moe.pyConfiguration6.8 KB —
code/models/tt_transformers/tt/mlp.pyConfiguration18.8 KB —
code/models/tt_transformers/tt/model.pyConfiguration44.0 KB —
code/models/tt_transformers/tt/model_config.pyConfiguration244.5 KB —
code/models/tt_transformers/tt/multimodal/llama_class_embedding.pyConfiguration1.5 KB —
code/models/tt_transformers/tt/multimodal/llama_conv2d_patch.pyConfiguration3.7 KB —
code/models/tt_transformers/tt/multimodal/llama_cross_attention.pyConfiguration16.2 KB —
code/models/tt_transformers/tt/multimodal/llama_cross_attention_transformer_text.pyConfiguration14.7 KB —
code/models/tt_transformers/tt/multimodal/llama_cross_attention_transformer_vision.pyConfiguration4.5 KB —
code/models/tt_transformers/tt/multimodal/llama_cross_block.pyConfiguration5.9 KB —
code/models/tt_transformers/tt/multimodal/llama_image_attention.pyConfiguration11.8 KB —
code/models/tt_transformers/tt/multimodal/llama_image_block.pyConfiguration3.8 KB —
code/models/tt_transformers/tt/multimodal/llama_image_mlp.pyConfiguration5.0 KB —
code/models/tt_transformers/tt/multimodal/llama_image_transformer.pyConfiguration1.9 KB —
code/models/tt_transformers/tt/multimodal/llama_layernorm.pyConfiguration4.7 KB —
code/models/tt_transformers/tt/multimodal/llama_positional_embedding.pyConfiguration5.0 KB —
code/models/tt_transformers/tt/multimodal/llama_tile_position_embedding.pyConfiguration4.3 KB —
code/models/tt_transformers/tt/multimodal/llama_vision_encoder.pyConfiguration9.8 KB —
code/models/tt_transformers/tt/multimodal/llama_vision_model.pyConfiguration47.3 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/mistral_e2e_model.pyConfiguration5.5 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/mistral_vision_tower.pyConfiguration5.9 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/rmsnorm.pyConfiguration7.9 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/vision_attention.pyConfiguration10.1 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/vision_conv2d.pyConfiguration3.3 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/vision_mlp.pyConfiguration3.0 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/vision_mmp.pyConfiguration6.6 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/vision_model.pyConfiguration1.7 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/vision_pixtral_image_block.pyConfiguration2.9 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/vision_pixtral_transformer.pyConfiguration2.1 KB —
code/models/tt_transformers/tt/multimodal/mistral_24b/vision_rope.pyConfiguration3.9 KB —
code/models/tt_transformers/tt/prefetcher.pyConfiguration25.8 KB —
code/models/tt_transformers/tt/prefetcher/prefetcher_config.yamlConfiguration1.3 KB —
code/models/tt_transformers/tt/rope.pyConfiguration43.1 KB —
image/index.jsonConfiguration384 B —
image/manifest.jsonConfiguration1.9 KB —
tt_kernel_manifest.jsonConfiguration8.6 KB —
README.mdDocumentation26.0 KB —
code/models/common/LICENSE-Llama-3.1Documentation7.7 KB —
code/models/common/README.mdDocumentation11.7 KB —
code/models/common/llm_runtime/README.mdDocumentation23.7 KB —
code/models/common/llm_runtime/prefill/README.mdDocumentation13.2 KB —
code/models/common/llm_runtime/tttv2_demo_to_vllm_integration_skill.mdDocumentation23.9 KB —
code/models/common/models/llama3_8b/README.mdDocumentation16.6 KB —
code/models/common/modules/README.mdDocumentation11.9 KB —
code/models/common/modules/moe/configs/models_table.mdDocumentation3.3 KB —
code/models/common/sampling/README.mdDocumentation5.8 KB —
code/models/common/tests/modules/attention/low_pcc_notes.mdDocumentation6.5 KB —
code/models/demos/blackhole/qwen36/BENCHMARKS.mdDocumentation7.0 KB —
code/models/demos/blackhole/qwen36/README.mdDocumentation8.9 KB —
code/models/demos/blackhole/qwen36/tests/DFLASH2_RESULTS.mdDocumentation58.1 KB —
code/models/demos/blackhole/qwen36/tests/DFLASH2_TRANSPORT_RESULTS.mdDocumentation12.4 KB —
code/models/demos/blackhole/qwen36/tests/GROUPED_PREFILL_RESULTS.mdDocumentation25.7 KB —
code/models/demos/blackhole/qwen36/tests/MONO_SPEC_RESULTS.mdDocumentation17.7 KB —
code/models/demos/blackhole/qwen36/tests/MTP_SPEC_RESULTS.mdDocumentation13.8 KB —
code/models/demos/blackhole/qwen36/tests/TP8_SPEC_RESULTS.mdDocumentation22.7 KB —
code/models/demos/blackhole/qwen36/tests/VERIFY_W32_AUDIT.mdDocumentation25.5 KB —
code/models/demos/utils/PERF_TARGET_VALIDATION.mdDocumentation1.8 KB —
code/models/experimental/gated_attention_gated_deltanet/README.mdDocumentation36.2 KB —
code/models/perf/README.mdDocumentation516 B —
code/models/tt_transformers/Host_Mem_Profile.mdDocumentation7.8 KB —
code/models/tt_transformers/PERF.mdDocumentation18.7 KB —
code/models/tt_transformers/README.mdDocumentation35.2 KB —
wheels/README.mdDocumentation657 B —
code/models/common/tests/requirements.txtOther11 B —
code/models/common/tests/setup.cfgOther224 B —
code/models/demos/utils/coco.namesOther625 B —
code/models/perf/images/example_perf_report.pngOther431.6 KB cad3f92bb517
code/models/tt_transformers/demo/sample_prompts/llama_models/clutter.jpegOther406.7 KB 8506697c4f59
code/models/tt_transformers/demo/sample_prompts/llama_models/dog.jpgOther40.2 KB —
code/models/tt_transformers/demo/sample_prompts/llama_models/ocr_image.jpegOther208.1 KB 605f22ef100a
code/models/tt_transformers/demo/sample_prompts/llama_models/pasta.jpegOther448.6 KB 8fbcd57e3160
code/models/tt_transformers/tests/generate_reference_outputs.shOther2.8 KB —
code/models/tt_transformers/tests/tale-of-two-cities.txt.bz2Other220.3 KB 25d33cc39a17
image/blobs/sha256/06d09bba9141d71ba9cfef79f15856e2ee282eec016c20980b2f05dcc1e64e19Other117 B —
image/blobs/sha256/187059930e3dac53e513636e22d9da5542b892cd617554c6c4b5e37df2345f79Other4.1 MB 187059930e3d
image/blobs/sha256/1b4f3f871f03dfe123dac0232fd71039468e9b811235ec14fed16a617db08482Other1.7 MB 1b4f3f871f03
image/blobs/sha256/20c3783cc497b5b0df1fc5f92bd64c3d2fbb24057c88692c8fda205b6ea8a2f2Other29.8 MB 20c3783cc497
image/blobs/sha256/295e9765634ff84d5a73fb7a197702148819e0629e2d52237d5a7bdae0a49b9cOther1.9 KB —
image/blobs/sha256/2abf777469cb9a6666a2849294fcb37805e6f2ff9b73f9a338c1f78e0111f0d9Other856 B —
image/blobs/sha256/39baa03fb94a271d831062b426ce9ca4dcd086865fcac7ecf537c6eb7eba0dd4Other1.0 KB —
image/blobs/sha256/3defbdfc2f4eae64093a80b52f0868d81eafdeb3da57d11b39d54f1d3ff25defOther65.9 MB 3defbdfc2f4e
image/blobs/sha256/41cd59bd2c7e757e6d2bb904b8fe8eee7950f81c6af5c1a7d88d30bf8c5838feOther1.5 KB —
image/blobs/sha256/4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1Other32 B —
image/blobs/sha256/50edcbeb9c98efece3a0c9cf4e86dd97fefd2f5830b569b06f51522972a675b8Other564 B —
image/blobs/sha256/5d712d04611b182a79870738a11ed1ba1345954650d847180210e354bfaa734bOther4.4 KB —
image/blobs/sha256/614ebe9ff4c662d56fc9cbd1e910afb433ebdf14ff83fb1d19558605b9e379abOther11.5 MB 614ebe9ff4c6
image/blobs/sha256/697b443a9af0062b61fa8290d609d6292c9705d938635c40840e5b5923a47e8aOther58.1 MB 697b443a9af0
image/blobs/sha256/7a8208d1b5ccf5b5fa86423ab4ffa9e92c25a1aaff3e7df4ba53e1d349ff8385Other167 B —
image/blobs/sha256/9002d2cd12eec1998ac120f636141afccf54af4dd5d9e228434a768e3a6f365aOther864.1 KB 9002d2cd12ee
image/blobs/sha256/937d1ef3b968106a5fd53d94e90300399e1d70bb7272f9130f9c1246ea99704bOther38.4 MB 937d1ef3b968
image/blobs/sha256/9a656c7774cd92ab6782920d78dab44bf55ea86d19bfe3f47a604dfc4e445b78Other139.1 MB 9a656c7774cd
image/blobs/sha256/9de168b8aa2924610c92b81dcbeba520cb9822604e7ad8eee07642ae1ce401cfOther6.6 KB —
image/blobs/sha256/b1c223d8a80f7d0b09caad9e620fbfb262b8ec491824c89c0da1fb851eec4eb2Other4.3 KB —
image/blobs/sha256/bedec7e229d6c492ed2f9aa2ab3abe166288795edd614ae46742743efac9a908Other38.4 MB bedec7e229d6
image/blobs/sha256/bf689ede870f44a3631f32fc8ffe76e69146a37a3f15039d58541856bb6891e4Other138.9 MB bf689ede870f
image/blobs/sha256/cb4b6974570f47f8f4f0995a4a3cfc863c4ec511bdce06d91e5d5ef655531524Other4.5 KB —
image/blobs/sha256/d5213289cbbc8b2af848c92d7a1887dc692967e673bb439cafd1d3f9d29fef96Other9.6 MB d5213289cbbc
image/blobs/sha256/de857d09640b19782c1cf8f4ddbe4f6d5bb28aebdf4f86863905d8cde25295fcOther1.3 GB de857d09640b
image/blobs/sha256/f5d4d182e58ff875e808c411e1da409851c09c1dda426ffb0b8c1fb4b8412be0Other14.5 KB —
image/blobs/sha256/fab07404a6227d7e1d02a8f4536e86fda0592554def3ffcfcc4f365686057707Other1.1 KB —
image/blobs/sha256/fe45b9e64b92f129f38df95c5e5a3da2519a51bbb2dcb0ff4a31416d3cd5e620Other69.5 MB fe45b9e64b92
image/oci-layoutOther30 B —
requirements.lockOther6.2 KB —
wheels/vllm-0.26.0+empty-cp312-cp312-linux_x86_64.whlOther8.2 MB cc6342644067
.gitattributesRepository3.7 KB —
code/models/tt_transformers/demo/.gitignoreRepository23 B —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download from Hyunggi Chang

Released by Hyunggi Chang through its official repository on Hugging Face.