sddqwen35a3b is an open-weight model from Max Sun. Its published files total 664.0 KB.
在 8 GB RAM 的 Intel 機器上真的跑得動 Qwen3.6-35B-A3B（22.1 GB / Q4KM）： 冷專家留在 SSD，RAM 只放有限容量的 expert cache，不用 swap 冒充 RAM。 - 引擎基礎：llama.cpp（pinned commit，見 sdq/config.py） - 核心實作：cpp/sdqpager.cpp（RAM arena + 槽位 + pin + 淘汰 + 指標） ＋ cpp/sdqmoe.cpp（自訂 MoE op）＋…
Model Card
在 8 GB RAM 的 Intel 機器上真的跑得動 Qwen3.6-35B-A3B（22.1 GB / Q4KM）： 冷專家留在 SSD，RAM 只放有限容量的 expert cache，不用 swap 冒充 RAM。 - 引擎基礎：llama.cpp（pinned commit，見 sdq/config.py） - 核心實作：cpp/sdqpager.cpp（RAM arena + 槽位 + pin + 淘汰 + 指標） ＋ cpp/sdqmoe.cpp（自訂 MoE op）＋ cpp/sdqbuft.cpp（讓 18.2 GiB 專家權重不進 RAM） - 進度真相來源：stage.txt（每階段更新，並上傳 HF） - 文件：docs/01 執行路徑分析、docs/02 設計、docs/03 實測結果與瓶頸、 docs/04 mode C 與負結果、docs/05 I/O 段平行與 8 GB 預算修正 - 一鍵從零到聊天：python demo.py 條件：--ram-budget-mb 8192 + RLIMITDATA 8 GB、8 執行緒、ctx 4096、temp 0， 短提示詞、48 個生成 token。換機器數字一定不同（見 docs/05 §1：本機的 SSD 上下文設計上支援 1M，實測只驗 4K。細節見 docs/03results.md（量測方法）、 docs/04experiments.md（mode C 與兩個負結果）、docs/05optimization.md（本輪的 一句話：一個 expert 的三段權重（gate/up/down）在…
Excerpt from the card by Max Sun.
Identity and Version
- Repository
- HelloSun/sddqwen35a3b
- Publisher
- Max Sun
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 464252e88a63e2a1e7a94f7fcb23d2d5880bdceb
- First published
- 2026-10-03
- Last updated
- 2026-10-04
Files and Weights
49 files, 664.0 KB in total.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| bench/expert_index.json | Configuration | 33.2 KB | — |
| bench/results/bench_first.json | Configuration | 6.8 KB | — |
| bench/results/bench_pipeline.json | Configuration | 6.8 KB | — |
| bench/results/bench_s2.json | Configuration | 6.5 KB | — |
| bench/results/bench_s4_modec.json | Configuration | 6.4 KB | — |
| bench/results/exp_final_ab.json | Configuration | 2.7 KB | — |
| bench/results/exp_rest_modec.json | Configuration | 4.1 KB | — |
| bench/results/exp_s5_io.json | Configuration | 3.1 KB | — |
| bench/results/exp_s5_io2.json | Configuration | 4.0 KB | — |
| bench/results/exp_smoke.json | Configuration | 884 B | — |
| demo.py | Configuration | 15.0 KB | — |
| sdq/__init__.py | Configuration | — | |
| sdq/bench.py | Configuration | 6.6 KB | — |
| sdq/config.py | Configuration | 2.3 KB | — |
| sdq/experiments.py | Configuration | 12.8 KB | — |
| sdq/hf_sync.py | Configuration | 7.2 KB | — |
| sdq/verify.py | Configuration | 9.2 KB | — |
| tools/drop_model_cache.py | Configuration | 1.6 KB | — |
| tools/gguf_index.py | Configuration | 10.1 KB | — |
| tools/io_probe.py | Configuration | 4.3 KB | — |
| tools/moe_layer_check.py | Configuration | 3.0 KB | — |
| tools/moe_ref.py | Configuration | 9.2 KB | — |
| tools/route_overlap.py | Configuration | 5.2 KB | — |
| README.md | Documentation | 3.2 KB | — |
| bench/results/exp_final_ab.md | Documentation | 715 B | — |
| bench/results/exp_rest_modec.md | Documentation | 939 B | — |
| bench/results/exp_s5_io.md | Documentation | 875 B | — |
| bench/results/exp_s5_io2.md | Documentation | 1.1 KB | — |
| bench/results/exp_smoke.md | Documentation | 382 B | — |
| docs/01_moe_path_analysis.md | Documentation | 5.9 KB | — |
| docs/02_design.md | Documentation | 6.3 KB | — |
| docs/03_results.md | Documentation | 5.5 KB | — |
| docs/04_experiments.md | Documentation | 13.9 KB | — |
| docs/05_optimization.md | Documentation | 11.0 KB | — |
| bench/results/exp_s5_io_final.txt | Other | 463 B | — |
| bench/results/exp_s5_io_run1.log | Other | 1.8 KB | — |
| bench/results/route_decode48.log | Other | 89.5 KB | — |
| bench/results/stats_cold.jsonl | Other | 1.0 KB | — |
| bench/results/stats_hot0.jsonl | Other | 1.0 KB | — |
| bench/results/stats_hot1.jsonl | Other | 1.0 KB | — |
| cpp/sdq_buft.cpp | Other | 8.0 KB | — |
| cpp/sdq_cli.cpp | Other | 31.8 KB | — |
| cpp/sdq_moe.cpp | Other | 31.0 KB | — |
| cpp/sdq_pager.cpp | Other | 65.6 KB | — |
| cpp/sdq_pager.h | Other | 17.0 KB | — |
| patches/0001-sdq-expert-pager.patch | Other | 163.4 KB | — |
| stage.txt | Other | 40.2 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
| .gitignore | Repository | 72 B | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
Released by Max Sun through its official repository on Hugging Face.