SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Qwen3.8-Flash-Next-DGX-Spark-Optimized-Recipe

by Single Spark AI single-spark-ai/Qwen3.8-Flash-Next-DGX-Spark-Optimized-Recipe

A personal, measured-on-one-machine deployment recipe for serving Qwen/Qwen3.8-Flash-Next on a single NVIDIA DGX Spark (GB10) with SGLang.

Parameters
Context
Weights3.1 MB
Licenseother
AccessOpen weights
Monthly Downloads

Model Card

A personal, measured-on-one-machine deployment recipe for serving Qwen/Qwen3.8-Flash-Next on a single NVIDIA DGX Spark (GB10) with SGLang. It is not a benchmark leaderboard claim and not "the fastest possible"; it is what is verifiably running on one GB10, with every patch, script, and check needed to reproduce it from upstream weights. Verified: 2026-09-13 · SGLang 00143e9c23aee2dead5e6fe217bda4fa8739cb92 (nightly-dev-cu13-20260911) · runtime image qwen38-flashnext-sm121-hybrid-sharp:00143e9c-hc2, built by bounded-ple/nightly/01c-build-sglang-nightly.sh. The v4 lineage (d91c3682-hc1) is still in the repo as the stable fallback. Key runtime facts (all asserted at deploy time by the 05…

Excerpt from the card by Single Spark AI, licensed other.

Identity and Version

Repository
single-spark-ai/Qwen3.8-Flash-Next-DGX-Spark-Optimized-Recipe
Publisher
Single Spark AI
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
dgx-spark, mtp
Revision
ba48d0244f88495a7e303f909cb55d36c3ce586d
First published
2026-09-05
Last updated
2026-09-18

Files and Weights

190 files, 3.1 MB in total.

Configuration69 files · 1.8 MB
Tokenizer4 files · 51.6 KB
Documentation12 files · 63.4 KB
Other104 files · 1.3 MB
Repository1 file · 94 B
Every file
FileTypeSizeSHA-256
bounded-ple/hybrid_sharp_runtime_check.pyConfiguration2.8 KB
bounded-ple/hybrid_sharp_tree_check.pyConfiguration18.5 KB
bounded-ple/nightly/apply_nvfp4_patches_nightly.pyConfiguration16.7 KB
bounded-ple/nightly/overlay-nightly/qwen4_exp.pyConfiguration87.8 KB
bounded-ple/nightly/patch_fcgb_nightly.pyConfiguration5.9 KB
bounded-ple/nightly/patch_gate_nightly.pyConfiguration4.6 KB
bounded-ple/nightly/patch_loader2_nightly.pyConfiguration2.6 KB
bounded-ple/nightly/patch_modelopt_nightly.pyConfiguration2.2 KB
bounded-ple/nightly/patches/patch-fp8.pyConfiguration1.9 KB
bounded-ple/nightly/patches/patch-loader-n.pyConfiguration3.2 KB
bounded-ple/nightly/patches/patch-loader.pyConfiguration3.3 KB
bounded-ple/nightly/patches/patch-loader2.pyConfiguration2.3 KB
bounded-ple/nightly/patches/patch-loader3.pyConfiguration1.5 KB
bounded-ple/nightly/patches/patch-modelopt.pyConfiguration2.1 KB
bounded-ple/nightly/patches/patch-modelopt2.pyConfiguration1.5 KB
bounded-ple/nightly/patches/patch-modelopt3.pyConfiguration2.5 KB
bounded-ple/nightly/patches/patch-ple-fix7.pyConfiguration11.6 KB
bounded-ple/nightly/patches/patch_flashinfer_cutlass_nvfp4_gate.pyConfiguration6.8 KB
bounded-ple/nightly/qsa_nvfp4_kv.pyConfiguration9.7 KB
bounded-ple/nightly/sm121_varlen.pyConfiguration6.8 KB
bounded-ple/overlay/qwen4_exp.pyConfiguration88.3 KB
bounded-ple/overlay/qwen4_ple_nvme.pyConfiguration32.2 KB
bounded-ple/overlay/serving_chat.pyConfiguration124.4 KB
bounded-ple/patch_flashinfer_cutlass_nvfp4_gate.pyConfiguration6.8 KB
bounded-ple/rust/sglang-mm/bench/bench_parity.pyConfiguration5.1 KB
bounded-ple/rust/sglang-mm/tests/generate_golden.pyConfiguration1.0 KB
bounded-ple/rust/sglang-mm/tests/test_golden.pyConfiguration1.5 KB
bounded-ple/rust/sglang-mm/tests/test_hash_fetch.pyConfiguration3.6 KB
bounded-ple/rust/sglang-mm/tests/test_integration.pyConfiguration2.8 KB
bounded-ple/rust/sglang-mm/tests/test_resize_parity.pyConfiguration5.2 KB
bounded-ple/upgrade/assemble-resolved.pyConfiguration2.1 KB
bounded-ple/upgrade/merge-overlays.pyConfiguration2.6 KB
bounded-ple/upgrade/merge-sources.pyConfiguration4.5 KB
build-nightly2/draft_nvfp4/fp8.pyConfiguration121.5 KB
build-nightly2/draft_nvfp4/loader.pyConfiguration178.1 KB
build-nightly2/kda_overlay/kda_kernels/__init__.pyConfiguration57 B
build-nightly2/kda_overlay/kda_kernels/qwen38_qsa_sm121/__init__.pyConfiguration3.0 KB
build-nightly2/kda_overlay/kda_kernels/qwen38_qsa_sm121/kernel.pyConfiguration10.1 KB
build-nightly2/kda_overlay/ops_attention_init.pyConfiguration8.1 KB
build-nightly2/kda_overlay/qwen_sparse_attn_backend.pyConfiguration76.2 KB
build-nightly2/modelopt_mixed/06-rewrite-qc-mixed.pyConfiguration4.4 KB
build-nightly2/modelopt_mixed/modelopt_quant.pyConfiguration129.2 KB
build-nightly2/ple_graph/full_cuda_graph_backend.pyConfiguration10.1 KB
build/draft_nvfp4/fp8.pyConfiguration114.3 KB
build/draft_nvfp4/loader.pyConfiguration178.0 KB
build/draft_nvfp4/patch-fp8.pyConfiguration1.9 KB
build/draft_nvfp4/patch-loader2.pyConfiguration2.3 KB
build/kda_overlay/kda_kernels/__init__.pyConfiguration57 B
build/kda_overlay/kda_kernels/qwen38_qsa_sm121/__init__.pyConfiguration3.0 KB
build/kda_overlay/kda_kernels/qwen38_qsa_sm121/kernel.pyConfiguration10.1 KB
build/kda_overlay/ops_attention_init.pyConfiguration7.9 KB
build/kda_overlay/qwen_sparse_attn_backend.pyConfiguration83.2 KB
build/modelopt_mixed/06-rewrite-qc-mixed.pyConfiguration4.5 KB
build/modelopt_mixed/07-prepare-draft-fp8.pyConfiguration4.0 KB
build/modelopt_mixed/08-merge-hybridsharp-nv.pyConfiguration5.3 KB
build/modelopt_mixed/modelopt_quant.pyConfiguration120.2 KB
build/modelopt_mixed/patch-modelopt.pyConfiguration2.1 KB
build/modelopt_mixed/patch-modelopt2.pyConfiguration1.5 KB
build/modelopt_mixed/patch-modelopt3.pyConfiguration2.5 KB
build/modelopt_mixed/probe-draft-fp8.pyConfiguration1.2 KB
build/modelopt_mixed/probe-mixed.pyConfiguration2.4 KB
build/modelopt_mixed/repro-mixed.pyConfiguration1.9 KB
build/patch-loader3.pyConfiguration1.5 KB
build/ple_graph/full_cuda_graph_backend.pyConfiguration7.7 KB
build/ple_graph/patch-ple-fix7.pyConfiguration11.1 KB
build/qwen4_exp.pyConfiguration86.5 KB
build/qwen_sparse_attn_backend.pyConfiguration81.1 KB
patch-serving-chat-log.pyConfiguration2.0 KB
verify.pyConfiguration3.8 KB
LICENSEDocumentation1.1 KB
NOTICE.mdDocumentation1.1 KB
README.mdDocumentation16.1 KB
bounded-ple/hybrid-sharp-review.mdDocumentation9.7 KB
bounded-ple/rust/sglang-mm/README.mdDocumentation10.5 KB
build-nightly2/kda_overlay/kda_kernels/README.mdDocumentation3.0 KB
build/kda_overlay/kda_kernels/README.mdDocumentation3.0 KB
build/ple_graph/PATCHES.mdDocumentation1.0 KB
docs/failure-history.mdDocumentation6.2 KB
docs/memory-budget.mdDocumentation2.1 KB
docs/quickstart-zh.mdDocumentation5.9 KB
docs/verification.mdDocumentation3.5 KB
bounded-ple/01-build-bounded-ple.shOther1.6 KB
bounded-ple/01b-build-hybrid-runtime.shOther4.7 KB
bounded-ple/02-deploy-bounded-ple.shOther5.9 KB
bounded-ple/03-verify-bounded-ple.shOther4.5 KB
bounded-ple/04-prepare-hybrid-sharp.shOther8.1 KB
bounded-ple/05-deploy-hybrid-sharp-nightly.shOther35.3 KB
bounded-ple/05-deploy-hybrid-sharp.shOther28.3 KB
bounded-ple/Dockerfile.bounded-pleOther1.3 KB
bounded-ple/Dockerfile.hybrid-sharp-runtimeOther1.3 KB
bounded-ple/hybrid-start-nv-nightly.shOther5.5 KB
bounded-ple/hybrid-start-nv.shOther2.1 KB
bounded-ple/hybrid-start.shOther1.1 KB
bounded-ple/hybrid-stop.shOther1.1 KB
bounded-ple/legacy-start.shOther2.2 KB
bounded-ple/legacy-stop.shOther977 B
bounded-ple/nightly/01c-build-sglang-nightly.shOther6.0 KB
bounded-ple/nightly/Dockerfile.nightly-bounded-pleOther2.3 KB
bounded-ple/nightly/Dockerfile.nightly-communityOther3.5 KB
bounded-ple/nightly/Dockerfile.nightly-hybridOther1.2 KB
bounded-ple/nightly/regenerate-overlays.shOther3.4 KB
bounded-ple/rust/Cargo.lockOther126.2 KB
bounded-ple/rust/Cargo.tomlOther1.2 KB
bounded-ple/rust/rust-toolchain.tomlOther84 B
bounded-ple/rust/sglang-grpc/Cargo.tomlOther1.5 KB
bounded-ple/rust/sglang-grpc/build.rsOther1.2 KB
bounded-ple/rust/sglang-grpc/pyproject.tomlOther627 B
bounded-ple/rust/sglang-grpc/src/bridge.rsOther26.1 KB
bounded-ple/rust/sglang-grpc/src/bridge/tests.rsOther212 B
bounded-ple/rust/sglang-grpc/src/lib.rsOther8.5 KB
bounded-ple/rust/sglang-grpc/src/server.rsOther36.7 KB
bounded-ple/rust/sglang-grpc/src/server/tests.rsOther2.3 KB
bounded-ple/rust/sglang-grpc/src/utils/mod.rsOther278 B
bounded-ple/rust/sglang-grpc/src/utils/py_utils.rsOther2.3 KB
bounded-ple/rust/sglang-grpc/src/utils/py_utils/tests.rsOther230 B
bounded-ple/rust/sglang-grpc/src/utils/request_utils.rsOther20.2 KB
bounded-ple/rust/sglang-mm/Cargo.tomlOther2.7 KB
bounded-ple/rust/sglang-mm/pyproject.tomlOther264 B
bounded-ple/rust/sglang-mm/src/common/fetch.rsOther16.9 KB
bounded-ple/rust/sglang-mm/src/common/mod.rsOther8.3 KB
bounded-ple/rust/sglang-mm/src/common/par.rsOther3.2 KB
bounded-ple/rust/sglang-mm/src/common/resize.rsOther8.1 KB
bounded-ple/rust/sglang-mm/src/common/token_layout.rsOther8.7 KB
bounded-ple/rust/sglang-mm/src/common/transforms.rsOther3.0 KB
bounded-ple/rust/sglang-mm/src/driver.rsOther10.8 KB
bounded-ple/rust/sglang-mm/src/inkling/mod.rsOther9.9 KB
bounded-ple/rust/sglang-mm/src/lib.rsOther727 B
bounded-ple/rust/sglang-mm/src/pipeline.rsOther5.0 KB
bounded-ple/rust/sglang-mm/src/qwen_vl/mod.rsOther26.3 KB
bounded-ple/rust/sglang-mm/src/registry.rsOther2.8 KB
bounded-ple/rust/sglang-mm/tests/rlib_is_single_threaded.rsOther2.5 KB
bounded-ple/rust/sglang-server/Cargo.tomlOther2.6 KB
bounded-ple/rust/sglang-server/pyproject.tomlOther383 B
bounded-ple/rust/sglang-server/src/api_server.rsOther3.9 KB
bounded-ple/rust/sglang-server/src/api_server/common.rsOther9.6 KB
bounded-ple/rust/sglang-server/src/api_server/disaggregation.rsOther26 B
bounded-ple/rust/sglang-server/src/api_server/disaggregation/bootstrap.rsOther21.7 KB
bounded-ple/rust/sglang-server/src/api_server/frame.rsOther34.8 KB
bounded-ple/rust/sglang-server/src/api_server/guard.rsOther5.0 KB
bounded-ple/rust/sglang-server/src/api_server/log.rsOther1.5 KB
bounded-ple/rust/sglang-server/src/api_server/native_api.rsOther26.8 KB
bounded-ple/rust/sglang-server/src/api_server/openai.rsOther7.2 KB
bounded-ple/rust/sglang-server/src/api_server/openai/chat.rsOther45.2 KB
bounded-ple/rust/sglang-server/src/api_server/openai/completions.rsOther30.8 KB
bounded-ple/rust/sglang-server/src/api_server/openai/models.rsOther1.5 KB
bounded-ple/rust/sglang-server/src/api_server/openai/reasoning.rsOther9.3 KB
bounded-ple/rust/sglang-server/src/api_server/openai/template.rsOther73.9 KB
bounded-ple/rust/sglang-server/src/api_server/openai/test_utils.rsOther11.2 KB
bounded-ple/rust/sglang-server/src/api_server/openai/tools.rsOther30.0 KB
bounded-ple/rust/sglang-server/src/api_server/prefetch.rsOther8.5 KB
bounded-ple/rust/sglang-server/src/api_server/submit.rsOther2.8 KB
bounded-ple/rust/sglang-server/src/environ.rsOther4.0 KB
bounded-ple/rust/sglang-server/src/error.rsOther1.5 KB
bounded-ple/rust/sglang-server/src/fsm.rsOther7.0 KB
bounded-ple/rust/sglang-server/src/ids.rsOther10.2 KB
bounded-ple/rust/sglang-server/src/lib.rsOther13.4 KB
bounded-ple/rust/sglang-server/src/message.rsOther4.5 KB
bounded-ple/rust/sglang-server/src/message/egress.rsOther55.5 KB
bounded-ple/rust/sglang-server/src/message/finish_reason.rsOther10.0 KB
bounded-ple/rust/sglang-server/src/message/io_struct.rsOther10.2 KB
bounded-ple/rust/sglang-server/src/message/mm_payload.rsOther7.7 KB
bounded-ple/rust/sglang-server/src/message/request.rsOther59.8 KB
bounded-ple/rust/sglang-server/src/message/sampling.rsOther42.6 KB
bounded-ple/rust/sglang-server/src/message/types.rsOther11.8 KB
bounded-ple/rust/sglang-server/src/mm.rsOther15.9 KB
bounded-ple/rust/sglang-server/src/ring.rsOther10.0 KB
bounded-ple/rust/sglang-server/src/runtime.rsOther24.5 KB
bounded-ple/rust/sglang-server/src/runtime/config.rsOther12.3 KB
bounded-ple/rust/sglang-server/src/runtime/runnable.rsOther534 B
bounded-ple/rust/sglang-server/src/runtime/threads.rsOther5.5 KB
bounded-ple/rust/sglang-server/src/tokenizer_manager/egress.rsOther9.5 KB
bounded-ple/rust/sglang-server/src/tokenizer_manager/ingress.rsOther69.5 KB
bounded-ple/rust/sglang-server/src/utils.rsOther120 B
bounded-ple/rust/sglang-server/src/utils/regex.rsOther56.3 KB
bounded-ple/rust/sglang-server/src/utils/response.rsOther3.9 KB
bounded-ple/rust/sglang-server/src/utils/serialize.rsOther3.9 KB
bounded-ple/rust/sglang-server/src/utils/sock.rsOther1.3 KB
bounded-ple/rust/sglang-storage/Cargo.tomlOther519 B
bounded-ple/rust/sglang-storage/src/io_uring_reader.rsOther9.6 KB
bounded-ple/rust/sglang-storage/src/lib.rsOther303 B
bounded-ple/upgrade/build-merged-image.shOther912 B
build-nightly2/path_qsa.txtOther85 B
build/path_qsa.txtOther85 B
build/path_qwen4_exp.txtOther60 B
nightly-audit.shOther4.4 KB
.gitattributesRepository94 B
bounded-ple/rust/sglang-grpc/src/tokenizers.rsTokenizer4.2 KB
bounded-ple/rust/sglang-server/src/detokenizer.rsTokenizer28.7 KB
bounded-ple/rust/sglang-server/src/tokenizer.rsTokenizer14.4 KB
bounded-ple/rust/sglang-server/src/tokenizer_manager.rsTokenizer4.2 KB

License and Download

License
other
Access
Open weights, no gate
Download from Single Spark AI

Released by Single Spark AI through its official repository on Hugging Face.

Built From

Questions About Qwen3.8-Flash-Next-DGX-Spark-Optimized-Recipe

What license is Qwen3.8-Flash-Next-DGX-Spark-Optimized-Recipe released under?

other, as its publisher declares it. Read the license text before commercial use.

Similar Models

Fine-tune Qwen3 (14B) for free using our Google Colab notebook! - Read our Blog about Qwen3 support: unsloth.ai/blog/qwen3 - View the rest of our notebooks in our docs here. Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for…

Open weights apache-2.0 transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp