A quantized version of Qwen/Qwen3.8-Flash-Next for Jetson AGX Orin 64GB / CUDA SM87, deployed with Orinfer v0.2.0. It supports text, images and multiple images, streaming Chat Completions, native MTP, prefix caching, continuous batching and resumable JSONL offline inference. Translation requests use enablethinking: false; thinking follows the original model's chat template. Routed experts use integer E8P near-2-bit weights with INT8 computation. GDN QKV/Z, QSA Q/gate and the shared output head use signed-block128 Q4A8. Output projections, shared FFN and sensitive MTP projections retain W8; HC retains BF16 and vision FP16. CPU embedding/PLE tables use bounded row caches. Deployed read-only…
Independent publisher
An Yudong
immiq
Models in Library5
Datasets in Library0
Models on Hugging Face6
Followers1
Compare the published evidence
This profile connects the 5 model and dataset records shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Image and text to text.
Reported licenses: apache-2.0, other. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.
Models
A quantized version of Qwen/Qwen3.8-27B for Jetson AGX Orin 64GB / CUDA SM87, deployed with Orinfer v0.2.0. It supports text, images and multiple images, streaming Chat Completions, native MTP, prefix caching, continuous batching and resumable JSONL offline inference. Translation requests use enablethinking: false; thinking follows the original model's chat template. Two-stage residual E8P Q4 with coefficients [4, 1], signed-block128 rotation and beam-8 encoding over the original BF16 weights, paired with INT8 computation. Sensitive tensors retain the validated W8/FP16/BF16/FP32 mixed-precision policy. Deployed read-only GPU data, including scales, derived constants and precision…
A quantized version of IndexTeam/Index-Translate-2B for Jetson AGX Orin 64GB / CUDA SM87, deployed with Orinfer v0.2.0. It supports text, images and multiple images, streaming Chat Completions, native MTP, prefix caching, continuous batching and resumable JSONL offline inference. Translation requests use enablethinking: false; thinking follows the original model's chat template. Two-stage residual E8P Q4 with coefficients [4, 1], signed-block128 rotation and beam-8 encoding over the original BF16 weights, paired with INT8 computation. Sensitive tensors retain the validated W8/FP16/BF16/FP32 mixed-precision policy. Deployed read-only GPU data, including scales, derived constants and…
A quantized version of IndexTeam/Index-Translate-9B for Jetson AGX Orin 64GB / CUDA SM87, deployed with Orinfer v0.2.0. It supports text, images and multiple images, streaming Chat Completions, native MTP, prefix caching, continuous batching and resumable JSONL offline inference. Translation requests use enablethinking: false; thinking follows the original model's chat template. Two-stage residual E8P Q4 with coefficients [4, 1], signed-block128 rotation and beam-8 encoding over the original BF16 weights, paired with INT8 computation. Sensitive tensors retain the validated W8/FP16/BF16/FP32 mixed-precision policy. Deployed read-only GPU data, including scales, derived constants and…
A quantized version of Qwen/Qwen3.5-4B for Jetson AGX Orin 64GB / CUDA SM87, deployed with Orinfer v0.2.0. It supports text, images and multiple images, streaming Chat Completions, native MTP, prefix caching, continuous batching and resumable JSONL offline inference. Translation requests use enablethinking: false; thinking follows the original model's chat template. Two-stage residual E8P Q4 with coefficients [4, 1], signed-block128 rotation and beam-8 encoding over the original BF16 weights, paired with INT8 computation. Sensitive tensors retain the validated W8/FP16/BF16/FP32 mixed-precision policy. Deployed read-only GPU data, including scales, derived constants and precision exceptions…