On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 62 tok/s and writes at 24 tok/s, 37 tok/s with its own draft block in a chat: llama.cpp, on the same laptop, 16 and 2.8. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the drafts with janas-bench on a chat reply, the mean of three rounds (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…
Organization
Prabanta Dev
prabanta-dev
Janas-LLM: 37 tok/s from Qwen3-Next-80B on a 32 GB laptop (24 without drafts; llama.cpp on the same laptop: 2.8). Pure-C inference for LLMs bigger than your RAM, CPU or GPU.
Models in Library13
Datasets in Library0
Models on Hugging Face14
Followers1
Compare the published evidence
This profile connects the 13 model and dataset records shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.
Models
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 66 tok/s and writes at 22 tok/s: llama.cpp, on the same laptop, 14 and 2.2. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration. On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU, through the Vulkan driver of Mesa 26.1.6 - 32 GB of DDR5-5600 memory - a 1 TB NVMe SSD, about 5.7 GB/s reading - llama.cpp build 2b18470 (18 September 2026), Vulkan backend The model (48.4 GB) is…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 104 tok/s and writes at 19 tok/s, 34 tok/s with its own draft block in a chat: llama.cpp, on the same laptop, 79 and 12. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the drafts with janas-bench on a chat reply, the mean of three rounds (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 111 tok/s and writes at 14 tok/s, 24 tok/s with its own draft block in a chat: llama.cpp, on the same laptop, 78 and 8.7. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the drafts with janas-bench on a chat reply, the mean of three rounds (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 441 tok/s and writes at 52 tok/s, 67 tok/s with its own draft block in a chat: llama.cpp, on the same laptop, 323 and 28. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the drafts with janas-bench on a chat reply, the mean of three rounds (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 799 tok/s and writes at 109 tok/s: llama.cpp, on the same laptop, 519 and 32. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration. On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU, through the Vulkan driver of Mesa 26.1.6 - 32 GB of DDR5-5600 memory - a 1 TB NVMe SSD, about 5.7 GB/s reading - llama.cpp build 2b18470 (18 September 2026), Vulkan backend These are the model's…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 193 tok/s and writes at 27 tok/s: llama.cpp, on the same laptop, 164 and 18. The other files of this repository, measured the same way: Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the draft pair in a chat reply at the chat's own temperature, as the README's section on --draft tells (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 135 tok/s and writes at 32 tok/s: llama.cpp, on the same laptop, 122 and 15. The other files of this repository, measured the same way: The 3-bit file reads a prompt slower than llama.cpp: its Q3K weights do not go to the GPU's fast prompt yet. It writes three times as fast. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration. On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 939 tok/s and writes at 130 tok/s: llama.cpp, on the same laptop, 670 and 45. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration. On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU, through the Vulkan driver of Mesa 26.1.6 - 32 GB of DDR5-5600 memory - a 1 TB NVMe SSD, about 5.7 GB/s reading - llama.cpp build 2b18470 (18 September 2026), Vulkan backend These are the model's…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 122 tok/s and writes at 20 tok/s, 32 tok/s with its own assistant in a chat: llama.cpp, on the same laptop, 109 and 15. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the drafts with janas-bench on a chat reply, the mean of three rounds (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 191 tok/s and writes at 38 tok/s, 52 tok/s with its own assistant in a chat: llama.cpp, on the same laptop, 150 and 19. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the drafts with janas-bench on a chat reply, the mean of three rounds (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 84 tok/s and writes at 18 tok/s, 26 tok/s with its own assistant in a chat: llama.cpp, on the same laptop, 76 and 12. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the drafts with janas-bench on a chat reply, the mean of three rounds (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…
On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 65 tok/s and writes at 9.9 tok/s, 14 tok/s with its own assistant in a chat: llama.cpp, on the same laptop, 46 and 7.1. Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration; the drafts with janas-bench on a chat reply, the mean of three rounds (a draft guesses the next tokens and the model checks them: the same text, faster). On other machines the figures will differ. Details: Janas README. - Debian 13 (trixie) Linux, x86-64, kernel 6.12.107 - its integrated Intel Arc GPU…