SAVRN
Search Contact SAVRN

Open-weight model · Audio text to text

DuplexJev-4B-Stress

by Adventists.ai adventists-ai/DuplexJev-4B-Stress

DuplexJev-4B-Stress is an open-weight model for audio text to text from Adventists.ai, released under Creative Commons Attribution-NonCommercial 4.0. It has 4.2B parameters and a 40,960-token context. At 16-bit it needs about 10.1 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

Paper: arXiv:2610.02638 · Code: github.com/adventists-ai/duplexjev · Research note: teaching a speech-decision LLM to hear stress DuplexJev-4B-Turn that also hears stress and pauses, for smaller GPUs.

Parameters4.2B
Context40,960
Weights8.4 GB
Licensecc-by-nc-4.0
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve DuplexJev-4B-Stress (4.2B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 8.4 GB 10.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 4.2 GB 5.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 2.1 GB 2.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 14, 2026.

DuplexJev-4B-Stress on every accelerator the SAVRN Index prices, at every precision

Model Card

Paper: arXiv:2610.02638 · Code: github.com/adventists-ai/duplexjev · Research note: teaching a speech-decision LLM to hear stress DuplexJev-4B-Turn that also hears stress and pauses, for smaller GPUs. "I didn't say she took the money" and "I didn't say she took the money" are the same words; this model tells them apart. It answers which word is stressed, is any word stressed at all, where the speaker pauses, and what the stress implies, in Mandarin and English. Trade-off — read before choosing. At 4B, adding stress costs some spoken-QA accuracy: VoiceBench OBQA / MMSU is 42.0 / 38.2 against 46.4 / 41.7 for 4B-Turn, and qa100 / ZJU-ML are 1 point lower. We tried lower stress weights…

Excerpt from the card by Adventists.ai, licensed cc-by-nc-4.0.

Configuration

Architecture
DuplexJevForConditionalGeneration
Context length (tokens)
40,960
Layers
36
Hidden size
4,096
Feed-forward size
9,728
Attention heads
32
Key/value heads
8
Head dimension
128
Vocabulary size
151,936
RoPE base
1,000,000
Stored precision
bfloat16
Model type
ultravox

Identity and Version

Repository
adventists-ai/DuplexJev-4B-Stress
Publisher
Adventists.ai
Task
Audio text to text
Modality
Other
Library
vllm
Parameters
4.2B parameters
Languages
zh, en
Revision
0f0c264aed439eae090949d5e506ea432c9098aa
First published
2026-10-07
Last updated
2026-10-08

Files and Weights

16 files, 8.5 GB in total. The weights are 2 files totalling 8.4 GB in safetensors.

Weights2 files · 8.4 GB
Configuration7 files · 119.0 KB
Tokenizer4 files · 15.9 MB
Documentation2 files · 18.2 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights4.3 GB 7dc9c1d80a97
model-00002-of-00002.safetensorsWeights4.2 GB 88c8dd2b6f59
added_tokens.jsonConfiguration730 B —
config.jsonConfiguration1.8 KB —
generation_config.jsonConfiguration239 B —
model.safetensors.index.jsonConfiguration62.8 KB —
normalizer.jsonConfiguration52.7 KB —
preprocessor_config.jsonConfiguration356 B —
special_tokens_map.jsonConfiguration355 B —
LICENSE-Qwen3-4BDocumentation11.3 KB —
README.mdDocumentation6.9 KB —
.gitattributesRepository1.6 KB —
merges.txtTokenizer1.7 MB —
tokenizer.jsonTokenizer11.4 MB 0422f49acb9b
tokenizer_config.jsonTokenizer9.8 KB —
vocab.jsonTokenizer2.8 MB —

License and Download

License
cc-by-nc-4.0
Access
Open weights, no gate
Download size
8.4 GB
Download from Adventists.ai

Released by Adventists.ai through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published8.4 GB
16-bit8.4 GB
8-bit4.2 GB
4-bit2.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About DuplexJev-4B-Stress

How much GPU memory does DuplexJev-4B-Stress need?

About 10.1 GB at 16-bit and 2.5 GB at 4-bit: the weights (4.2B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run DuplexJev-4B-Stress on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use DuplexJev-4B-Stress commercially?

Not without separate permission. DuplexJev-4B-Stress is released under Creative Commons Attribution-NonCommercial 4.0. CC BY-NC 4.0 permits sharing and adapting with credit for non-commercial purposes only. Commercial use needs separate permission from the rights holder.

What is DuplexJev-4B-Stress's context length?

40,960 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Audio text to text

DuplexJev-4B-Para-LiveTurn

Adventists.ai

Paper: arXiv:2610.02638 · Code: github.com/adventists-ai/duplexjev · Plugins: pipecat-duplexjev, livekit-plugins-duplexjev The 4B DuplexJev tuned for live end-of-turn: is the user done, right after they go quiet? A turn-taking variant of DuplexJev-4B-Para v1.1, which stays the general 4B. Same recipe as DuplexJev-32B-Para v1.2: the 4B-Para v1.1 mix plus accent data and pause-level turn-taking data, one rank-16 LoRA, 4,000 steps, merged. Qwen3-ASR-0.6B encoder + connector + Qwen3-4B, 4.2 B parameters, bf16, ~10 GB GPU memory. Which 4B to pick. - This one for a voice agent's end-of-turn on a small GPU (LiveKit / Pipecat plugins). - 4B-Para for everything else (stress, non-verbal sounds…

Open weights cc-by-nc-4.0 4.2B parameters 40,960 tokens vllm

Model · Audio text to text

Sori-1B-MCQ

Seonuk Kim

Sori-1B-MCQ — sori (소리) is Korean for sound — listens to a clip and answers typed questions about it: which of these options, how far along this scale, is this true. It returns the answer, a probability for every option you defined, and a confidence — never prose, never a token stream to parse. Code stays in charge: your program defines the options, reads the numbers and decides what to do. It is the decision model of the Sori Agent project at the Human Interface Lab, Seoul National University. Inspired by TypeSafe's System One model, Jev. Jev showed what a model built for software rather than for conversation looks like: a state, typed questions, calibrated probabilities, one call for many…

Access requested at publisher other 1.1B parameters transformers

Model · Audio text to text

MOSS-Transcribe-Diarize-HF

Ita Zaporozhets

MOSS-Transcribe-Diarize 0.9B is an end-to-end audio understanding model for long-form multi-speaker transcription, diarization, timestamps, and acoustic event awareness. It supports transcription and diarization across 50+ languages, single-pass inference on audio recordings up to 90 minutes long, and custom hotword prompting for domain-specific terms. Given an audio or video file, the model generates a compact speaker-aware transcript in one pass, including timestamps and anonymous speaker labels such as [S01], [S02], and beyond. 2026-07-22: The subtitle Web UI now supports both Simplified Chinese and English. 2026-07-14: MOSS-Transcribe-Diarize won first place in the 2nd MLC-SLM Challenge…

Open weights apache-2.0 909M parameters 131,072 tokens transformers

Model · Audio text to text

Qwen2-Audio-7B-Instruct

Qwen

Qwen2-Audio is the new series of Qwen large audio-language models. Qwen2-Audio is capable of accepting various audio signal inputs and performing audio analysis or direct textual responses with regard to speech instructions. We introduce two distinct audio interaction modes: We release Qwen2-Audio-7B and Qwen2-Audio-7B-Instruct, which are pretrained model and chat model respectively. For more details, please refer to our Blog, GitHub, and Report. The code of Qwen2-Audio has been in the latest Hugging face transformers and we advise you to build from source with command pip install git+https://github.com/huggingface/transformers, or you might encounter the following error: In the following…

Open weights apache-2.0 8.4B parameters 8,192 tokens transformers

Model · Audio text to text

strixAE

Wujunjie

strixAE is an audio-language reasoning agent obtained by applying Group Relative Policy Optimization (GRPO) to Audio-Reasoner and merging the trained weights into a standalone checkpoint. It uses the Qwen2AudioForConditionalGeneration architecture and is intended for audio understanding, structured reasoning, and audio-restoration pipeline decisions. The model is designed for research involving: - audio understanding across speech, music, and environmental sounds; - audio-quality and degradation analysis; - deciding whether candidate restoration operations should be applied or skipped; - selecting and ordering an audio-restoration pipeline; - structured audio reasoning and question…

Open weights mit 8.4B parameters 8,192 tokens transformers

A small DuplexJev connector: the Whisper-small encoder (frozen) feeds a frozen Qwen3-4B-2507, and every typed question is read as a single-token distribution over its options, with zero decode steps and many questions per forward pass. Trained with the same recipe as the Qwen3-32B connectors released with the paper. Leaderboard scores (see the GitHub README): main language (mean of qa100, ZJU-ML, Easy-Turn) 53.5, paralinguistics (mean of gender, emotion) 43.0. Paper protocol: the evaluation prompts of the paper (single option order, one H200). duplexjev defaults: the package's own prompts with lang matched to the clip. Spoken QA with a small LLM is bounded by the LLM itself (see the…

Open weights apache-2.0 30M parameters transformers