SAVRN
Search Contact SAVRN

Open-weight model · Text generation

vlt5-base-keywords

by VoiceLab.ai Voicelab/vlt5-base-keywords

Results on demo model (different generation method, one model per language): Keywords generated with vlT5-base-keywords: encoder-decoder architecture, vlT5, keyword generation, scientific articles corpus The biggest advantage is the transferability of the…

Parameters275M
Context
Weights2.2 GB
Licensecc-by-4.0
AccessOpen weights
Monthly Downloads348.9k

Runs On

What it takes to serve vlt5-base-keywords (275M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.6 GB 0.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.3 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on vlt5-base-keywords

Three to five keywords from an abstract-length piece of text, extractive or abstractive, is what VoiceLab.ai built this 275M-parameter T5 to return. At 16-bit it needs 0.7 GB of memory, and 0.3 GB at 8-bit, so the cheapest listed setup, one 192 GB MI300X at $1.85 per hour on-demand, is overkill for it alone. Its natural home is leftover memory on a card already busy with other work. Longer documents must be split into chunks, and the training set is posmac.

CC BY 4.0 asks two things in return for commercial use: credit the creator and indicate what you changed, which matters once you fine-tune it on your own tags. Settle the chunk size before committing, since output length and keyword count follow the training data and no context length is given. Weights are stored in float32, the last update was August 16, 2023, and the method is in arXiv:2209.14008.

Model Card

By VoiceLab.ai, published under cc-by-4.0, revision 89a069b6626a.

Keyword Extraction from Short Texts with T5

Our vlT5 model is a keyword generation model based on encoder-decoder architecture using Transformer blocks presented by Google (https://huggingface.co/t5-base). The vlT5 was trained on scientific articles corpus to predict a given set of keyphrases based on the concatenation of the article’s abstract and title. It generates precise, yet not always complete keyphrases that describe the content of the article based only on the abstract.

Keywords generated with vlT5-base-keywords: encoder-decoder architecture, keyword generation

Results on demo model (different generation method, one model per language):

Our vlT5 model is a keyword generation model based on encoder-decoder architecture using Transformer blocks presented by Google (https://huggingface.co/t5-base). The vlT5 was trained on scientific articles corpus to predict a given set of keyphrases based on the concatenation of the article’s abstract and title. It generates precise, yet not always complete keyphrases that describe the content of the article based only on the abstract.

Read the full model card (900 words)

Configuration

Architecture
T5ForConditionalGeneration
Vocabulary size
50,048
Stored precision
float32
Model type
t5

Identity and Version

Repository
Voicelab/vlt5-base-keywords
Publisher
VoiceLab.ai
Task
Text generation
Modality
Text
Library
transformers
Parameters
275M parameters
Languages
pl, en
Revision
89a069b6626ad817ceaddf1f08271cd1aadb138a
First published
2022-09-27
Last updated
2023-08-16

Files and Weights

8 files, 2.2 GB in total. The weights are 2 files totalling 2.2 GB in bin, safetensors.

Weights2 files · 2.2 GB
Configuration2 files · 881 B
Tokenizer2 files · 1.1 MB
Documentation1 file · 11.2 KB
Repository1 file · 1.4 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.1 GB c8d9cefb35a2
pytorch_model.binWeights1.1 GB 2b055a39ebd3
config.jsonConfiguration807 B
special_tokens_map.jsonConfiguration74 B
README.mdDocumentation11.2 KB
.gitattributesRepository1.4 KB
spiece.modelTokenizer1.1 MB a200b4b9d710
tokenizer_config.jsonTokenizer265 B

License and Download

License
cc-by-4.0
Access
Open weights, no gate
Download size
2.2 GB
Download from VoiceLab.ai

Released by VoiceLab.ai through its official repository on Hugging Face. Read the license.

Built From

  • Described by arXiv:2209.14008
  • Trained on (disclosed) posmac

Memory Requirements

PrecisionWeights in memory
As published2.2 GB
16-bit0.6 GB
8-bit0.3 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Compare vlt5-base-keywords

Questions About vlt5-base-keywords

How much GPU memory does vlt5-base-keywords need?

About 0.7 GB at 16-bit and 0.2 GB at 4-bit: the weights (275M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run vlt5-base-keywords on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use vlt5-base-keywords commercially?

Yes. vlt5-base-keywords is released under Creative Commons Attribution 4.0. CC BY 4.0 permits sharing and adapting the work, including commercially, provided the creator is credited and changes are indicated.

Similar Models

This model is a fine-tuned derivative of google/gemma-3-270m, adapted using the Convergent Intelligence sparse fine-tuning setup originally tested on Liquid Foundation Models. The checkpoint was trained on reasoning-style English examples from angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k using a targeted adaptation strategy and the custom CIxOpt optimizer framework. The goal of this model is to test whether a compact Gemma 3 270M backbone can be shaped toward reasoning-style text generation through selective parameter participation rather than broad full-model modification. This is an experimental research checkpoint intended for evaluation, local testing, optimizer research, and…

Open weights gemma 268M parameters 262,144 tokens transformers

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Open weights apache-2.0 268M parameters 32,768 tokens transformers

Model · Text generation

pythia-160m

EleutherAI

The Pythia Scaling Suite is a collection of models developed to facilitate interpretability research (see paper). It contains two sets of eight models of sizes 70M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, and 12B. For each size, there are two models: one trained on the Pile, and one trained on the Pile after the dataset has been globally deduplicated. All 8 model sizes are trained on the exact same data, in the exact same order. We also provide 154 intermediate checkpoints per model, hosted on Hugging Face as branches. The Pythia model suite was deliberately designed to promote scientific research on large language models, especially interpretability research. Despite not centering downstream…

Open weights apache-2.0 213M parameters 2,048 tokens transformers

Model · Text generation

title

Desert Ant Labs

Suggest a title and description for any text. On-device titles and descriptions: a short factual title and a one- to two-sentence description for any passage of text. Swift (requirements) Then add the Title product to your target. The MLX trait is required: without it the module compiles as a stub. Get a title and a one or two sentence description for any passage of text, on device. Fine-tuned on transcript clips, but it works on any prose. The register is deliberately plain, with no emoji, no hashtags and no clickbait, and a description is meant to identify this passage rather than its topic. An MLX model directory. Load the folder, not a single file. The chat template is not incidental. A…

Open weights other 352M parameters 32,768 tokens mlx

Model · Text generation

SMOLM2Prover

Convergent Intelligence

SmolLM2Prover is a specialized, fine-tuned version of prithivMLmods/SmolLM2-CoT-360M. While retaining the strong conversational abilities of its base model, this version has been specifically enhanced to excel at deep thinking, logical reasoning, and higher-level mathematics, with a focus on generating step-by-step proofs and explanations (Chain-of-Thought). The model was fine-tuned using multiple rounds of Supervised Fine-Tuning (SFT) with the TRL library on a curated dataset, enhancing its ability to follow complex instructions and reason through problems. This model is intended to be used for text generation tasks that require logical reasoning or advanced conversation. The easiest way…

Open weights apache-2.0 362M parameters 8,192 tokens transformers

Model · Text generation

CasualSwarms

Convergent Intelligence

SAGI is a novel causal language model that integrates swarm intelligence dynamics with transformer architecture. The model treats cognition as a dynamic, adaptive system where multiple internal "agents" collaborate through differentiable routing, trust mechanisms, and shared memory. The enhancements were integrated with the existing AGI system through: 1. Compatibility Layer: Ensuring new components work with existing AGI Core 2. Unified State Representation: Combining enhanced capabilities with existing state 3. Enhanced Continuous Learning: Upgrading the learning system with new capabilities 4. Performance Monitoring: Tracking improvements through validation systems - Successfully…

Open weights apache-2.0 170M parameters 1,024 tokens transformers