SAVRN
Search Contact SAVRN

Open-weight model · Summarization

T5-base-10K-summarization

by Yatharth Sant yatharth97/T5-base-10K-summarization

This model is a fine-tuned version of Google's T5-Base model tailored for summarizing financial 10K report sections.

Parameters223M
Context
Weights891.6 MB
License
AccessOpen weights
Monthly Downloads12k

Runs On

What it takes to serve T5-base-10K-summarization (223M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.4 GB 0.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.2 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

This model is a fine-tuned version of Google's T5-Base model tailored for summarizing financial 10K report sections. T5-Base-10K-Summarization is optimized to condense lengthy 10K reports into manageable summaries, enabling quick insights into financial data and trends. Ideal for use by financial analysts and regulatory agencies needing rapid insights from 10K reports. It may not be suited for summarizing non-financial documents or informal texts. Trained on a diverse collection of 10K reports from various industries, annotated for summarization to ensure broad applicability and accuracy. The following hyperparameters were used during training: - learningrate: 5e-05 - trainbatchsize: 8…

Excerpt from the card by Yatharth Sant.

Configuration

Architecture
T5ForConditionalGeneration
Vocabulary size
32,128
Stored precision
float32
Model type
t5

Identity and Version

Repository
yatharth97/T5-base-10K-summarization
Publisher
Yatharth Sant
Task
Summarization
Modality
Text
Library
transformers
Parameters
223M parameters
Languages
Not stated by the source
Revision
e9dc10234bb5fe54dff3d3a6f3d048c18c3b1008
First published
2024-04-17
Last updated
2024-06-10

Files and Weights

10 files, 892.5 MB in total. The weights are 2 files totalling 891.6 MB in bin, safetensors.

Weights2 files · 891.6 MB
Configuration4 files · 6.8 KB
Tokenizer2 files · 812.5 KB
Documentation1 file · 1.2 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights891.6 MB b26a8b8871a5
training_args.binWeights5.0 KB c39648d2157e
added_tokens.jsonConfiguration2.6 KB
config.jsonConfiguration1.5 KB
generation_config.jsonConfiguration142 B
special_tokens_map.jsonConfiguration2.5 KB
README.mdDocumentation1.2 KB
.gitattributesRepository1.5 KB
spiece.modelTokenizer791.7 KB d60acb128cf7
tokenizer_config.jsonTokenizer20.8 KB

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
891.6 MB
Download from Yatharth Sant

Released by Yatharth Sant through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published891.6 MB
16-bit0.4 GB
8-bit0.2 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About T5-base-10K-summarization

How much GPU memory does T5-base-10K-summarization need?

About 0.5 GB at 16-bit and 0.1 GB at 4-bit: the weights (223M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run T5-base-10K-summarization on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Similar Models

Model · Summarization

rut5-base-summ

Dmitry Balobin

Finetuned ai-forever/ruT5-base for text and dialogue summarization. All 'train' subsets was concatenated and shuffled with seed 1000 - 7. Train subset = 155678 rows. Evaluation on 10% of concatenated 'validation' subsets = 1458 rows. See WandB logs. See report at REPORT WIP.

Open weights 223M parameters transformers

Model · Summarization

ptt5-base-summ

Recogna NLP

PTT5 Summ is a fine-tuned PTT5 model to perform Abstractive Summarization in Brazilian Portuguese texts. This model was fine-tuned on the datasets: RecognaSumm, WikiLingua, XL-Sum, TeMário.pdf) and CSTNews. For further information, please go to PTT5 Summ repository.

Open weights mit 223M parameters transformers

Model · Summarization

ptt5-base-summ-xlsum

Recogna NLP

PTT5 Summ is a fine-tuned PTT5 model to perform Abstractive Summarization in Brazilian Portuguese texts. This model was fine-tuned on the datasets: RecognaSumm, WikiLingua, XL-Sum, TeMário.pdf) and CSTNews. For further information, please go to PTT5 Summ repository. author="Paiola, Pedro H. and de Rosa, Gustavo H. and Papa, Jo{\~a}o P.", editor="Xavier-Junior, Jo{\~a}o Carlos and Rios, Ricardo Ara{\'u}jo", title="Deep Learning-Based Abstractive Summarization for Brazilian Portuguese Texts", booktitle="BRACIS 2022: Intelligent Systems", year="2022", publisher="Springer International Publishing", address="Cham", pages="479--493", isbn="978-3-031-21689-3"} This model was fine-tuned using the…

Open weights cc-by-nc-sa-4.0 223M parameters transformers

Model · Summarization

led-base-book-summary

Peter Szemraj

The Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization is a model I fine-tuned from allenai/led-base-16384 to condense extensive technical, academic, and narrative content in a fairly generalizable way. - Ideal for summarizing long narratives, articles, papers, textbooks, and other documents. - the sparknotes-esque style leads to 'explanations' in the summarized content, offering insightful output. The model was trained on the BookSum dataset released by SalesForce, which leads to the bsd-3-clause license. The training process involved 16 epochs with parameters tweaked to facilitate very fine-tuning-type training (super low learning rate). This model is the…

Open weights apache-2.0 162M parameters transformers

Model · Summarization

distilbart-news-summarizer

Sachin Rao

Imagine you have a very long news article, and you want someone to read it and tell you the key points in just a few sentences. That's exactly what this model does! This model takes a long news article and turns it into a short, easy-to-read summary. - It writes back a 3-4 sentence summary that captures all the important information The special thing about this model is that it's: 1. Very accurate - It understands news writing style very well 2. Very fast - It works quickly even on regular computers (not just expensive AI servers) 3. Specialized in news - It was trained specifically on news articles, so it understands how journalists write 4. Good with financial news - It knows market…

Open weights agpl-3.0 306M parameters 1,024 tokens transformers

Model · Summarization

kobart-summary-v3

EbanLee

이 모델은 kobart모델을 문서요약, 도서자료요약, 요약문 및 레포트 생성 데이터로 fine-tuning한 모델입니다.

Open weights 124M parameters 1,026 tokens transformers