SAVRN
Search Contact SAVRN

Open-weight model · Time series forecasting

TimeMoE-50M

by Xiaoming Shi Maple728/TimeMoE-50M

This repository contains the weights of the TimeMoE-50M model of the paper Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts. For details on how to use this model, please visit our GitHub page.

Parameters113M
Context4,096
Weights226.8 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads57.1k

Runs On

What it takes to serve TimeMoE-50M (113M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.2 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By Xiaoming Shi, published under apache-2.0, revision 446753ee48ff.

This repository contains the weights of the TimeMoE-50M model of the paper Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts. For details on how to use this model, please visit our GitHub page.

Read Xiaoming Shi's full model card

Model Card for TimeMoE

This repository contains the weights of the TimeMoE-50M model of the paper Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts.

For details on how to use this model, please visit our GitHub page.

Configuration

Architecture
TimeMoeForPrediction
Context length (tokens)
4,096
Layers
12
Hidden size
384
Feed-forward size
1,536
Attention heads
12
Key/value heads
12
Experts
8
Experts active per token
2
RoPE base
10,000
Stored precision
bfloat16
Model type
time_moe

Identity and Version

Repository
Maple728/TimeMoE-50M
Publisher
Xiaoming Shi
Task
Time series forecasting
Modality
Time series
Library
Not stated by the source
Parameters
113M parameters
Languages
Not stated by the source
Revision
446753ee48ff3726d0606a81d0092d54acee995e
First published
2024-09-21
Last updated
2024-10-22

Files and Weights

8 files, 226.8 MB in total. The weights are 1 file totalling 226.8 MB in safetensors.

Weights1 file · 226.8 MB
Configuration5 files · 66.9 KB
Documentation1 file · 399 B
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights226.8 MB 012720983366
config.jsonConfiguration891 B
configuration_time_moe.pyConfiguration2.5 KB
generation_config.jsonConfiguration69 B
modeling_time_moe.pyConfiguration51.9 KB
ts_generation_mixin.pyConfiguration11.5 KB
README.mdDocumentation399 B
.gitattributesRepository1.5 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
226.8 MB
Download from Xiaoming Shi

Released by Xiaoming Shi through its official repository on Hugging Face. Read the license.

Built From

  • Described by arXiv:2409.16040

Memory Requirements

PrecisionWeights in memory
As published226.8 MB
16-bit0.2 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About TimeMoE-50M

How much GPU memory does TimeMoE-50M need?

About 0.3 GB at 16-bit and 0.1 GB at 4-bit: the weights (113M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run TimeMoE-50M on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use TimeMoE-50M commercially?

Yes. TimeMoE-50M is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is TimeMoE-50M's context length?

4,096 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Time series forecasting

MOMENT-1-base

Auton Lab

MOMENT is a family of foundation models for general-purpose time-series analysis. The models in this family (1) serve as a building block for diverse time-series analysis tasks (e.g., forecasting, classification, anomaly detection, and imputation, etc.), (2) are effective out-of-the-box, i.e., with no (or few) task-specific exemplars (enabling e.g., zero-shot forecasting, few-shot classification, etc.), and (3) are tunable using in-distribution and task-specific data to improve performance. For details on MOMENT models, training data, and experimental results, please refer to the paper MOMENT: A Family of Open Time-series Foundation Models. Recommended Python Version: Python 3.11 (support…

Open weights mit 113M parameters transformers

Model · Time series forecasting

moirai-moe-1.0-R-small

Salesforce AI Research

This model has been pushed to the Hub using the PytorchModelHubMixin integration: This release is for research purposes only in support of an academic paper. Our models, datasets, and code are not specifically designed or evaluated for all downstream purposes. We strongly recommend users evaluate and address potential concerns related to accuracy, safety, and fairness before deploying this model. We encourage users to consider the common limitations of AI, comply with applicable laws, and leverage best practices when selecting use cases, particularly for high-risk scenarios where errors or misuse could significantly impact people’s lives, rights, or safety. For further guidance on use…

Open weights cc-by-nc-4.0 117M parameters

Model · Time series forecasting

chronos-2-synth

Autogluon

This is a variant of the Chronos-2 model which has only been trained on synthetic univariate and multivariate data. For usage and details on the Chronos-2 model, please refer to https://huggingface.co/autogluon/chronos-2. If you find Chronos-2 useful for your research, please consider citing the associated paper

Open weights apache-2.0 119M parameters chronos-forecasting

Model · Time series forecasting

chronos-2

Amazon

Update Jun 5, 2026: Deploy Chronos-2 on AWS with AutoGluon-Cloud. Real-time, serverless, or batch inference in 3 lines of code — pandas DataFrames in, forecasts out. Check out the new deployment guide. Chronos-2 is a 120M-parameter, encoder-only time series foundation model for zero-shot forecasting. It supports univariate, multivariate, and covariate-informed tasks within a single architecture. Inspired by the T5 encoder, Chronos-2 produces multi-step-ahead quantile forecasts and uses a group attention mechanism for efficient in-context learning across related series and covariates. Trained on a combination of real-world and large-scale synthetic datasets, it achieves state-of-the-art…

Open weights apache-2.0 119M parameters chronos-forecasting

Model · Time series forecasting

chronos-2

Autogluon

Update Jun 5, 2026: Deploy Chronos-2 on AWS with AutoGluon-Cloud. Real-time, serverless, or batch inference in 3 lines of code — pandas DataFrames in, forecasts out. Check out the new deployment guide. Chronos-2 is a 120M-parameter, encoder-only time series foundation model for zero-shot forecasting. It supports univariate, multivariate, and covariate-informed tasks within a single architecture. Inspired by the T5 encoder, Chronos-2 produces multi-step-ahead quantile forecasts and uses a group attention mechanism for efficient in-context learning across related series and covariates. Trained on a combination of real-world and large-scale synthetic datasets, it achieves state-of-the-art…

Open weights apache-2.0 119M parameters chronos-forecasting

Model · Time series forecasting

Kronos-base

ShiYu

Kronos is the first open-source foundation model for financial candlesticks (K-lines), trained on data from over 45 global exchanges. It is designed to handle the unique, high-noise characteristics of financial data. Kronos is a family of decoder-only foundation models, pre-trained specifically for the "language" of financial markets—K-line sequences. It leverages a novel two-stage framework: 1. A specialized tokenizer first quantizes continuous, multi-dimensional K-line data (OHLCV) into hierarchical discrete tokens. 2. A large, autoregressive Transformer is then pre-trained on these tokens, enabling it to serve as a unified model for diverse quantitative tasks. The success of large-scale…

Open weights mit 102M parameters