Moirai, the Masked Encoder-based Universal Time Series Forecasting Transformer is a Large Time Series Model pre-trained on LOTSA data. For more details on the Moirai architecture, training, and results, please refer to the paper. Fig. 1: Overall architecture of Moirai. Visualized is a 3-variate time series, where variates 0 and 1 are target variables (i.e. to be forecasted, and variate 2 is a dynamic covariate (values in forecast horizon known). Based on a patch size of 64, each variate is patchified into 3 tokens. The patch embeddings along with sequence and variate id are fed into the Transformer. The shaded patches represent the forecast horizon to be forecasted, whose corresponding…
Open weights
cc-by-nc-4.0
311M parameters
transformers
Model · Time series forecasting
Datadog
Toto (Time Series Optimized Transformer for Observability) is a family of time series foundation models for multivariate forecasting developed by Datadog. Toto 2.0 is the current generation, featuring u-μP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family. The family sets a new state of the art on three forecasting benchmarks: BOOM, our observability benchmark; GIFT-Eval, the standard general-purpose benchmark; and the recent contamination-resistant TIME benchmark. Inference code is available on GitHub. For more examples, see the Quick Start notebook and GluonTS integration…
Open weights
apache-2.0
313M parameters
pytorch
Model · Time series forecasting
Google
TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting. This repository contains the official PyTorch weights and configurations for TimesFM 3.0. This model is released under the TimesFM Non-Commercial License v1.0. timesfm-3.0 is pretrained using - GiftEvalPretrain excluding the datasets that overlap with fev-bench - Wikipedia Pageviews, cutoff Nov 2023 (see paper for details). - Google Trends top queries, cutoff EoY 2022 (see paper for details). - Synthetic and augmented data. title={A decoder-only foundation model for time-series forecasting}, author={Das, Abhimanyu and Kong, Weihao and Sen, Rajat and…
Open weights
other
331M parameters
MOMENT is a family of foundation models for general-purpose time-series analysis. The models in this family (1) serve as a building block for diverse time-series analysis tasks (e.g., forecasting, classification, anomaly detection, and imputation, etc.), (2) are effective out-of-the-box, i.e., with no (or few) task-specific exemplars (enabling e.g., zero-shot forecasting, few-shot classification, etc.), and (3) are tunable using in-distribution and task-specific data to improve performance. For details on MOMENT models, training data, and experimental results, please refer to the paper MOMENT: A Family of Open Time-series Foundation Models. Recommended Python Version: Python 3.11 (support…
Open weights
mit
346M parameters
transformers
PatchTST was originally released prior to the interest in creating pre-trained, zero-shot time series foundation models that were capable of state-of-the-art performance on out of sample datasets. PatchTST-FM (patched time-series transformer-based foundation model) essentially has the architectural simplicity of PatchTST, but differs in some crucial ways. Coupled with a revised training strategy and a significantly larger training corpus, we are able to train a model that achieves state-of-the-art results on GiftEval (see below for recommended filters to view this on the leaderboard). The architecture incorporates the following changes: - residual blocks in the input and output projections…
Open weights
apache-2.0
258M parameters
This model card is for the non-commercial, research version of PatchTST-FM-r1. Please also check-out the Apache-2.0 licensed IBM Granite version. PatchTST was originally released prior to the interest in creating pre-trained, zero-shot time series foundation models that were capable of state-of-the-art performance on out of sample datasets. PatchTST-FM (patched time-series transformer-based foundation model) essentially has the architectural simplicity of PatchTST, but differs in some crucial ways. Coupled with a revised training strategy and a significantly larger training corpus, we are able to train a model that achieves state-of-the-art results on GiftEval. The architecture incorporates…
Open weights
cc-by-nc-sa-4.0
258M parameters