Skip to page content
SAVRN
Search Plan a project

Open-weight model · Other

TTVidT-decoders

by Shih-Ying Yeh KBlueLeaf/TTVidT-decoders

TTVidT-decoders is an open-weight model for other from Shih-Ying Yeh, released under Apache License 2.0. Its published files total 51.8 GB.

Pretrained DiT decoders for TT-VidT (Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining, NeurIPS 2026).

Parameters—
Context—
Weights51.8 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Shih-Ying Yeh, published under apache-2.0, revision 9aba56699397.

Pretrained DiT decoders for TT-VidT (Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining, NeurIPS 2026). Paper · Each TT-VidT encoder pretraining run initialises its decoder from one of these; the training code downloads them automatically through DECODERPRETRAINED, e.g. "KBlueLeaf/TTVidT-decoders/pretrainvideoSqknorm". The decoders work in the 32x32x4 latent space of the frozen f8 frame VAE KBlueLeaf/latentmaid-vae and are conditioned on DINOv3 ViT-B/16 features (768-d). - ImageNet decoders reconstruct an ImageNet image from its DINOv3 class token. - Video decoders reconstruct a later video frame from its class token plus, through cross-attention, the spatial…

Read Shih-Ying Yeh's full model card

TT-VidT pretrained DiT decoders

Pretrained DiT decoders for TT-VidT (Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining, NeurIPS 2026). Paper · Project page

Each TT-VidT encoder pretraining run initialises its decoder from one of these; the training code downloads them automatically through DECODER_PRETRAINED, e.g. "KBlueLeaf/TTVidT-decoders/pretrain_video_S_qknorm".

The decoders work in the 32x32x4 latent space of the frozen f8 frame VAE KBlueLeaf/latentmaid-vae and are conditioned on DINOv3 ViT-B/16 features (768-d).

  • ImageNet decoders reconstruct an ImageNet image from its DINOv3 class token.
  • Video decoders reconstruct a later video frame from its class token plus, through cross-attention, the spatial features of an earlier frame.

Files

Each decoder is <name>.safetensors plus <name>.json, which holds the decoder config (decoder_config), the latent size and the latent statistics used in training.

pretrain_{imgnet,video}_{S,B,L}_<variant>:

Size Hidden Layers Heads
S 768 12 12
B 1024 16 16
L 1152 28 16
Variant Meaning
qknorm QK-norm attention, diffusion head
qknorm_nofinal as above, without the final norm
qknorm_reg, qknorm_nofinal_reg latent-regression head instead of diffusion
768d12l, 1024d16l, 1152d28l (_80k) earlier runs without QK-norm

The ones used in the paper's configs:

Decoder Used by
pretrain_imgnet_S_qknorm objective / encoder sweep
pretrain_video_S_qknorm TT-VidT
pretrain_imgnet_S_qknorm_nofinal DisMo-2D3D with dual augmentation
pretrain_{imgnet,video}_B_qknorm_nofinal, pretrain_{imgnet,video}_L_qknorm decoder ablation

Recipe: 100k steps (80k for _80k), global batch 256, AdamW lr 1e-4. See the code repository for training and usage.

Identity and Version

Repository
KBlueLeaf/TTVidT-decoders
Publisher
Shih-Ying Yeh
Task
Other
Modality
Other
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
9aba566993972d45050109ac7ed1b1e3635b3a48
First published
2026-03-26
Last updated
2026-09-30

Files and Weights

62 files, 51.8 GB in total. The weights are 30 files totalling 51.8 GB in safetensors.

Weights30 files · 51.8 GB
Configuration30 files · 18.0 KB
Documentation1 file · 2.2 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
pretrain_imgnet_B_1024d16l.safetensorsWeights1.6 GB 71d51a561eaf
pretrain_imgnet_B_qknorm.safetensorsWeights1.5 GB 23738d11fa3b
pretrain_imgnet_B_qknorm_nofinal.safetensorsWeights1.5 GB 8912e6827055
pretrain_imgnet_B_qknorm_nofinal_reg.safetensorsWeights1.5 GB fc68f22585f2
pretrain_imgnet_B_qknorm_reg.safetensorsWeights1.5 GB 8f00f2b06db9
pretrain_imgnet_L_1152d28l.safetensorsWeights3.0 GB dbb10311cb4b
pretrain_imgnet_L_qknorm.safetensorsWeights3.0 GB 18b6630f9bd6
pretrain_imgnet_L_qknorm_nofinal.safetensorsWeights3.0 GB c806ed265265
pretrain_imgnet_L_qknorm_nofinal_reg.safetensorsWeights3.0 GB eeb821fd992b
pretrain_imgnet_L_qknorm_reg.safetensorsWeights3.0 GB ddfd701846a4
pretrain_imgnet_S_768d12l.safetensorsWeights656.8 MB 5160b2f96b77
pretrain_imgnet_S_qknorm.safetensorsWeights654.1 MB 58d3b381d186
pretrain_imgnet_S_qknorm_nofinal.safetensorsWeights654.1 MB f57d06477444
pretrain_imgnet_S_qknorm_nofinal_reg.safetensorsWeights651.7 MB 2c2228359f98
pretrain_imgnet_S_qknorm_reg.safetensorsWeights651.7 MB 4de694e86d59
pretrain_video_B_1024d16l.safetensorsWeights1.6 GB 47fe8dd97160
pretrain_video_B_qknorm.safetensorsWeights1.5 GB e410d4ff2a46
pretrain_video_B_qknorm_nofinal.safetensorsWeights1.5 GB f027e21dfa68
pretrain_video_B_qknorm_nofinal_reg.safetensorsWeights1.5 GB 919b01a1d8d3
pretrain_video_B_qknorm_reg.safetensorsWeights1.5 GB db8713827a74
pretrain_video_L_1152d28l_80k.safetensorsWeights3.0 GB 258ef38f5f41
pretrain_video_L_qknorm.safetensorsWeights3.0 GB 49e3b7b1d430
pretrain_video_L_qknorm_nofinal.safetensorsWeights3.0 GB 1726b6f3bdf4
pretrain_video_L_qknorm_nofinal_reg.safetensorsWeights3.0 GB 7d8841897d20
pretrain_video_L_qknorm_reg.safetensorsWeights3.0 GB ea1ef6a47fb3
pretrain_video_S_768d12l.safetensorsWeights656.8 MB cea31019a66e
pretrain_video_S_qknorm.safetensorsWeights654.1 MB 79067d2ecc53
pretrain_video_S_qknorm_nofinal.safetensorsWeights654.1 MB e63d0b9b2485
pretrain_video_S_qknorm_nofinal_reg.safetensorsWeights651.7 MB e3a2f8a2207d
pretrain_video_S_qknorm_reg.safetensorsWeights651.7 MB 6a0a69510f1c
pretrain_imgnet_B_1024d16l.jsonConfiguration542 B —
pretrain_imgnet_B_qknorm.jsonConfiguration615 B —
pretrain_imgnet_B_qknorm_nofinal.jsonConfiguration616 B —
pretrain_imgnet_B_qknorm_nofinal_reg.jsonConfiguration617 B —
pretrain_imgnet_B_qknorm_reg.jsonConfiguration616 B —
pretrain_imgnet_L_1152d28l.jsonConfiguration542 B —
pretrain_imgnet_L_qknorm.jsonConfiguration615 B —
pretrain_imgnet_L_qknorm_nofinal.jsonConfiguration616 B —
pretrain_imgnet_L_qknorm_nofinal_reg.jsonConfiguration617 B —
pretrain_imgnet_L_qknorm_reg.jsonConfiguration616 B —
pretrain_imgnet_S_768d12l.jsonConfiguration541 B —
pretrain_imgnet_S_qknorm.jsonConfiguration614 B —
pretrain_imgnet_S_qknorm_nofinal.jsonConfiguration615 B —
pretrain_imgnet_S_qknorm_nofinal_reg.jsonConfiguration616 B —
pretrain_imgnet_S_qknorm_reg.jsonConfiguration615 B —
pretrain_video_B_1024d16l.jsonConfiguration539 B —
pretrain_video_B_qknorm.jsonConfiguration612 B —
pretrain_video_B_qknorm_nofinal.jsonConfiguration613 B —
pretrain_video_B_qknorm_nofinal_reg.jsonConfiguration614 B —
pretrain_video_B_qknorm_reg.jsonConfiguration613 B —
pretrain_video_L_1152d28l_80k.jsonConfiguration538 B —
pretrain_video_L_qknorm.jsonConfiguration612 B —
pretrain_video_L_qknorm_nofinal.jsonConfiguration613 B —
pretrain_video_L_qknorm_nofinal_reg.jsonConfiguration614 B —
pretrain_video_L_qknorm_reg.jsonConfiguration613 B —
pretrain_video_S_768d12l.jsonConfiguration538 B —
pretrain_video_S_qknorm.jsonConfiguration611 B —
pretrain_video_S_qknorm_nofinal.jsonConfiguration612 B —
pretrain_video_S_qknorm_nofinal_reg.jsonConfiguration613 B —
pretrain_video_S_qknorm_reg.jsonConfiguration612 B —
README.mdDocumentation2.2 KB —
.gitattributesRepository1.5 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
51.8 GB
Download from Shih-Ying Yeh

Released by Shih-Ying Yeh through its official repository on Hugging Face. Read the license.

Built From

  • Described by arXiv:2609.33419

Memory Requirements

PrecisionWeights in memory
As published51.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About TTVidT-decoders

Can I use TTVidT-decoders commercially?

Yes. TTVidT-decoders is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Other

JLD

Shreshth

Official fitted Jacobian lens for JLD and JLD-fast, by Shreshth Saini, Balu Adsumilli, and Alan C. Bovik. JLD measures the perceptual distance between an aligned reference image and a distorted image. Lower scores mean more similar images. It projects early DINOv2 patch features onto directions selected by the encoder's output sensitivity. The lens is fitted from unlabeled images without human quality ratings. This installs the versioned release wheel and records it in uv.lock. The distribution is named jacobian-lens-distance; the Python import remains jld. The package already includes this lens. The encoder weights are downloaded separately through timm on first use. Python 3.10 or newer…

Open weights mit jld

ONNX conversion of cua-ai/cua-s1-forms, prepared for lightweight local inference experiments with ONNX Runtime, ONNX Runtime Web, WebAssembly (WASM), and WebGPU. Please read the original model card before using this conversion. It contains the authoritative description of the model's architecture, training setup, evaluation, limitations, and intended scope. CUA-S1 Forms is a small specialist "System One" model for form-oriented computer-use tasks. Unlike an autoregressive LLM, it does not generate text token-by-token. For each UI element, it receives: 1. a short structured context describing the task, form, and element, and 2. a set of candidate options such as extracted document values…

Open weights mit

Model · Other

weather-sculpt

Z

Sculpt real ECMWF ERA5 atmospheric state into publish-ready video, GIF, and sound. Not animation. Not simulation. Real observed weather, rendered through 4 tuned presets. - Global 0.25 deg x 7 days (5 variables: t2m, u10, v10, tp, msl) - China region 0.25 deg x 30 days (5 variables) - 4 presets: temperature waves / wind streamlines / rain curtain / pressure vortex - Weather sonification (WAV) - "hear" the atmosphere - Pre-downloaded, zstd-compressed, SHA-256 checksummed https://roblitz-spec.github.io/weather-sculpt/ - Full dataset + commercial license: https://robloxer31.gumroad.com/l/Weather-Sculpt ECMWF ERA5 reanalysis (CC-BY 4.0). The same dataset used by meteorologists worldwide.

Open weights mit custom

Model · Other

fly-instinct

Z

A frozen, non-learning recursive network built on the real fruit-fly MaleCNS connectome (Janelia 2024). Feed any stimulus, get an organic, structured "instinctive" signal that is more alive than noise, less predictable than a script. Not AI. Not a brain. Not learning. Just real neural wiring, frozen. - Real MaleCNS connectome subset (1,587,930 edges, ~25 MB) - 4 tuned presets: escape / sugar / startle / explore - Zero training. Weight-frozen. Deterministic per seed. https://roblitz-spec.github.io/fly-instinct/ - Full 1.05GB connectome + commercial license: https://robloxer31.gumroad.com/l/Fly-Instinct

Open weights mit custom

Model · Other

nys-sft-public

Dakuwon Moody

NYS is not a transformer. It is a coupled-oscillator organism: phases \(\thetai\), amplitudes, natural frequencies \(\omegai\), and a sparse coupling graph \(K\). Language, compiler bits, and speech-frame IDs live on one graph (\(N = 5{,}000{,}000\) nodes, \(k = 512\) edges per node). The native graph trains by Equilibrium Propagation (free RK4, then same-moment free/nudged branches, then a contrastive \(K\) update), without backprop or a cross-entropy objective. A separate sparse context head now provides retrieved language inputs. The GPU Qwen teacher uses PyTorch/Transformers; that does not make the native graph a transformer. Dakuwon Moody (YNSScarSaiyan) · Saiyan Corp The…

Open weights mit nys-thermodynamic

Reference Machine: Apple M3 Max (16 CPU cores, 40 Metal GPU cores, 16 Apple Neural Engine cores, 48 GB Unified Memory) - Unlocking the Apple Neural Engine for Physical AI: While Apple's 16-Core NPU (38 TOPS) was designed primarily for vision and speech, physical PDE operators historically failed to run on it due to unsupported tensor primitives. By algebraically reformulating complex Fourier spectral convolutions and dynamic graph scatter into native Apple Machine Intermediate Language (MIL) representations, all 8 foundation networks achieve up to 98.4% ANE execution with 0 CPU fallbacks. - Extreme Energy Efficiency (0.071 J / step for ANE aerodynamic solver to 10.8 J for global weather at…

Open weights apache-2.0 coreml