Official fitted Jacobian lens for JLD and JLD-fast, by Shreshth Saini, Balu Adsumilli, and Alan C. Bovik. JLD measures the perceptual distance between an aligned reference image and a distorted image. Lower scores mean more similar images. It projects early DINOv2 patch features onto directions selected by the encoder's output sensitivity. The lens is fitted from unlabeled images without human quality ratings. This installs the versioned release wheel and records it in uv.lock. The distribution is named jacobian-lens-distance; the Python import remains jld. The package already includes this lens. The encoder weights are downloaded separately through timm on first use. Python 3.10 or newer…
TTVidT-decoders is an open-weight model for other from Shih-Ying Yeh, released under Apache License 2.0. Its published files total 51.8 GB.
Pretrained DiT decoders for TT-VidT (Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining, NeurIPS 2026).
Model Card
By Shih-Ying Yeh, published under apache-2.0, revision 9aba56699397.
Pretrained DiT decoders for TT-VidT (Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining, NeurIPS 2026). Paper · Each TT-VidT encoder pretraining run initialises its decoder from one of these; the training code downloads them automatically through DECODERPRETRAINED, e.g. "KBlueLeaf/TTVidT-decoders/pretrainvideoSqknorm". The decoders work in the 32x32x4 latent space of the frozen f8 frame VAE KBlueLeaf/latentmaid-vae and are conditioned on DINOv3 ViT-B/16 features (768-d). - ImageNet decoders reconstruct an ImageNet image from its DINOv3 class token. - Video decoders reconstruct a later video frame from its class token plus, through cross-attention, the spatial…
Read Shih-Ying Yeh's full model card
TT-VidT pretrained DiT decoders
Pretrained DiT decoders for TT-VidT (Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining, NeurIPS 2026). Paper · Project page
Each TT-VidT encoder pretraining run initialises its decoder from one of
these; the training code downloads them automatically through DECODER_PRETRAINED,
e.g. "KBlueLeaf/TTVidT-decoders/pretrain_video_S_qknorm".
The decoders work in the 32x32x4 latent space of the frozen f8 frame VAE
KBlueLeaf/latentmaid-vae and are
conditioned on DINOv3 ViT-B/16 features (768-d).
- ImageNet decoders reconstruct an ImageNet image from its DINOv3 class token.
- Video decoders reconstruct a later video frame from its class token plus, through cross-attention, the spatial features of an earlier frame.
Files
Each decoder is <name>.safetensors plus <name>.json, which holds the decoder
config (decoder_config), the latent size and the latent statistics used in training.
pretrain_{imgnet,video}_{S,B,L}_<variant>:
| Size | Hidden | Layers | Heads |
|---|---|---|---|
| S | 768 | 12 | 12 |
| B | 1024 | 16 | 16 |
| L | 1152 | 28 | 16 |
| Variant | Meaning |
|---|---|
qknorm |
QK-norm attention, diffusion head |
qknorm_nofinal |
as above, without the final norm |
qknorm_reg, qknorm_nofinal_reg |
latent-regression head instead of diffusion |
768d12l, 1024d16l, 1152d28l (_80k) |
earlier runs without QK-norm |
The ones used in the paper's configs:
| Decoder | Used by |
|---|---|
pretrain_imgnet_S_qknorm |
objective / encoder sweep |
pretrain_video_S_qknorm |
TT-VidT |
pretrain_imgnet_S_qknorm_nofinal |
DisMo-2D3D with dual augmentation |
pretrain_{imgnet,video}_B_qknorm_nofinal, pretrain_{imgnet,video}_L_qknorm |
decoder ablation |
Recipe: 100k steps (80k for _80k), global batch 256, AdamW lr 1e-4. See the
code repository for training and usage.
Identity and Version
- Repository
- KBlueLeaf/TTVidT-decoders
- Publisher
- Shih-Ying Yeh
- Task
- Other
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 9aba566993972d45050109ac7ed1b1e3635b3a48
- First published
- 2026-03-26
- Last updated
- 2026-09-30
Files and Weights
62 files, 51.8 GB in total. The weights are 30 files totalling 51.8 GB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| pretrain_imgnet_B_1024d16l.safetensors | Weights | 1.6 GB | 71d51a561eaf |
| pretrain_imgnet_B_qknorm.safetensors | Weights | 1.5 GB | 23738d11fa3b |
| pretrain_imgnet_B_qknorm_nofinal.safetensors | Weights | 1.5 GB | 8912e6827055 |
| pretrain_imgnet_B_qknorm_nofinal_reg.safetensors | Weights | 1.5 GB | fc68f22585f2 |
| pretrain_imgnet_B_qknorm_reg.safetensors | Weights | 1.5 GB | 8f00f2b06db9 |
| pretrain_imgnet_L_1152d28l.safetensors | Weights | 3.0 GB | dbb10311cb4b |
| pretrain_imgnet_L_qknorm.safetensors | Weights | 3.0 GB | 18b6630f9bd6 |
| pretrain_imgnet_L_qknorm_nofinal.safetensors | Weights | 3.0 GB | c806ed265265 |
| pretrain_imgnet_L_qknorm_nofinal_reg.safetensors | Weights | 3.0 GB | eeb821fd992b |
| pretrain_imgnet_L_qknorm_reg.safetensors | Weights | 3.0 GB | ddfd701846a4 |
| pretrain_imgnet_S_768d12l.safetensors | Weights | 656.8 MB | 5160b2f96b77 |
| pretrain_imgnet_S_qknorm.safetensors | Weights | 654.1 MB | 58d3b381d186 |
| pretrain_imgnet_S_qknorm_nofinal.safetensors | Weights | 654.1 MB | f57d06477444 |
| pretrain_imgnet_S_qknorm_nofinal_reg.safetensors | Weights | 651.7 MB | 2c2228359f98 |
| pretrain_imgnet_S_qknorm_reg.safetensors | Weights | 651.7 MB | 4de694e86d59 |
| pretrain_video_B_1024d16l.safetensors | Weights | 1.6 GB | 47fe8dd97160 |
| pretrain_video_B_qknorm.safetensors | Weights | 1.5 GB | e410d4ff2a46 |
| pretrain_video_B_qknorm_nofinal.safetensors | Weights | 1.5 GB | f027e21dfa68 |
| pretrain_video_B_qknorm_nofinal_reg.safetensors | Weights | 1.5 GB | 919b01a1d8d3 |
| pretrain_video_B_qknorm_reg.safetensors | Weights | 1.5 GB | db8713827a74 |
| pretrain_video_L_1152d28l_80k.safetensors | Weights | 3.0 GB | 258ef38f5f41 |
| pretrain_video_L_qknorm.safetensors | Weights | 3.0 GB | 49e3b7b1d430 |
| pretrain_video_L_qknorm_nofinal.safetensors | Weights | 3.0 GB | 1726b6f3bdf4 |
| pretrain_video_L_qknorm_nofinal_reg.safetensors | Weights | 3.0 GB | 7d8841897d20 |
| pretrain_video_L_qknorm_reg.safetensors | Weights | 3.0 GB | ea1ef6a47fb3 |
| pretrain_video_S_768d12l.safetensors | Weights | 656.8 MB | cea31019a66e |
| pretrain_video_S_qknorm.safetensors | Weights | 654.1 MB | 79067d2ecc53 |
| pretrain_video_S_qknorm_nofinal.safetensors | Weights | 654.1 MB | e63d0b9b2485 |
| pretrain_video_S_qknorm_nofinal_reg.safetensors | Weights | 651.7 MB | e3a2f8a2207d |
| pretrain_video_S_qknorm_reg.safetensors | Weights | 651.7 MB | 6a0a69510f1c |
| pretrain_imgnet_B_1024d16l.json | Configuration | 542 B | — |
| pretrain_imgnet_B_qknorm.json | Configuration | 615 B | — |
| pretrain_imgnet_B_qknorm_nofinal.json | Configuration | 616 B | — |
| pretrain_imgnet_B_qknorm_nofinal_reg.json | Configuration | 617 B | — |
| pretrain_imgnet_B_qknorm_reg.json | Configuration | 616 B | — |
| pretrain_imgnet_L_1152d28l.json | Configuration | 542 B | — |
| pretrain_imgnet_L_qknorm.json | Configuration | 615 B | — |
| pretrain_imgnet_L_qknorm_nofinal.json | Configuration | 616 B | — |
| pretrain_imgnet_L_qknorm_nofinal_reg.json | Configuration | 617 B | — |
| pretrain_imgnet_L_qknorm_reg.json | Configuration | 616 B | — |
| pretrain_imgnet_S_768d12l.json | Configuration | 541 B | — |
| pretrain_imgnet_S_qknorm.json | Configuration | 614 B | — |
| pretrain_imgnet_S_qknorm_nofinal.json | Configuration | 615 B | — |
| pretrain_imgnet_S_qknorm_nofinal_reg.json | Configuration | 616 B | — |
| pretrain_imgnet_S_qknorm_reg.json | Configuration | 615 B | — |
| pretrain_video_B_1024d16l.json | Configuration | 539 B | — |
| pretrain_video_B_qknorm.json | Configuration | 612 B | — |
| pretrain_video_B_qknorm_nofinal.json | Configuration | 613 B | — |
| pretrain_video_B_qknorm_nofinal_reg.json | Configuration | 614 B | — |
| pretrain_video_B_qknorm_reg.json | Configuration | 613 B | — |
| pretrain_video_L_1152d28l_80k.json | Configuration | 538 B | — |
| pretrain_video_L_qknorm.json | Configuration | 612 B | — |
| pretrain_video_L_qknorm_nofinal.json | Configuration | 613 B | — |
| pretrain_video_L_qknorm_nofinal_reg.json | Configuration | 614 B | — |
| pretrain_video_L_qknorm_reg.json | Configuration | 613 B | — |
| pretrain_video_S_768d12l.json | Configuration | 538 B | — |
| pretrain_video_S_qknorm.json | Configuration | 611 B | — |
| pretrain_video_S_qknorm_nofinal.json | Configuration | 612 B | — |
| pretrain_video_S_qknorm_nofinal_reg.json | Configuration | 613 B | — |
| pretrain_video_S_qknorm_reg.json | Configuration | 612 B | — |
| README.md | Documentation | 2.2 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 51.8 GB
Released by Shih-Ying Yeh through its official repository on Hugging Face. Read the license.
Built From
- Described by arXiv:2609.33419
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 51.8 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About TTVidT-decoders
Can I use TTVidT-decoders commercially?
Yes. TTVidT-decoders is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
Similar Models
ONNX conversion of cua-ai/cua-s1-forms, prepared for lightweight local inference experiments with ONNX Runtime, ONNX Runtime Web, WebAssembly (WASM), and WebGPU. Please read the original model card before using this conversion. It contains the authoritative description of the model's architecture, training setup, evaluation, limitations, and intended scope. CUA-S1 Forms is a small specialist "System One" model for form-oriented computer-use tasks. Unlike an autoregressive LLM, it does not generate text token-by-token. For each UI element, it receives: 1. a short structured context describing the task, form, and element, and 2. a set of candidate options such as extracted document values…
Sculpt real ECMWF ERA5 atmospheric state into publish-ready video, GIF, and sound. Not animation. Not simulation. Real observed weather, rendered through 4 tuned presets. - Global 0.25 deg x 7 days (5 variables: t2m, u10, v10, tp, msl) - China region 0.25 deg x 30 days (5 variables) - 4 presets: temperature waves / wind streamlines / rain curtain / pressure vortex - Weather sonification (WAV) - "hear" the atmosphere - Pre-downloaded, zstd-compressed, SHA-256 checksummed https://roblitz-spec.github.io/weather-sculpt/ - Full dataset + commercial license: https://robloxer31.gumroad.com/l/Weather-Sculpt ECMWF ERA5 reanalysis (CC-BY 4.0). The same dataset used by meteorologists worldwide.
A frozen, non-learning recursive network built on the real fruit-fly MaleCNS connectome (Janelia 2024). Feed any stimulus, get an organic, structured "instinctive" signal that is more alive than noise, less predictable than a script. Not AI. Not a brain. Not learning. Just real neural wiring, frozen. - Real MaleCNS connectome subset (1,587,930 edges, ~25 MB) - 4 tuned presets: escape / sugar / startle / explore - Zero training. Weight-frozen. Deterministic per seed. https://roblitz-spec.github.io/fly-instinct/ - Full 1.05GB connectome + commercial license: https://robloxer31.gumroad.com/l/Fly-Instinct
NYS is not a transformer. It is a coupled-oscillator organism: phases \(\thetai\), amplitudes, natural frequencies \(\omegai\), and a sparse coupling graph \(K\). Language, compiler bits, and speech-frame IDs live on one graph (\(N = 5{,}000{,}000\) nodes, \(k = 512\) edges per node). The native graph trains by Equilibrium Propagation (free RK4, then same-moment free/nudged branches, then a contrastive \(K\) update), without backprop or a cross-entropy objective. A separate sparse context head now provides retrieved language inputs. The GPU Qwen teacher uses PyTorch/Transformers; that does not make the native graph a transformer. Dakuwon Moody (YNSScarSaiyan) · Saiyan Corp The…
Reference Machine: Apple M3 Max (16 CPU cores, 40 Metal GPU cores, 16 Apple Neural Engine cores, 48 GB Unified Memory) - Unlocking the Apple Neural Engine for Physical AI: While Apple's 16-Core NPU (38 TOPS) was designed primarily for vision and speech, physical PDE operators historically failed to run on it due to unsupported tensor primitives. By algebraically reformulating complex Fourier spectral convolutions and dynamic graph scatter into native Apple Machine Intermediate Language (MIL) representations, all 8 foundation networks achieve up to 98.4% ANE execution with 0 CPU fallbacks. - Extreme Energy Efficiency (0.071 J / step for ANE aerodynamic solver to 10.8 J for global weather at…
