captioning pretrained on COCO dataset - base architecture (with ViT base backbone). Authors from the paper write in the abstract: Vision-Language Pre-training (VLP) has advanced the performance for many vision-language tasks. However, most existing pre-trained models only excel in either understanding-based tasks or generation-based tasks. Furthermore, performance improvement has been largely achieved by scaling up the dataset with noisy image-text pairs collected from the web, which is a suboptimal source of supervision. In this paper, we propose BLIP, a new VLP framework which transfers flexibly to both vision-language understanding and generation tasks. BLIP effectively utilizes the…
Open weights
bsd-3-clause
512 tokens
transformers
Audio Spectrogram Transformer (AST) model fine-tuned on AudioSet. It was introduced in the paper AST: Audio Spectrogram Transformer by Gong et al. and first released in this repository. Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks. You can use the raw model for classifying audio into one of the AudioSet classes. See…
Open weights
bsd-3-clause
87M parameters
transformers
captioning pretrained on COCO dataset - base architecture (with ViT large backbone). Authors from the paper write in the abstract: Vision-Language Pre-training (VLP) has advanced the performance for many vision-language tasks. However, most existing pre-trained models only excel in either understanding-based tasks or generation-based tasks. Furthermore, performance improvement has been largely achieved by scaling up the dataset with noisy image-text pairs collected from the web, which is a suboptimal source of supervision. In this paper, we propose BLIP, a new VLP framework which transfers flexibly to both vision-language understanding and generation tasks. BLIP effectively utilizes the…
Open weights
bsd-3-clause
470M parameters
512 tokens
transformers
Audio Spectrogram Transformer (AST) model fine-tuned on AudioSet. It was introduced in the paper AST: Audio Spectrogram Transformer by Gong et al. and first released in this repository. Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks. You can use the raw model for classifying audio into one of the AudioSet classes. See…
Open weights
bsd-3-clause
86M parameters
transformers
Audio Spectrogram Transformer (AST) model fine-tuned on Speech Commands v2. It was introduced in the paper AST: Audio Spectrogram Transformer by Gong et al. and first released in this repository. Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks. You can use the raw model for classifying audio into one of the Speech…
Open weights
bsd-3-clause
85M parameters
transformers
This model is a fine-tuned version of MIT/ast-finetuned-audioset-10-10-0.4593 on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 1e-05 - trainbatchsize: 16 - evalbatchsize: 16 - lrschedulertype: linear - lrschedulerwarmupsteps: 10 - numepochs: 4 - mixedprecisiontraining: Native AMP - Transformers 5.16.1 - Pytorch 2.11.0+cu128 - Datasets 4.8.5 - Tokenizers 0.23.1
Open weights
bsd-3-clause
86M parameters
transformers
These are the checkpoints the latents in were recorded from. E05-FT S01 is not the shipped atmosphere (S03). The kit/ folder holds what a 2015 atmosphere run needs besides the checkpoint: the initial condition (2015-01-03 12:00), two months of forcing (the inputs only), and configs for the control and each intervention. One run uses about 4 GB of GPU memory. Every config sets seed: 0. Keep it: the model is stochastic, and a shared seed is what makes two runs comparable node for node. Change the intervention by editing the overwrite block; make it longer with nforwardsteps (the forcing covers January and February 2015). To record the latents as well, and to steer a layer along a feature, use…
Open weights
bsd-3-clause
Working implementation of Albef for Multitask using a large configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adam with a step schedule. These are starting values in the script, not evidence of a completed…
Open weights
bsd-3-clause
33,088 parameters
256 tokens
Velocity-commanded walking policy for Asimov 1, trained in Isaac Lab with PPO. It is a base walk meant for later skills to build on: forward, backward and sideways walking, turning while walking or on the spot, and standing still. The gait was shaped with a reference cycle from an everyday human walk (CMU motion capture, retargeted with GMR) and a light AMP style reward. It was then trained further for balance (pushes from every direction, steady forces, harder terrain) and for robustness to differences between simulation and the robot (IMU tilt bias, motor strength and gain changes, extra mass, command latency, joint friction, low-friction floors). A terrain height map was used by the…
Open weights
bsd-3-clause
asimov
A research-oriented Blip prototype targeting Contrastive. The included base setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adafactor with a cosine schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
33,088 parameters
256 tokens
This repository is a compact, custom PyTorch implementation of Poolformer for Retrieval. The large configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a constant warmup schedule.…
Open weights
bsd-3-clause
33,088 parameters
256 tokens
A research-oriented Beit prototype targeting Matching. The included tiny setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses sgd with a onecycle schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
49,600 parameters
128 tokens
Working implementation of Beit for Matching using a nano configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adafactor with a step schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
33,088 parameters
128 tokens
A research-oriented Beit prototype targeting Retrieval. The included small setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adafactor with a polynomial schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
24,832 parameters
512 tokens
This repository is a compact, custom PyTorch implementation of Blip for Generation. The nano configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adamw with a exponential schedule. These are…
Open weights
bsd-3-clause
24,832 parameters
128 tokens
V
Model · Text generation
Venky
A LoRA adapter for Qwen2.5-Coder-7B-Instruct that predicts, from the code alone, whether a Verilog design change will fail its test bench before any simulator is run. It exists to sit in front of the expensive evaluation stage of an agentic hardware design loop. Simulation is slow and costly, and many agent proposals are simply wrong. This model triages them. Every frontier model tested carries the same wrong prior: that any edit to working code is probably a bug. That produces near-perfect recall and poor precision, so the gate throws away a large share of perfectly good designs. This adapter was trained on data containing verified-harmless edits alongside real faults, which attacks that…
Open weights
bsd-3-clause
peft
This is an experimental Tiny Transformer codebase for Classification. It keeps the tiny setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lamb with a exponential schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
16,576 parameters
256 tokens
This is an experimental Efficientformer codebase for Classification. It keeps the xlarge setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses novograd with a cosine schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
33,088 parameters
256 tokens
A research-oriented Swin T prototype targeting Classification. The included nano setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a linear warmup schedule. These are starting values in the script, not evidence of a completed…
Open weights
bsd-3-clause
49,600 parameters
512 tokens
This repository is a compact, custom PyTorch implementation of Cnn Transformer for Classification. The small configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lion with a constant warmup…
Open weights
bsd-3-clause
33,088 parameters
256 tokens
A small CLIP implementation for Classification, packaged with an explicit configuration and an initialization checkpoint. The large variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adamw with a exponential schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
49,600 parameters
256 tokens
A small CLIP implementation for Contrastive, packaged with an explicit configuration and an initialization checkpoint. The xlarge variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses sgd with a linear warmup schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
24,832 parameters
256 tokens
A small CLIP implementation for Matching, packaged with an explicit configuration and an initialization checkpoint. The xlarge variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses novograd with a polynomial schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
16,576 parameters
128 tokens
This is an experimental CLIP codebase for Multitask. It keeps the tiny setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adam with a onecycle schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
49,600 parameters
128 tokens
This repository is a compact, custom PyTorch implementation of CLIP for Retrieval. The large configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses novograd with a constant warmup schedule. These…
Open weights
bsd-3-clause
33,088 parameters
512 tokens
This repository is a compact, custom PyTorch implementation of Cnn Transformer for Generation. The small configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lamb with a polynomial schedule.…
Open weights
bsd-3-clause
16,576 parameters
256 tokens
This is an experimental Coca codebase for Contrastive. It keeps the giant setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a step schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
24,832 parameters
256 tokens
A small Coca implementation for Classification, packaged with an explicit configuration and an initialization checkpoint. The base variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses novograd with a linear warmup schedule. These are starting values in the script…
Open weights
bsd-3-clause
49,600 parameters
512 tokens
A small Coca implementation for Contrastive, packaged with an explicit configuration and an initialization checkpoint. The small variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a cosine schedule. These are starting values in the script, not evidence…
Open weights
bsd-3-clause
49,600 parameters
512 tokens
Working implementation of Swin T for Contrastive using a giant configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lamb with a exponential schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
24,832 parameters
256 tokens
This is an experimental Mobilevit codebase for Contrastive. It keeps the large setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adamw with a cosine schedule. These are starting values in the script, not evidence of a completed run.…
Open weights
bsd-3-clause
16,576 parameters
512 tokens
This is an experimental Swin T codebase for Contrastive. It keeps the tiny setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lamb with a step schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
49,600 parameters
128 tokens
Working implementation of Perceiver for Generation using a small configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lion with a polynomial schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
16,576 parameters
256 tokens
A small Albef implementation for Generation, packaged with an explicit configuration and an initialization checkpoint. The large variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adafactor with a linear warmup schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
33,088 parameters
256 tokens
A small Cnn Transformer implementation for Matching, packaged with an explicit configuration and an initialization checkpoint. The small variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adam with a cosine schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
16,576 parameters
512 tokens
Working implementation of Perceiver for Generation using a large configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adafactor with a constant warmup schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
49,600 parameters
256 tokens
A research-oriented Dino prototype targeting Matching. The included large setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lion with a constant warmup schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
16,576 parameters
128 tokens
Working implementation of CLIP for Retrieval using a small configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adafactor with a exponential schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
49,600 parameters
512 tokens
A small Efficientformer implementation for Retrieval, packaged with an explicit configuration and an initialization checkpoint. The tiny variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lamb with a polynomial schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
16,576 parameters
256 tokens
A small Coca implementation for Classification, packaged with an explicit configuration and an initialization checkpoint. The tiny variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adamw with a polynomial schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
33,088 parameters
512 tokens
This repository is a compact, custom PyTorch implementation of Flamingo for Classification. The base configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lamb with a exponential schedule. These…
Open weights
bsd-3-clause
33,088 parameters
256 tokens
This repository is a compact, custom PyTorch implementation of Poolformer for Generation. The large configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adafactor with a step schedule. These are…
Open weights
bsd-3-clause
16,576 parameters
512 tokens
This is an experimental Flamingo codebase for Generation. It keeps the xlarge setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a constant warmup schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
33,088 parameters
128 tokens
Part of the Secryst phonological-layer family — a dedicated model for diacritization (HE), distributed as a Secryst IMF artifact and loadable through any Secryst crystal: Full evaluation sets, zero skipped examples, the benchmark's own evaluator. Provenance for every number is the results record of the training project. Nakdimon test set, greedy decode, seq2seqder — the exact protocol of −3.96pp (24% relative error reduction) over the shipped student at the plane's on-device economics. Median per-example DER 9.8%; 223,872 scored positions. encoder (no decoder) with a nikud-plane embedding and one classification head per character position over 135 order-preserving nikud classes. Decoding is…
Open weights
bsd-3-clause
A research-oriented Mae prototype targeting Classification. The included large setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adamw with a step schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
24,832 parameters
256 tokens
A small Mocov3 implementation for Matching, packaged with an explicit configuration and an initialization checkpoint. The base variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a exponential schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
49,600 parameters
256 tokens
A research-oriented Swin T prototype targeting Matching. The included base setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adam with a onecycle schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
24,832 parameters
256 tokens
A research-oriented Poolformer prototype targeting Matching. The included base setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses novograd with a linear warmup schedule. These are starting values in the script, not evidence of a completed run.…
Open weights
bsd-3-clause
33,088 parameters
512 tokens
A research-oriented Albef prototype targeting Matching. The included huge setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses sgd with a linear warmup schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
49,600 parameters
256 tokens
Working implementation of Perceiver for Matching using a xlarge configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses novograd with a step schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
49,600 parameters
128 tokens
Working implementation of Mae for Matching using a nano configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses novograd with a polynomial schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
33,088 parameters
128 tokens
This is an experimental Mixer codebase for Contrastive. It keeps the small setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lion with a linear warmup schedule. These are starting values in the script, not evidence of a completed run.…
Open weights
bsd-3-clause
33,088 parameters
128 tokens
This repository is a compact, custom PyTorch implementation of Mobilevit for Retrieval. The giant configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses sgd with a cosine schedule. These are…
Open weights
bsd-3-clause
33,088 parameters
256 tokens
A small Mobilevit implementation for Retrieval, packaged with an explicit configuration and an initialization checkpoint. The xlarge variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adam with a onecycle schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
24,832 parameters
256 tokens
This is an experimental Mocov3 codebase for Classification. It keeps the tiny setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adam with a constant warmup schedule. These are starting values in the script, not evidence of a completed…
Open weights
bsd-3-clause
33,088 parameters
128 tokens
This repository is a compact, custom PyTorch implementation of Mocov3 for Contrastive. The giant configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lamb with a linear warmup schedule. These are…
Open weights
bsd-3-clause
24,832 parameters
512 tokens
A research-oriented Mocov3 prototype targeting Multitask. The included huge setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a constant warmup schedule. These are starting values in the script, not evidence of a completed run.…
Open weights
bsd-3-clause
16,576 parameters
256 tokens
A small Tiny Transformer implementation for Multitask, packaged with an explicit configuration and an initialization checkpoint. The base variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lion with a linear warmup schedule. These are starting values in the script…
Open weights
bsd-3-clause
49,600 parameters
512 tokens
A research-oriented Albef prototype targeting Multitask. The included small setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adamw with a cosine schedule. These are starting values in the script, not evidence of a completed run. For a…
Open weights
bsd-3-clause
49,600 parameters
128 tokens
This repository is a compact, custom PyTorch implementation of Tiny Transformer for Multitask. The xlarge configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses novograd with a polynomial schedule.…
Open weights
bsd-3-clause
33,088 parameters
128 tokens