A small Mocov3 implementation for Matching, packaged with an explicit configuration and an initialization checkpoint. The base variant is a reproducible starting point, not a trained model release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a exponential schedule. These are starting values in the script, not…
Open weights
bsd-3-clause
49,600 parameters
256 tokens
This is an experimental Tiny Transformer codebase for Classification. It keeps the tiny setup intentionally manageable so architecture changes can be inspected before a full training run. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses lamb with a exponential schedule. These are starting values in the script, not evidence of a…
Open weights
bsd-3-clause
16,576 parameters
256 tokens
