Minerva-MLM is a genome language model for coevolutionary mining. The checkpoint includes the masked language model head and three interaction heads for base-pairing, repeat, and structure signals. Full documentation, finetuning scripts, notebooks, and setup are on the github. Try it in the browser here. Inference from this repo needs only Transformers and PyTorch: flash-attn is picked up automatically when present, otherwise Minerva falls back to PyTorch SDPA. The optional minerva-dna package adds plotting helpers, GenBank utilities and finetuning wrappers, and lets you load the model without trustremotecode: With minerva-dna installed, import the class directly and drop trustremotecode…
Open weights
apache-2.0
671M parameters
transformers
Minerva-MLM is a genome language model for coevolutionary mining. The checkpoint includes the masked language model head and three interaction heads for base-pairing, repeat, and structure signals. Full documentation, finetuning scripts, notebooks, and setup are on the github. Try it in the browser here. Inference from this repo needs only Transformers and PyTorch: flash-attn is picked up automatically when present, otherwise Minerva falls back to PyTorch SDPA. The optional minerva-dna package adds plotting helpers, GenBank utilities and finetuning wrappers, and lets you load the model without trustremotecode: With minerva-dna installed, import the class directly and drop trustremotecode…
Open weights
apache-2.0
671M parameters
transformers
