Stage-1 tokenizers and stage-2 paired-pretraining checkpoints for fMRI-LM, a foundation model that aligns functional MRI with language. Three variants, differing in the objective the stage-1 fMRI tokenizer was trained with. vq-contrastive/ — vector quantization + SigLIP contrastive alignment. vq-domain/ — vector quantization + adversarial domain loss. mae/ — masked autoencoding (mask ratio 0.5) + adversarial domain loss. All three were trained on UK Biobank with robust normalisation and Qwen3-0.6B. Stage-2 files are DeepSpeed checkpoints already merged to a single file. The MAE stage-1 file loads with MaskedAutoencoderViT; the two VQ stage-1 files load with the Tokenizer class. They are not…
Independent publisher
YUXIANG WEI
stanjsx
Models in Library1
Datasets in Library0
Models on Hugging Face1
Followers—