This repository contains a checkpoint of the Pi0 model (HF implementation | Paper) finetuned on the BridgeV2 dataset for robotic manipulation tasks. The model is later used for testing on the Simpler Environment and our INTACT Probing Suite for the generalization boundaries of VLA models. Paper: From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models Or directly in python with Lerobot, see blow: First, install lerobot Then For more details please refer to our paper and code Checkpoint choice After training 15 epochs, we sweep the checkpoint at epoch 1, 2, 3, 4, 5, 10, 15 for performance on the original 4 Bridge tasks in the SimplerEnv, and choose…
Open weights
apache-2.0
3.2B parameters
transformers
Full fine-tune of lerobot/pi05base on a bimanual actuator-unboxing task, with a speed token in the text prompt: Part of a check whether pi0.5 can be conditioned through text tokens, as a precursor to advantage conditioning (RECAP, π0.6). Data (not on the Hub): 198 teleoperated episodes labelled slow, merged with 437 episodes of the same task demonstrated about 1.75× faster in another session, labelled fast (635 episodes, 371,523 frames; 50 fps, three 224×224 cameras, 14-D state and action). 30 % of training samples get unknown, the null prompt for classifier-free guidance. Training: 4,400 steps (about 3 epochs), batch 256, learning rate 5e-5, 10 % linear warm-up, cosine decay over the last…
Open weights
3.4B parameters
lerobot
Full fine-tune of lerobot/pi05base on a bimanual actuator-unboxing task, with a speed token in the text prompt: Part of a check whether pi0.5 can be conditioned through text tokens, as a precursor to advantage conditioning (RECAP, π0.6). Data (not on the Hub): 198 teleoperated episodes (50 fps, three 224×224 cameras, 14-D state and action) labelled slow, plus two 2× copies of every episode that keep only the even or only the odd frames, labelled fast (594 episodes, 348,616 frames). Slow and fast samples show the same images, so only the token tells them apart. 30 % of training samples get unknown, the null prompt for classifier-free guidance. Training: 4,000 steps (about 3 epochs), batch…
Open weights
3.4B parameters
lerobot
This repository contains the model-only checkpoint saved at 30,000 training steps. The files at the repository root are the original contents of checkpoint-30000. Full model and processor settings are in config.json, processorconfig.json, and experimentcfg/. The training run did not include an evaluation. Source checkpoint: outputs/moeforcetransformertuningobs2h1020260926223332/vasev6k12s1e6f384xformer/vasev6/moe/checkpoint-30000.
Open weights
3.2B parameters
This repository contains the model-only checkpoint saved at 30,000 training steps. The files at the repository root are the original contents of checkpoint-30000. Full model and processor settings are in config.json, processorconfig.json, and experimentcfg/. The training run did not include an evaluation. Source checkpoint: outputs/moeforcetransformertuningobs2h1020260926223332/whiteboardv9k8s1e6f384xformer/whiteboardv9/moe/checkpoint-30000.
Open weights
3.2B parameters
This repository contains the model-only checkpoint saved at 30,000 training steps. The files at the repository root are the original contents of checkpoint-30000. Full model and processor settings are in config.json, processorconfig.json, and experimentcfg/. The training run did not include an evaluation. Source checkpoint: outputs/moeforcetransformertuningobs2h1020260926223332/usbk6s1e4f384xformer/usb/moe/checkpoint-30000.
Open weights
3.2B parameters