Skip to page content
SAVRN
Search Plan a project

Open-weight model · Robotics

so101-dw05-sim-real-10task

by Harrysunshine Harrysunshine/so101-dw05-sim-real-10task

so101-dw05-sim-real-10task is an open-weight model for robotics from Harrysunshine, released under Apache License 2.0. Its published files total 12.0 GB.

底座里的 VAE、文本编码器与 Wan2.2-TI2V-5B 扩散主干仍从 Dexmal/DW05-Robotwin 取,本仓只放微调后的权重。 - 起点:Dexmal/DW05-Robotwin,剔掉与双臂机器人绑定的动作头与本体编码器(宽度对不上 SO-101,重新学) - 全量微调 + DeepSpeed ZeRO-1,每卡 batch 1 × 3 卡,20000 步,学习率 1e-4 cosine - SO-101 的 6 维状态填进 RobotWin 的 16 槽排布:前五个槽放五个臂关节,夹爪落在第…

Parameters—
Context—
Weights12.0 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Harrysunshine, published under apache-2.0, revision 4057b9915b8a.

底座里的 VAE、文本编码器与 Wan2.2-TI2V-5B 扩散主干仍从 Dexmal/DW05-Robotwin 取,本仓只放微调后的权重。 - 起点:Dexmal/DW05-Robotwin,剔掉与双臂机器人绑定的动作头与本体编码器(宽度对不上 SO-101,重新学) - 全量微调 + DeepSpeed ZeRO-1,每卡 batch 1 × 3 卡,20000 步,学习率 1e-4 cosine - SO-101 的 6 维状态填进 RobotWin 的 16 槽排布:前五个槽放五个臂关节,夹爪落在第 7 槽;三路视图用 顶视 + 腕部 + 腕部 - 本体状态在训练时没有归一化:推理时把 6 维状态排进 16 槽、补一位终止标志 0 后原样送入,不要套 RobotWin 的分位数归一化。 用法与评测脚本见 dexbotic 的 docs/so101.md(script/so101/dw05simcheck.py), Apache-2.0,随底座 Dexmal/DW05-Robotwin。

Read Harrysunshine's full model card

DW0.5 · SO-101 动作条件世界模型(仿真 + 真机 10 任务混训)

在 Dexmal/DW05-Robotwin 上全量微调得到的 SO-101 世界模型: 给它当前画面、机械臂状态和一串未来动作,它画出「照这串动作做下去会看到什么」。

文件

文件 内容
model.pt 微调后的权重(约 12 GB)
norm_stats.json 训练时的动作归一化统计,推理必须用同一份

底座里的 VAE、文本编码器与 Wan2.2-TI2V-5B 扩散主干仍从 Dexmal/DW05-Robotwin 取,本仓只放微调后的权重。

训练

  • 数据:与策略模型同一份,仿真三场景 1498 集 + 真机九任务 2200 集,共 3698 集 / 10 个任务
  • 起点:Dexmal/DW05-Robotwin,剔掉与双臂机器人绑定的动作头与本体编码器(宽度对不上 SO-101,重新学)
  • 全量微调 + DeepSpeed ZeRO-1,每卡 batch 1 × 3 卡,20000 步,学习率 1e-4 cosine
  • SO-101 的 6 维状态填进 RobotWin 的 16 槽排布:前五个槽放五个臂关节,夹爪落在第 7 槽;三路视图用 顶视 + 腕部 + 腕部

仿真验证

拿策略模型在仿真里新跑出的 12 条轨迹(训练集里没有),从第 0 帧起连推 3 轮、共 96 步,和仿真真实画面比:

喂给它的动作 平均 PSNR
轨迹里真实的动作 21.65 dB
不预测,复制第一帧 19.60 dB
同一串动作按时间倒放 17.60 dB

真实动作 12 条全部胜过倒放 —— 它按动作推演未来,不是在放一段和动作无关的视频。

用法注意

  • 本体状态在训练时没有归一化:推理时把 6 维状态排进 16 槽、补一位终止标志 0 后原样送入,不要套 RobotWin 的分位数归一化。
  • 动作条件用「相对第一帧的增量」,夹爪那一维不做增量。

用法与评测脚本见 dexbotic 的 docs/so101.md(script/so101/dw05_sim_check.py), 教学示例见 Xbotics-Dexmal-Workshop。

许可

Apache-2.0,随底座 Dexmal/DW05-Robotwin。

Identity and Version

Repository
Harrysunshine/so101-dw05-sim-real-10task
Publisher
Harrysunshine
Task
Robotics
Modality
Control
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
4057b9915b8a4796db7cc142446f35096ceb8b49
First published
2026-09-25
Last updated
2026-09-25

Files and Weights

4 files, 12.0 GB in total. The weights are 1 file totalling 12.0 GB in pt.

Weights1 file · 12.0 GB
Configuration1 file · 2.1 KB
Documentation1 file · 2.5 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.ptWeights12.0 GB 8ccc4dd1e2a9
norm_stats.jsonConfiguration2.1 KB —
README.mdDocumentation2.5 KB —
.gitattributesRepository1.5 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
12.0 GB
Download from Harrysunshine

Released by Harrysunshine through its official repository on Hugging Face. Read the license.

Built From

  • Derived from Dexmal/DW05-Robotwin
  • Trained on (disclosed) Harrysunshine/so101-sim-pickplace-v2

Memory Requirements

PrecisionWeights in memory
As published12.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About so101-dw05-sim-real-10task

Can I use so101-dw05-sim-real-10task commercially?

Yes. so101-dw05-sim-real-10task is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

LIBERO 4in1(liberospatial / liberoobject / liberogoal / libero10)共 53.19 GB 的 Wan2.2-VAE 编码 latent 缓存: 训练 LIBERO policy(action head / VLA)时直接读取 latent 缓存,避免重复 VAE 编码。 - 窗口模式: windowed(--windowed) - 输出:.pt 文件,每 episode 一个 - dataset(推荐): https://huggingface.co/datasets/MangoGoes/libero4in1wan2.2vaelatentdataset - model(本仓库): https://huggingface.co/MangoGoes/libero4in1wan2.2vaelatentcosmosstyle

Open weights other cosmos

Model · Robotics

wam_ctxpool_bmethod

Hyeonmo Kang

Wan2.2-TI2V-5B video DiT + 48-joint action head, trainingmode=joint. The base is suhyeok's finalized B-method recipe: a teacher-forced (sigma=0.25) self-EMA teacher plus an iBOT prototype loss at L18 L18, gamma=0.01, two-view. On top of it the 3 PAST cond latent frames are pooled into one motion frame before a chosen block. These are NOT the surrogate ctxpool runs. The surrogate line (older base, pd8 x GA1) lives in hmkang/wamctxpoolxattn and hmkang/wamctxpoolavg. Do not compare across the two sets. Geometry: 4-latin (numframesin=25, numframesout=41, fdf 2) = 4 cond + 2 future latent slots, 96 tokens per latent frame, 576 tokens per row. Effective batch 16 clips x GA 2 x 2 views = 64 rows…

Open weights apache-2.0 wan2.2

weighted/imatrix quants of https://huggingface.co/DeepCybo/PhysBrain1.5-8B For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/PhysBrain1.5-8B-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the matter…

Open weights transformers

static quants of https://huggingface.co/MirilAI/Miril-DroneVLM-2B-2 For a convenient overview and download list, visit our model page for this model. weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant…

Open weights apache-2.0 transformers

Model · Robotics

microduck-bubu-sprint

Dadudu

Own lineage: PPO from scratch (nb1, commit 46c48b1) continued as nb2 and nb4 (commit fac88cc), checkpoint 850 (1.328 s); evolution strategies on the weights against the Arena sprint scorer (0.952 s); then the network frozen and wrapped in a step counter carried in the headroll action that adds joint-target and forward-command offsets from about 0.5 m to the line, found by CMA-ES on the event's official seeds: 0.940 s. No other entry's weights used. Simulation only. A perpetual policy for the microduck (61-D observation, 14 actions, 50 Hz). Runs until told otherwise — a gait, loaded into a policy slot. The observation normalizer is baked into policy.onnx; feed raw observations. manifest.json…

Open weights microduck

Model · Robotics

EgoSteer-3B-RealMan

EgoSteer

EgoSteer-3B-RealMan is the generalist policy from EgoSteer: A Full-Stack System Towards Steerable Dexterous Manipulation from Egocentric Videos. It is a world-model-enhanced Vision-Language-Action (VLA) policy built on a Qwen3-VL backbone with a flow-matching action expert, post-trained from EgoSteer-3B-Base on real-world demonstrations collected on the RealMan robot. This is a robot-ready dual-camera (head + chest) checkpoint, corresponding to EgoSteer-9.6K-DG in the paper. For the base model to fine-tune on your own data, see EgoSteer-3B-Base. Our full-stack system integrates EgoSmith (data pipeline), Robot Stack (deployment), and EgoSteer (policy) to learn from 9.6k hours of large-scale…

Open weights apache-2.0