Dataset · Image and text to text
dexforge-episode-smolvlm-demo
by Sanbei101 Sanbei101/dexforge-episode-smolvlm-demo
单条双臂遥操作 MCAP 录制切分出的 6 个 Episode 及抽帧结果,用于在 Colab 上验证 SmolVLM2-500M-Video-Instruct 能否替代 LLM 网关做 Episode 语义预标注。 含 /fsmstate 状态机、双臂末端位姿、夹爪关节、XR 手柄输入等信号。 - 原始录制:recording/rec202609141354110.mcap(约 36.4 秒,219935 条消息) - 切分口径:平台现有规则 episode.Method = fsmposev1,即优先按…
Dataset Card
单条双臂遥操作 MCAP 录制切分出的 6 个 Episode 及抽帧结果,用于在 Colab 上验证 SmolVLM2-500M-Video-Instruct 能否替代 LLM 网关做 Episode 语义预标注。 含 /fsmstate 状态机、双臂末端位姿、夹爪关节、XR 手柄输入等信号。 - 原始录制:recording/rec202609141354110.mcap(约 36.4 秒,219935 条消息) - 切分口径:平台现有规则 episode.Method = fsmposev1,即优先按 /fsmstate 非零活动区间切分;本录制 6 个 Episode 全部命中 fsm 边界,置信度 0.90 - 帧抽取:每个 Episode 内按 frameCount 预算在 3 路视频流(左右彩相机 + XR 相机) 上均匀取样,JPEG 落盘 frames/index.json 每条形如: 帧按时间顺序编号。一个 Episode 取 8 帧,三路相机混合取样 (例如 episode-000 是 3 帧左相机 + 3 帧右相机 + 2 帧 XR 相机)。 平台 internal/pipelines/semanticepisodetag 活动当前把同样的证据交给 OpenAI 兼容视觉模型,产出 actionId / task / caption / outcome / confidence / needsHumanReview / evidenceFrameIds。这个数据集就是那条链路的输入快照, 用来先在 Colab…
Excerpt from the card by Sanbei101, licensed other.
Structure
default 6 rows
| Split | Rows | Size |
|---|---|---|
| train | 6 | 1.3 KB |
Details
- Repository
- Sanbei101/dexforge-episode-smolvlm-demo
- Publisher
- Sanbei101
- Task category
- Image and text to text
- Tags
- robotics, episode-segmentation, smolvlm2
- Size category
- n<1K
- Languages
- zh, en
- Revision
- 8ee2cfec80de480deea07ef378fae74f947c4f1e
- Last updated
- 2026-09-28
Files
56 files, 107.8 MB in total.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| dataset.json | Data | 4.1 KB | — |
| episodes.jsonl | Data | 2.2 KB | — |
| frames/index.json | Data | 4.3 KB | — |
| xy_time.json | Data | 2.6 KB | — |
| README.md | Documentation | 2.8 KB | — |
| frames/episode-000/frame-000.jpg | Other | 124.5 KB | dcb699bf3bb5 |
| frames/episode-000/frame-001.jpg | Other | 118.8 KB | 11a2fbbacae6 |
| frames/episode-000/frame-002.jpg | Other | 599.9 KB | be8c0a532ee7 |
| frames/episode-000/frame-003.jpg | Other | 559.3 KB | 61ebbc0a8b97 |
| frames/episode-000/frame-004.jpg | Other | 124.2 KB | 5a73d5e44ae8 |
| frames/episode-000/frame-005.jpg | Other | 115.6 KB | 3e1c615d379b |
| frames/episode-000/frame-006.jpg | Other | 125.7 KB | fd38b11f6f08 |
| frames/episode-000/frame-007.jpg | Other | 557.8 KB | efb38eac2e2b |
| frames/episode-001/frame-000.jpg | Other | 574.9 KB | 2d0a8d00a57b |
| frames/episode-001/frame-001.jpg | Other | 130.2 KB | ad2e52621025 |
| frames/episode-001/frame-002.jpg | Other | 129.2 KB | 8af96f8be780 |
| frames/episode-001/frame-003.jpg | Other | 119.7 KB | 55c328252781 |
| frames/episode-001/frame-004.jpg | Other | 560.7 KB | 1e5dede7d0db |
| frames/episode-001/frame-005.jpg | Other | 120.2 KB | fcdeefe80066 |
| frames/episode-001/frame-006.jpg | Other | 126.1 KB | 8793204d84a3 |
| frames/episode-001/frame-007.jpg | Other | 565.1 KB | d0847ccb93c7 |
| frames/episode-002/frame-000.jpg | Other | 559.9 KB | 11fa55208e39 |
| frames/episode-002/frame-001.jpg | Other | 129.6 KB | a7fbd0c89888 |
| frames/episode-002/frame-002.jpg | Other | 123.5 KB | eb1be409dd6c |
| frames/episode-002/frame-003.jpg | Other | 129.4 KB | 98b584344bd0 |
| frames/episode-002/frame-004.jpg | Other | 557.5 KB | b9e7e67b3098 |
| frames/episode-002/frame-005.jpg | Other | 119.4 KB | 54154978d7c4 |
| frames/episode-002/frame-006.jpg | Other | 106.2 KB | 8c12dc765b3e |
| frames/episode-002/frame-007.jpg | Other | 557.1 KB | c78ef638fe32 |
| frames/episode-003/frame-000.jpg | Other | 121.8 KB | f0b480466ced |
| frames/episode-003/frame-001.jpg | Other | 550.4 KB | 0d2cacaeed04 |
| frames/episode-003/frame-002.jpg | Other | 121.2 KB | 7748cd5e75de |
| frames/episode-003/frame-003.jpg | Other | 110.3 KB | d70f6ea9946d |
| frames/episode-003/frame-004.jpg | Other | 546.2 KB | 39b387bcf064 |
| frames/episode-003/frame-005.jpg | Other | 559.6 KB | d82c23813aa0 |
| frames/episode-003/frame-006.jpg | Other | 122.9 KB | 641b3acc9a08 |
| frames/episode-003/frame-007.jpg | Other | 123.3 KB | 78c896e42f20 |
| frames/episode-004/frame-000.jpg | Other | 124.2 KB | 0918d4861b9c |
| frames/episode-004/frame-001.jpg | Other | 552.6 KB | 2336f394f0ae |
| frames/episode-004/frame-002.jpg | Other | 551.9 KB | 4ca4f3fcd11d |
| frames/episode-004/frame-003.jpg | Other | 124.0 KB | 28819274029f |
| frames/episode-004/frame-004.jpg | Other | 130.9 KB | 892c13cb8498 |
| frames/episode-004/frame-005.jpg | Other | 558.2 KB | 7570f3311c6d |
| frames/episode-004/frame-006.jpg | Other | 129.5 KB | edb0e468f375 |
| frames/episode-004/frame-007.jpg | Other | 124.9 KB | e06d47a8b96b |
| frames/episode-005/frame-000.jpg | Other | 555.8 KB | f59dcf07519e |
| frames/episode-005/frame-001.jpg | Other | 126.6 KB | aef13252dd99 |
| frames/episode-005/frame-002.jpg | Other | 549.8 KB | a8cfce250db8 |
| frames/episode-005/frame-003.jpg | Other | 126.3 KB | 0b915934f4c0 |
| frames/episode-005/frame-004.jpg | Other | 123.2 KB | 6e844b9c2322 |
| frames/episode-005/frame-005.jpg | Other | 120.5 KB | 1afb7556ac9f |
| frames/episode-005/frame-006.jpg | Other | 124.7 KB | ac9256ed6bd4 |
| frames/episode-005/frame-007.jpg | Other | 563.0 KB | d77fe0cce302 |
| recording/rec_20260914_135411_0.mcap | Other | 94.0 MB | fbe46a3a937c |
| recording/recording.mcap.sig | Other | 250 B | — |
| .gitattributes | Repository | 2.6 KB | — |
License and Download
- License
- other
- Access
- No access gate
Released by Sanbei101 through its official repository on Hugging Face.