SAVRN
Search Contact SAVRN

Dataset

MemGUI-RL-Eval

by Anonymous memgui-rl/MemGUI-RL-Eval

Evaluation logs of every model row reported in the ICLR 2027 submission MemGUI-RL (project page: https://memgui-rl-anonymous.github.io/).

Rows
Configurations
Size143.8 GB
Licenseapache-2.0
AccessPublicly accessible
Monthly Downloads82

Dataset Card

By Anonymous, published under apache-2.0, revision dfb5dd4d6dbe.

Evaluation logs of every model row reported in the ICLR 2027 submission MemGUI-RL (project page: https://memgui-rl-anonymous.github.io/). One zip archive per evaluation session:

  • memgui_bench/<session>.zip - per-task ConAct trajectories (traj.json, three attempts where applicable), MemGUI-Eval judge outputs (results.csv, per-attempt judgments, failure labels, information-retention analyses) and run metadata. Screenshots are omitted for size; the paper's case-study tasks are included under case_studies/ with down-scaled screenshots.
  • mobileworld/<session>.zip - per-task trajectories and the MobileWorld GUI-only evaluation report.

manifest.json maps every archive to the row of the paper it supports. Serving-endpoint identifiers, judge model ids and local paths are redacted.

Details

Repository
memgui-rl/MemGUI-RL-Eval
Publisher
Anonymous
Task category
Not stated by the source
Tags
mobile-gui-agent, agent-memory, benchmark-results
Size category
Not stated by the source
Languages
Not stated by the source
Revision
dfb5dd4d6dbeabad06355af86c41b2f97369740e
Last updated
2026-09-18

Files

65 files, 143.8 GB in total.

Data63 files · 143.8 GB
Documentation1 file · 939 B
Repository1 file · 2.5 KB
Every file
FileTypeSizeSHA-256
manifest.jsonData5.0 KB
memgui_bench/memgui-8b-26062201.zipData5.0 MB743beb70638c
memgui_bench/memgui-8b-26062202.zipData4.6 MB8bca5264e9b5
memgui_bench/memgui_8b_on_mg_26062901.zipData4.4 MB3c2ae18f805c
memgui_bench/memgui_8b_on_mg_26070401.zipData4.4 MBe43d1787aecb
memgui_bench/memgui_8b_on_mg_26070602.zipData4.3 MB940f79d25cc2
memgui_bench/memgui_8b_on_mg_26070701.zipData3.6 MB0b843b118476
memgui_bench/memgui_8b_on_mg_26070702.zipData4.1 MB89b83f773623
memgui_bench/memgui_8b_on_mg_26072401.zipData16.2 MB0d3da9549930
memgui_bench/memgui_8b_on_mg_26090601.zipData8.4 MB723fc808da36
memgui_bench/memgui_8b_on_mg_26090701.zipData16.0 MB79c8bf37f88d
memgui_bench/memgui_8b_on_mg_26090901-check1.zipData13.5 MB2341661a688e
memgui_bench/memgui_8b_on_mg_26091201-check1.zipData9.9 MBe914eeac3d1a
memgui_bench/session-memgui-v26050803.zipData9.4 MB515b2797989c
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_001-014.zipData2.1 GBa28c16728d57
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_015-022.zipData2.8 GBf3f31499a941
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_023-028.zipData2.0 GBa9a5af428d81
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_028-033.zipData1.4 GBc7f4cff35d0c
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_033-038.zipData2.5 GB2b15c8c85c10
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_038-043.zipData7.1 GB9c364c545e22
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_043-048.zipData8.9 GB6dbd7c576d23
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_048-053.zipData2.7 GBf51b9c6e0d59
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_054-058.zipData7.5 GBe767d445d9cf
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_059-064.zipData5.2 GBa8212fb2572a
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_064-069.zipData2.2 GB9c40ca66d113
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_069-074.zipData1.8 GBb0d8c9452f81
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_075-080.zipData10.2 GBada4701da58a
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_080-085.zipData4.4 GB2d3754b6133d
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_085-090.zipData3.9 GB133977e84cfd
memgui_bench_full/memgui_8b_on_mg_26072401/memgui_8b_on_mg_26072401.tasks_091-096.zipData3.4 GBb353372c6883
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.session_files.zipData3.1 MB80b38307c9a7
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.tasks_001-016.zipData1.1 GBd85d1b07bc35
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.tasks_017-032.zipData4.6 GB525aa43563d6
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.tasks_033-048.zipData7.8 GB4c58dbd92b2b
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.tasks_049-064.zipData5.1 GB846a3559e03b
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.tasks_065-080.zipData6.8 GB8b8297c7e0a7
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.tasks_081-096.zipData9.3 GBfa336cb8518c
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.tasks_097-112.zipData6.1 GBfa853580f948
memgui_bench_full/session-memgui-v26050803/session-memgui-v26050803.tasks_113-128.zipData5.3 GB43ae63818989
mobileworld/memgui_8b_26050801.zipData905.0 KBa63c1ef794b9
mobileworld/memgui_8b_26062301.zipData1.2 MBdc9b24cfe7a0
mobileworld/memgui_8b_26062302.zipData905.4 KBad2fc54d8d3b
mobileworld/memgui_on_mw_8b_26062801.zipData1.2 MBad2b161a3109
mobileworld/memgui_on_mw_8b_26070301.zipData1.0 MB5f515adeddef
mobileworld/memgui_on_mw_8b_26070601.zipData946.0 KB96e39300d302
mobileworld/memgui_on_mw_8b_26070602.zipData1.1 MBe09129b16f6d
mobileworld/memgui_on_mw_8b_26070603.zipData1.1 MB289ba284e757
mobileworld/memgui_on_mw_8b_26090601.zipData514.2 KB37ead8f010e9
mobileworld/memgui_on_mw_8b_26090701.zipData947.8 KBbd1109666e8c
mobileworld/memgui_on_mw_8b_26090901-check1.zipData968.5 KBea82b6eb3333
mobileworld/memgui_on_mw_8b_26091201-check1.zipData1.1 MBd296ca9eb066
mobileworld_full/memgui_8b_26050801/memgui_8b_26050801.zipData2.3 GB277254aa8864
mobileworld_full/memgui_8b_26062301/memgui_8b_26062301.zipData2.4 GB9c975a77cbc4
mobileworld_full/memgui_8b_26062302/memgui_8b_26062302.zipData2.1 GBf8925e83159b
mobileworld_full/memgui_on_mw_8b_26062801/memgui_on_mw_8b_26062801.zipData2.4 GB9441875a1bd3
mobileworld_full/memgui_on_mw_8b_26070301/memgui_on_mw_8b_26070301.zipData2.2 GBde623354012c
mobileworld_full/memgui_on_mw_8b_26070601/memgui_on_mw_8b_26070601.zipData2.8 GBd2b89e3666b4
mobileworld_full/memgui_on_mw_8b_26070602/memgui_on_mw_8b_26070602.zipData2.5 GB04d5e0930a82
mobileworld_full/memgui_on_mw_8b_26070603/memgui_on_mw_8b_26070603.zipData2.4 GB5cd7eeeefde3
mobileworld_full/memgui_on_mw_8b_26090601/memgui_on_mw_8b_26090601.zipData2.2 GBb98c4f97891e
mobileworld_full/memgui_on_mw_8b_26090701/memgui_on_mw_8b_26090701.zipData2.9 GB6581c6ffdf9c
mobileworld_full/memgui_on_mw_8b_26090901-check1/memgui_on_mw_8b_26090901-check1.zipData2.6 GB56014c8c840e
mobileworld_full/memgui_on_mw_8b_26091201-check1/memgui_on_mw_8b_26091201-check1.zipData2.6 GB0e93da7dbf5a
README.mdDocumentation939 B
.gitattributesRepository2.5 KB

License and Download

License
apache-2.0
Access
No access gate
Download from Anonymous

Released by Anonymous through its official repository on Hugging Face. Read the license.