Dataset · Text generation

SWE-Misbehavior

by Nguyen Duc Anh duc-anh-2002/SWE-Misbehavior

SWE-Misbehavior is a benchmark for measuring boundary violations made by software coding agents, meaning actions that go beyond what the user asked for.

Rows7,427

Configurations9

Size10.3 MB

License—

AccessPublicly accessible

Monthly Downloads—

Dataset Card

SWE-Misbehavior is a benchmark for measuring boundary violations made by software coding agents, meaning actions that go beyond what the user asked for. Examples include rewriting code around the target function, changing signatures, touching unrelated files, deleting the wrong files, running unrequested commands, or skipping files the agent needed to read. The benchmark has 7,427 task instances across 3 task families and 9 subsets. All of them are built on real-world Python repositories from DevEval (10 domains: Communications, Database, Internet, Multimedia, Scientific-Engineering, Security, Software-Development, System, Text-Processing, Utilities). Each instance comes with 50 paraphrased…

Excerpt from the card by Nguyen Duc Anh.

Structure

cg_lv1 1,253 rows

Split	Rows	Size
test	1,253	11.8 MB

instance_idstringnamespacestringcompletion_pathstringnew_completion_pathstringproject_pathstringfunction_namestringpromptlistneed_readlist

cg_lv2 1,253 rows

Split	Rows	Size
test	1,253	11.7 MB

instance_idstringnamespacestringcompletion_pathstringnew_completion_pathstringproject_pathstringfunction_namestringpromptlistneed_readlist

cg_lv3 570 rows

Split	Rows	Size
test	570	6.1 MB

instance_idstringnamespacestringcompletion_pathstringnew_completion_pathstringproject_pathstringfunction_namestringpromptlistneed_readlist

exec_execute 570 rows

Split	Rows	Size
test	570	4.1 MB

instance_idstringnamespacestringcompletion_pathstringproject_pathstringfunction_namestringpromptlistneed_readlist

exec_testing 570 rows

Split	Rows	Size
test	570	4.5 MB

instance_idstringnamespacestringcompletion_pathstringproject_pathstringfunction_namestringpromptlistneed_readlist

fm_aef 257 rows

Split	Rows	Size
test	257	2.7 MB

instance_idstringnamespacestringcompletion_pathstringfunction_namestringpromptlistneed_updatelist

fm_anf 904 rows

Split	Rows	Size
test	904	6.2 MB

instance_idstringnamespacestringcompletion_pathstringfunction_namestringpromptlistneed_updatelist

fm_delf 1,000 rows

Split	Rows	Size
test	1,000	6.3 MB

instance_idstringcompletion_pathstringpromptlist

fm_delif 1,050 rows

Split	Rows	Size
test	1,050	7.2 MB

instance_idstringcompletion_pathstringpromptlistdmlisttaken_fromlistneed_readlist

Details

Repository: duc-anh-2002/SWE-Misbehavior
Publisher: Nguyen Duc Anh
Task category: Text generation
Tags: code, agents, coding-agents
Size category: 1K<n<10K
Languages: en
Revision: 106e680b0cef15c9d82491c8d21b15bab65a7e5f
Last updated: 2026-10-22

Files

20 files, 10.3 MB in total.

Data18 files · 10.3 MB

Documentation1 file · 11.9 KB

Repository1 file · 2.5 KB

Every file

File	Type	Size	SHA-256
data/cg_lv1/test-00000-of-00001.parquet	Data	2.0 MB	567c59088d44
data/cg_lv2/test-00000-of-00001.parquet	Data	1.9 MB	2a8a095d7db1
data/cg_lv3/test-00000-of-00001.parquet	Data	923.3 KB	2fb0c1fbf636
data/exec_execute/test-00000-of-00001.parquet	Data	668.2 KB	ad8dcc1fb961
data/exec_testing/test-00000-of-00001.parquet	Data	733.1 KB	648b118ecc6b
data/fm_aef/test-00000-of-00001.parquet	Data	470.9 KB	84684e920a06
data/fm_anf/test-00000-of-00001.parquet	Data	1.3 MB	5ffaf88c8161
data/fm_delf/test-00000-of-00001.parquet	Data	1.0 MB	10e030cde350
data/fm_delif/test-00000-of-00001.parquet	Data	1.3 MB	42e5493d799f
prompt-templates/cg-lv1-templates.txt	Data	5.9 KB	—
prompt-templates/cg-lv2-templates.txt	Data	5.9 KB	—
prompt-templates/cg-lv3-templates.txt	Data	6.3 KB	—
prompt-templates/exec-execute-templates.txt	Data	4.5 KB	—
prompt-templates/exec-testing-templates.txt	Data	5.1 KB	—
prompt-templates/fm-aef-templates.txt	Data	6.2 KB	—
prompt-templates/fm-anf-templates.txt	Data	6.1 KB	—
prompt-templates/fm-delf-templates.txt	Data	3.4 KB	—
prompt-templates/fm-delif-templates.txt	Data	4.4 KB	—
README.md	Documentation	11.9 KB	—
.gitattributes	Repository	2.5 KB	—

License and Download

License: Not stated by the source
Access: No access gate

Download from Nguyen Duc Anh

Released by Nguyen Duc Anh through its official repository on Hugging Face.