SAVRN
Search Contact SAVRN

Organization

Mercor

mercor

Models in Library0
Datasets in Library1
Models on Hugging Face2
Followers137

Datasets

APEX–Agents is a benchmark from Mercor for evaluating whether AI agents can execute long-horizon, cross-application professional services tasks. Tasks were created by investment banking analysts, management consultants, and corporate lawyers, and require agents to navigate realistic work environments with files and tools (e.g., docs, spreadsheets, PDFs, email, chat, calendar). Each case is a task inside a world (where worlds can have multiple tasks associated with them). A “world” is a realistic project scenario created by experts. Worlds contain files and tools required to complete tasks. Web search is disabled to keep evaluations reproducible. Worlds contain applications such as…

Access requested at publisher cc-by-4.0 n<1K