…Scientific Foundation Model Collaboration (2026) A Unified Framework for the Evaluation of LLM Agentic Capabilities (2026) Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence (2026) From Storage to…
…Zhang Abstract EnterpriseClawBench presents a benchmark for enterprise agents based on real-world sessions with 852 reproducible tasks, emphasizing comprehensive evaluation metrics beyond single performance scores. Generated by Qwen/Qwen2.5-Coder…
…Furthermore, we create a dataset of 600 tasks modeled after real-world rescue cases and propose a robust set of evaluation metrics. We evaluate diverse baselines, ranging from traditional heuristics to advanced…
…A Benchmark for Evaluating World Models in Robotic Manipulation (2026) GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation (2026) RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation…
…A Large-Scale Benchmark for Real-World Speech Recognition in India (2026) NVBench: A Benchmark for Speech Synthesis with Non-Verbal Vocalizations (2026) AnimeScore: A Preference-Based Dataset and Framework for Evaluating…
…Despite its importance, existing relevant benchmarks largely evaluate agents on pre-specified or synthesized files with limited real-world dependencies, leaving workspace-level evaluation underexplored. To this end, we introduce Workspace-Bench…
…Towards Trustworthy Evaluation of Autonomous Agents (2026) AlphaEval: Evaluating Agents in Production (2026) ClawBench: Can AI Agents Complete Everyday Online Tasks? (2026) OccuBench: Evaluating AI Agents on Real-World Professional Tasks via…
…PatRe comprises 480 real-world cases and supports both oracle and retrieval-simulated evaluation settings. Our benchmark reframes patent examination as a dynamic, multi-turn process of justification and response. Extensive experiments…
…Nguyen , Raghav Mehndiratta , Lindsay Devon Brin , , Hari Subramani , Anil Madamala , Sridhar Krishna Nemala , Abstract EVA-Bench presents a comprehensive evaluation framework for voice agents that simulates realistic conversations and measures performance across…
…Unlike prior work that focuses on limited datasets or settings, MMDG-Bench unifies evaluation across multiple tasks, modalities, and real-world challenges, including corruption robustness, missing modalities, and model trustworthiness. the take…