…A Benchmark for Real-World, Long-Horizon Agent Evaluation (2026) OpenComputer: Verifiable Software Worlds for Computer-Use Agents (2026) AgenticVBench: Can AI Agents Complete Real-World Post-Production Tasks? (2026) SWE-Marathon…
…Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields Published on Jun 9 Submitted by taesiri on Jun 10 ByteDance Seed Authors: , Jingzhe Ding , , , , , , , , , , , , , , , , , , , , Abstract Current AI…
…2026) $\pi$-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows (2026) TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks (2026) WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use…
…Benchmarking LLM Agents on Real-World Hardware Bug Repair Tasks (2026) ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspaces (2026) Spec Kit Agents: Context-Grounded Agentic Workflows (2026…
…A Unified Video-Action World Model for Robotic Manipulation (2026) Cortex 2.0: Grounding World Models in Real-World Industrial Deployment (2026) dWorldEval: Scalable Robotic Policy Evaluation via Discrete Diffusion World Model…
…for evaluating LLM agents' ability to adaptively plan under progressively revealed world and user constraints through multi-turn interactions. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Planning for real-world problems…
…a unified evaluation suite for image editing and reward modeling. Edit-Compass contains 2,388 carefully annotated instances spanning six progressively challenging task categories, covering capabilities such as world knowledge reasoning, visual…
…View arXiv page View PDF Add to collection Community NVIDIA OmniDreams is an action-conditioned foundation generative world model that provides real-time, photorealistic, and reactive simulation environments for training and evaluating…
…Jiahao Ying , Boxian Ai , , , Abstract OpenSkillEval is an automatic evaluation framework that assesses skill-augmented agent systems and skills across diverse real-world applications, revealing that skill availability doesn't guarantee effective…
…Benchmarking LLM Agents on Real-World Personal Applications via Environment Simulation Published on Jun 1 Submitted by WENHAO WANG on Jun 2 Authors: , , , , , , , , , , , Abstract MCP-Persona benchmark evaluates agent performance on personalized…