Papers arxiv:2605.15185 Quantitative Video World Model Evaluation for Geometric-Consistency Published on May 14 Submitted by taesiri on May 15 Authors: , , , , Abstract A quantitative framework called PDI-Bench is introduced…
…Submitted by T. S. Liang on May 14 The University of Hong Kong Authors: Shuang Liang , , , , Abstract CAFE is a new benchmark for evaluating concept-faithful segmentation in promptable models through attribute…
…A Benchmark for Real-World, Long-Horizon Agent Evaluation Published on May 11 Submitted by Shuangrui Ding on May 15 Intern Large Models Authors: , Xuanlang Dai , , , , Yang JingYi , , , , , , , , , , , Yuhang Zang Abstract WildClawBench…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Large language models can reproduce training data, but existing memorization evaluation s mostly measure whether models can be forced to do so, rather than…
…Multi-Modal Memory Evaluation through Cognitively-Grounded Video Tasks Published on Jun 3 Submitted by Huang Jie on Jun 4 PKU-VaLuE-Lab Authors: , , , , , , Abstract Multi-modal models exhibit significant limitations in…
…Evaluating Open-World Exploration of MLLM Agents in Minecraft Published on May 29 Submitted by Tianjie Ju on Jun 2 Authors: , , , , , , , , , Abstract MineExplorer benchmark evaluates multimodal large language models' open-world exploration…
…by the Semantic Scholar API IndicSafe: A Benchmark for Evaluating Multilingual LLM Safety in South Asia (2026) ML-Bench&Guard: Policy-Grounded Multilingual Safety Benchmark and Guardrail for Large Language Models (2026…
…Evaluating Multimodal Large Language Models on Real-World University-Level STEM Student Handwritten Solutions Published on Apr 30 Submitted by Weiyu Sun on May 8 Authors: Weiyu Sun , , , , , Abstract EDU-CIRCUIT-HW…
…Are Current Agents Capable of Autonomous Agent Development? Published on Jun 3 Submitted by Xinyu Lu on Jun 3 Authors: Xinyu Lu , , , , , , , , , , Abstract The Meta-Agent Challenge evaluates AI models' ability to…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct A growing failure mode in agent evaluation and training is that models can achieve high evaluation scores by exploiting shortcuts instead of solving the…