…by taesiri on May 5 Authors: Junjie Yu , , , , , , , , , , , , , , , , , , , , , Abstract AcademiClaw presents a comprehensive benchmark for evaluating AI agents on complex academic tasks spanning multiple domains, revealing significant capability gaps in current models…
Papers arxiv:2605.26396 Advancing Creative Physical Intelligence in Large Multimodal Models Published on May 25 Submitted by Cheng Qian on May 28 University of Illinois at Urbana-Champaign Authors: , , , , , , , , , , , , Abstract Large…
…on May 2 Submitted by 张道瑄 on May 6 Authors: Daoxuan Zhang , , , Abstract Embodied Search and Rescue task and benchmark are introduced to evaluate multimodal large language model-driven UAV agents in…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Reference-free faithfulness metrics verify each atomic claim a model makes against ground truth, and are increasingly used to evaluate grounded generation . We show…
…Submitted by Yifei Li on Jun 4 Intern Large Models Authors: , , Yuhang Zang , , , , Abstract OVO-S-Bench presents a comprehensive benchmark for evaluating streaming spatial intelligence in multimodal language models through human…
…AI-generated summary LLM inference is still evaluated mainly as a model or software problem: accuracy, latency, throughput, and hardware utilization. This is incomplete. At deployment scale, the relevant output is a…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Robotic manipulation requires models that generate executable actions while anticipating and evaluating their future consequences before physical execution. We present τ_0-World Model…
…Further ablation studies show that evaluation skills are critical for handling complex evaluation: removing them causes Eval@1 to drop significantly from 65% to 30%. No model linking this paper Cite arxiv…
…Bot for paper recommendations by tagging it in a comment: @ librarian-bot recommend No model linking this paper Cite arxiv.org/abs/2605.15188 in a model README.md to link it…
…Evaluating five state-of-the-art models, we find that the best model reaches only 48.45% average accuracy, performance drops nearly 47 points from early to late turns, and long-horizon…