…A Multitask Benchmark and Model for Code Search Published on May 6 Submitted by Ziyin Zhang on May 11 high-quality llm benchmarks Authors: , , , Ziyin Zhang , , , Hang Yu Abstract A new code…
…To bridge this gap, we introduce ViMU, the first benchmark designed to systematically evaluate the subtext understanding capabilities of frontier models in videos. ViMU assesses whether video understanding models can go beyond…
…with absent-persona hallucination and larger models do not always achieve higher Cal, exposing calibration as a separate evaluation axis; and (iii) SFT is bounded by the difficulty of constructing annotated ground…
Papers arxiv:2605.30219 When Should Models Change Their Minds? Contextual Belief Management in Large Language Models Published on May 28 Submitted by Ningyu Zhang on May 29 Zhejiang University Authors: , , , , , , , , Abstract…
…Across nine tasks built from aligned video, play-by-play logs, commentary, reports, and statistics, our evaluation reveals a sharp capability cliff: current models handle localized perception reasonably well but struggle significantly…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Large language models are increasingly used to simulate social media users and infer how individuals may respond to online discussions. However, it remains unclear…
…Experimental results of leading large models and agents show that: 1) All computer-use agents perform poorly on multi-application tasks (< 21% success rate), far below the performance of simple single-app…
…We evaluate imitiation learning (diffusion policies, VLAs), reinforcement learning (PPO, SAC, MBRL), foundation model-based planning (LLM, VLM), diffusion-based planning (GSC), and task and motion planning (bilevel planning). No methods pass…
To show you the most relevant results, we’ve omitted some entries very similar to those already shown. Repeat the search with the omitted results included.