…The following papers were recommended by the Semantic Scholar API Benchmarking Speech-to-Speech Translation Models (2026) SpeechEditBench: A Bilingual Multi-Attribute Benchmark for Instruction-Guided Speech Editing (2026) KVoiceBench, KOpenAudioBench, and…
…Training Robust Multilingual Code Reward Models for Flexible Multi-Criteria Scoring Published on May 1 Submitted by Indraneil Paul on May 4 Themis Authors: Indraneil Paul , , Abstract Researchers introduce Themis-RM, a…
Papers arxiv:2605.04045 Audio-Visual Intelligence in Large Foundation Models Published on May 5 Submitted by Hao Fei on May 8 National University of Singapore Authors: , , Shengqiong Wu , , , , , , , , , Lei Cui , , , Hao…
…The following papers were recommended by the Semantic Scholar API Adaptive Cost-Efficient Evaluation for Reliable Patent Claim Validation (2026) MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model…
…Unlike prior work that focuses on limited datasets or settings, MMDG-Bench unifies evaluation across multiple tasks, modalities, and real-world challenges, including corruption robustness, missing modalities, and model trustworthiness. the take…
…by Sajib Acharjee Dip on May 12 Virginia Polytechnic Institute and State University Authors: , , Abstract PlantMarkerBench presents a multi-species benchmark for evaluating literature-based plant marker evidence interpretation, assessing models on…
…Experiments across lexical, general-purpose, and reasoning-intensive retrievers show that aspect-aware and agentic evaluation expose behaviors hidden by standard metrics, while RTriever-4B substantially improves over its base model. View…
…A Platform for Prompt Injection Evaluation (2026) Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMs (2026) Transient Turn Injection: Exposing Stateless Multi-Turn Vulnerabilities in Large Language Models…
…We further provide Workspace-Bench-Lite, a 100-task subset that preserves the benchmark distribution while reducing evaluation costs by about 70%. We evaluate 4 popular agent harnesses and 7 foundation models…
…Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks? Published on Jun 3 Submitted by taesiri on Jun 4 Authors: , , , Dongfu Jiang , , Hang Hua , , , , Lichi Li , , , , , , , , , Abstract AutoLab benchmark evaluates…