…The following papers were recommended by the Semantic Scholar API BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali (2026) Cultural Benchmarking of LLMs in Standard and Dialectal…
…The following papers were recommended by the Semantic Scholar API HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (2026) Medical Reasoning with Large Language Models: A Survey and MR-Bench (2026…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Recent multimodal large language models have demonstrated strong reasoning ability, yet their reliability as automated evaluators remains limited by a critical weakness: when visual…
…AI-generated summary Crowdsourced pairwise evaluation has emerged as a scalable approach for assessing foundation models. However, applying it to Text to Speech (TTS) introduces high variance due to linguistic diversity and…
…May 7 Submitted by Yuwei Yin on May 11 University of British Columbia Authors: Yuwei Yin , Chuyuan Li , Abstract IntentGrasp is a benchmark for evaluating large language models' intent understanding capability, demonstrating…
…Across the eight model backends, Lucky rates range from 0.5% to 23.2%, and some models move by as many as five rank positions when ranked by quality score instead of…
…We evaluate 10 frontier LLMs on Ψ-Bench and find that while most models can produce coherent and reasonable arguments, even state-of-the-art models still leave considerable room for improvement…
…to evaluate conversational agent reliability, revealing significant performance gaps among leading models. Generated by Qwen/Qwen2.5-Coder-32B-Instruct As recommender systems transition toward agentic, multi-turn conversational interfaces , evaluation paradigms…
…The following papers were recommended by the Semantic Scholar API GEditBench v2: A Human-Aligned Benchmark for General Image Editing (2026) Can Nano Banana 2 Replace Traditional Image Restoration Models? An Evaluation…
…The following papers were recommended by the Semantic Scholar API WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Models (2026) WebGameBench: Requirement-to-Application Evaluation for Coding Agents via Browser-Native…