…PlantMarkerBench is constructed using a modular curation pipeline integrating large-scale literature retrieval, hybrid search , species-aware biological grounding , structured evidence extraction , and targeted human review. The benchmark spans four plant species…
… More broadly, MedSP1000 shows how process-level, SP-style evaluation can reveal clinically relevant failure modes that single-turn benchmarks miss. …
… The following papers were recommended by the Semantic Scholar API Adaptive Cost-Efficient Evaluation for Reliable Patent Claim Validation 2026 MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model and Data Card Generation 2026 Beyond Rating: A Comprehensive Evaluation and Benchm… …
… However, existing benchmarks rarely test a fundamental bottleneck: whether Large Language Models can judge the methodological viability of a research idea before expending time and computational resources. …
… Existing benchmarks either evaluate offline over full videos or target events rather than spatial structure. …
…for running the benchmark can be found in mteb , while scripts for reproducing paper artifacts will be made available at mveb-paper once the paper has been reviewed and finalized. This is…
… AI-generated summary While GUI agents have shown impressive capabilities in common computer-use tasks such as OSWorld, current benchmarks mainly focus on isolated and single-application tasks. …
… Existing ICU benchmarks typically treat historical clinician actions as ground truth. …
… Existing medical agent benchmarks primarily focus on static knowledge recall, single-step atomic actions, or action intent without verifiable execution against the environment. …
… MedMisBench exposes a structural blind spot in LLM evaluation in medical settings: existing benchmarks measure what models know, but not whether they preserve correct medical judgment under misleading context . …