← Back to publications
2026 · Preprint

Are We Testing Too Much? A Survey of Benchmark Compression for Efficient Evaluation of Large Language Models

Guoming Ling, Yupei Lin, Zhongzhan Huang, Junxin Li, Junjie Liu, Shanshan Zhong, Hefeng Wu, Liang Lin
arXiv:2610.18248
Figure 1 — Are We Testing Too Much? A Survey of Benchmark Compression for Efficient Evaluation of Large Language Models
Figure 1: Publication trends in benchmark compression research from 2023 to August 2026. Quarterly and cumulative paper counts show rapid growth since 2024.
Overview

Surveys 119 papers on benchmark compression and organizes methods around sample selection, full-benchmark score recovery, and reliability verification.