← Back to publications
2026 · Preprint · Under review

HoloCosm: Beyond Single-Metric Benchmark Compression Across Multiple Metrics

Yupei Lin, Zhongzhan Huang, Junxin Li, Guoming Ling, Shanshan Zhong, Hefeng Wu, Yukai Shi, Liang Lin
arXiv:2610.26714
Figure 1 — HoloCosm: Beyond Single-Metric Benchmark Compression Across Multiple Metrics
Figure 1: Model-ranking consistency across metrics. Each point shows Spearman ρ between rankings induced by two official metrics, all direction-aligned so higher is better. Colors show correlation ranges, the dashed line marks ρ ≥0.85, and right-side annotations give metric counts and high-correlation pairs. Weak and negative correlations are common.
Overview

Studies multi-metric benchmark compression. HoloCosm jointly minimizes score-reconstruction error while constraining ranking distortion across 15 benchmark configurations and 85 component metrics.