@Article{Hoffman_EGUsphere_2025, author = {Forrest M. Hoffman and Birgit Hassler and Ranjini Swaminathan and Jared Lewis and Bouwe Andela and Nathan Collier and D\'{o}ra Heged\H{u}s and Jiwoo Lee and Charlotte Pascoe and Mika Pfl\"{u}ger and Martina Stockhause and Paul Ullrich and Min Xu and Lisa Bock and Felicity Chun and Bettina K. Gier and Douglas I. Kelley and Axel Lauer and Julien Lenhardt and Manuel Schlund and Mohannan G. Sreeush and Katja Weigel and Ed Blockley and Rebecca Beadling and Romain Beucher and Demiso D. Dugassa and Valerio Lembo and Jianhua Lu and Swen Brands and Jerry Tjiputra and Elizaveta Malinina and Brian Mederios and Enrico Scoccimarro and Jeremy Walton and Phil Kershaw and Andr\'{e} L. Marquez and Malcolm J. Roberts and Eleanor O'Rourke and Elisabeth Dingley and Briony Turner and Helene Hewitt and John P. Dunne}, title = {Rapid Evaluation Framework for the {CMIP7} Assessment Fast Track}, journal = EGUsphere, volume = 2025, pages = {1--57}, doi = {10.5194/egusphere-2025-2685}, year = 2025, abstract = {As Earth system models (ESMs) grow in complexity and in volumes of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon community evaluation and benchmarking tools. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages best-available observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and finally selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for specific diagnostics as soon as model data are published on ESGF by the originating modelling centres. The REF is designed to be portable across a range of current computational platforms to facilitate use by modelling centres for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and reductions in uncertainties for projections since ESMs are the main tool for studying the global Earth system. Production of reproducible diagnostics and community-based assessments are the key features of the REF that help to inform mitigation and adaptation policies.} }