A Statistical Investigation of the CESM Ensemble Consistency Testing Framework - Part II

Weather is the archetype for chaotic dynamical system. As such, improvements, updates, and modifications to large scale climate simulation demand there be quality checks in place to ensure that new climate simulations are consistent in their reproduction of the real-world phenomena. The Community Earth System Model (CESM) Ensemble Consistency Test (ECT) was constructed to fulfill this need. In short, the CESM-ECT uses a large ensemble of climate simulations produced from an established software version and trusted computational environment as a baseline to compare against new climate simulations produced from updated software and/or a new computational infrastructure. One shortcoming of the current version of CESM-ECT is its need for a large ensemble in order to produce accurate enough estimation for certain statistics. The current method uses Principal Component Analysis (PCA) and in previous work we demonstrate the limitations of this approach for reducing the necessary ensemble size. In this work, we propose an alternative method based on a hard thresholding estimate of the correlation matrix. We compare our new method to the previously established method by considering both the false positive rate and the power in our analysis. We are able to explain a remarkable and counterintuitive result concerning the effect of ensemble size on the power of the CESM-ECT by investigating the effects of ensemble size on the estimates of the eigenvalues of the corresponding sample correlation matrix.

To Access Resource:

Questions? Email Resource Support Contact:

  • opensky@ucar.edu
    UCAR/NCAR - Library

Keywords

Resource Type publication
Temporal Range Begin N/A
Temporal Range End N/A
Temporal Resolution N/A
Bounding Box North Lat N/A
Bounding Box South Lat N/A
Bounding Box West Long N/A
Bounding Box East Long N/A
Spatial Representation N/A
Spatial Resolution N/A
Related Links

Related Service #1 : Cheyenne: SGI ICE XA Cluster

Additional Information N/A
Resource Format PDF
Standardized Resource Format PDF
Asset Size N/A
Legal Constraints

Copyright author(s). This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.


Access Constraints None
Software Implementation Language N/A

Resource Support Name N/A
Resource Support Email opensky@ucar.edu
Resource Support Organization UCAR/NCAR - Library
Distributor N/A
Metadata Contact Name N/A
Metadata Contact Email opensky@ucar.edu
Metadata Contact Organization UCAR/NCAR - Library

Author S. Molinari
Milroy, D.
Hammerling, Dorit
Publisher UCAR/NCAR - Library
Publication Date 2024-12-10T00:00:00
Digital Object Identifier (DOI) Not Assigned
Alternate Identifier N/A
Resource Version N/A
Topic Category geoscientificInformation
Progress N/A
Metadata Date 2025-07-10T19:55:51.479469
Metadata Record Identifier edu.ucar.opensky::technotes:42141
Metadata Language eng; USA
Suggested Citation S. Molinari, Milroy, D., Hammerling, Dorit. (2024). A Statistical Investigation of the CESM Ensemble Consistency Testing Framework - Part II. UCAR/NCAR - Library. https://n2t.net/ark:/85065/d7348qqk. Accessed 01 August 2025.

Harvest Source