A Statistical Investigation of the CESM Ensemble Consistency Testing Framework

Constant evolution and improvement of large scale climate simulation codes such as the Community Earth System Model (CESM) necessitate quality checks to verify the constitution of new climate simulations. The CESM Ensemble Consistency Test (CESM-ECT) was developed as a flexible but objective method for checking the statistical consistency between an accepted ensemble of climate simulations and a new simulation created with updated code or within a new computational infrastructure. CESM-ECT utilizes a testing framework based on the popular technique of Principal Component Analysis (PCA) to determine whether a set of new simulations is statistically distinguishable from the established ensemble of climate simulations. One shortcoming of PCA is that accurate estimation requires the computational expense of a large ensemble. In this work we begin with an exploratory analysis of the CESM climate simulation data as well as an overview of PCA. Then we develop certain diagnostic tools to evaluate the estimation within PCA with respect to the size of the ensemble. Finally we demonstrate the limitations of PCA for smaller ensemble sizes by showing poor performance according to our diagnostics as well as an increased false positive rate for both empirical and simulated data.

To Access Resource:

Questions? Email Resource Support Contact:

  • opensky@ucar.edu
    UCAR/NCAR - Library


Resource Type publication
Temporal Range Begin N/A
Temporal Range End N/A
Temporal Resolution N/A
Bounding Box North Lat N/A
Bounding Box South Lat N/A
Bounding Box West Long N/A
Bounding Box East Long N/A
Spatial Representation N/A
Spatial Resolution N/A
Related Links N/A
Additional Information N/A
Resource Format PDF
Standardized Resource Format PDF
Asset Size N/A
Legal Constraints

Copyright Author(s). This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Access Constraints None
Software Implementation Language N/A

Resource Support Name N/A
Resource Support Email opensky@ucar.edu
Resource Support Organization UCAR/NCAR - Library
Distributor N/A
Metadata Contact Name N/A
Metadata Contact Email opensky@ucar.edu
Metadata Contact Organization UCAR/NCAR - Library

Author Molinari, Stephen J.
Milroy, Daniel J.
Hammerling, Dorit M.
Publisher UCAR/NCAR - Library
Publication Date 2018-12-27T00:00:00
Digital Object Identifier (DOI) Not Assigned
Alternate Identifier N/A
Resource Version N/A
Topic Category geoscientificInformation
Progress N/A
Metadata Date 2023-08-18T18:06:52.541434
Metadata Record Identifier edu.ucar.opensky::technotes:575
Metadata Language eng; USA
Suggested Citation Molinari, Stephen J., Milroy, Daniel J., Hammerling, Dorit M.. (2018). A Statistical Investigation of the CESM Ensemble Consistency Testing Framework. UCAR/NCAR - Library. http://n2t.net/ark:/85065/d7sn0czx. Accessed 30 September 2023.

Harvest Source