Improving earth system model selection methodologies for projecting hydroclimatic change: Case study in the Pacific Northwest

The rapid expansion of Earth system model (ESM) data available from the Coupled Model Intercomparison Project Phase 6 (CMIP6) necessitates new methods to evaluate the performance and suitability of ESMs used for hydroclimate applications as these extremely large data volumes complicate stakeholder efforts to use new ESM outputs in updated climate vulnerability and impact assessments. We develop an analysis framework to inform ESM sub-selection based on process-oriented considerations and demonstrate its performance for a regional application in the US Pacific Northwest. First, a suite of global and regional metrics is calculated, using multiple historical observation datasets to assess ESM performance. These metrics are then used to rank CMIP6 models, and a culled ensemble of models is selected using a trend-related diagnostics approach. This culling strategy does not dramatically change climate scenario trend projections in this region, despite retaining only 20% of the CMIP6 ESMs in the final model ensemble. The reliability of the culled trend projection envelope and model response similarity is also assessed using a perfect model framework. The absolute difference in temperature trend projections is reduced relative to the full ensemble compared to the model for each SSP scenario, while precipitation trend errors are largely unaffected. In addition, we find that the spread of the culled ensemble temperature and precipitation trends includes the trend of the "truth" model similar to 83%-92% of the time. This analysis demonstrates a reliable method to reduce ESM ensemble size that can ease use of ESMs for creating and understanding climate vulnerability and impact assessments.

To Access Resource:

Questions? Email Resource Support Contact:

  • opensky@ucar.edu
    UCAR/NCAR - Library

Resource Type publication
Temporal Range Begin N/A
Temporal Range End N/A
Temporal Resolution N/A
Bounding Box North Lat N/A
Bounding Box South Lat N/A
Bounding Box West Long N/A
Bounding Box East Long N/A
Spatial Representation N/A
Spatial Resolution N/A
Related Links

Related Software #1 : matplotlib/matplotlib v3.1.3

Related Software #2 : xarray-contrib/xskillscore: Release v0.0.23

Related Software #3 : pangeo-data/xESMF: v0.6.3

Related Software #4 : nlybarger/ESM_regional_evaluation: Initial release

Additional Information N/A
Resource Format PDF
Standardized Resource Format PDF
Asset Size N/A
Legal Constraints

Copyright author(s). This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.


Access Constraints None
Software Implementation Language N/A

Resource Support Name N/A
Resource Support Email opensky@ucar.edu
Resource Support Organization UCAR/NCAR - Library
Distributor N/A
Metadata Contact Name N/A
Metadata Contact Email opensky@ucar.edu
Metadata Contact Organization UCAR/NCAR - Library

Author Lybarger, Nicholas
Smith, Abigail
Newman, Andrew J.
Gutmann, Ethan D.
Wood, Andrew
Frans, C. D.
Warner, M. D.
Arnold, J. R.
Publisher UCAR/NCAR - Library
Publication Date 2024-04-16T00:00:00
Digital Object Identifier (DOI) Not Assigned
Alternate Identifier N/A
Resource Version N/A
Topic Category geoscientificInformation
Progress N/A
Metadata Date 2025-07-10T20:02:48.567557
Metadata Record Identifier edu.ucar.opensky::articles:27119
Metadata Language eng; USA
Suggested Citation Lybarger, Nicholas, Smith, Abigail, Newman, Andrew J., Gutmann, Ethan D., Wood, Andrew, Frans, C. D., Warner, M. D., Arnold, J. R.. (2024). Improving earth system model selection methodologies for projecting hydroclimatic change: Case study in the Pacific Northwest. UCAR/NCAR - Library. https://n2t.org/ark:/85065/d7qn6bz5. Accessed 09 August 2025.

Harvest Source