A Statistical Analysis of Lossily Compressed CESM-LENS Data

The data storage burden resulting from CESM simulations continues to grow, and lossy data compression methods can alleviate this burden, provided that key climate variables are not altered to the point of affecting scientific conclusions. This dataset was generated to evaluate the effects of two leading lossy compression algorithms, SZ and ZFP, on daily output data from the CESM-LENS dataset. In particular, it contains daily data for variables TS (surface temperature) and PRECT (precipitation rate) from the historical forcing period (1920-2005) for CESM-LENS ensemble member 30. The provided data has been compressed and reconstructed via two popular compressors: SZ 1.4.13 and ZFP 0.5.3 with a number of different absolute error tolerances. Errors due to compression can be determined by comparing these reconstructed files to the original CESM-LENS timeseries data, and statistical methods can evaluate the errors at different spatiotemporal scales. While both compression algorithms show promising fidelity with the original output, detectable artifacts are introduced even at relatively tight error tolerances.

To Access Resource:

Questions? Email Resource Support Contact:

  • datahelp@ucar.edu

Keywords

Resource Type dataset
Temporal Range Begin N/A
Temporal Range End N/A
Temporal Resolution N/A
Bounding Box North Lat N/A
Bounding Box South Lat N/A
Bounding Box West Long N/A
Bounding Box East Long N/A
Spatial Representation N/A
Spatial Resolution N/A
Related Links N/A
Additional Information N/A
Resource Format HDF5/NetCDF4
Standardized Resource Format NetCDF
Asset Size 98183.013 MB
Legal Constraints

Creative Commons Attribution 4.0 International License
Access Constraints None
Software Implementation Language N/A

Resource Support Name N/A
Resource Support Email datahelp@ucar.edu
Resource Support Organization N/A
Distributor NSF NCAR Geoscience Data Exchange
Metadata Contact Name N/A
Metadata Contact Email datahelp@ucar.edu
Metadata Contact Organization NSF NCAR Geoscience Data Exchange

Author Baker, Allison H
Hammerling, Dorit M
Publisher NSF National Center for Atmospheric Research
Publication Date 2020-03-13
Digital Object Identifier (DOI) https://doi.org/10.5065/5sqy-zf23
Alternate Identifier d583147
Resource Version N/A
Topic Category climatologyMeteorologyAtmosphere
Progress completed
Metadata Date 2025-10-09T01:45:40Z
Metadata Record Identifier edu.ucar.gdex::d583147
Metadata Language eng; USA
Suggested Citation Baker, Allison H, Hammerling, Dorit M. (2020). A Statistical Analysis of Lossily Compressed CESM-LENS Data. NSF National Center for Atmospheric Research. https://doi.org/10.5065/5sqy-zf23. Accessed 16 October 2025.

Harvest Source