A Statistical Analysis of Lossily Compressed CESM-LENS Data

The data storage burden resulting from CESM simulations continues to grow, and lossy data compression methods can alleviate this burden, provided that key climate variables are not altered to the point of affecting scientific conclusions. This dataset was generated to evaluate the effects of two leading lossy compression algorithms, sz and zfp, on daily output data from the CESM-LENS dataset. In particular, it contains daily data for variables TS (surface temperature) and PRECT (precipitation rate) from the historical forcing period (1920-2005) for CESM-LENS ensemble member 30. The provided data has been compressed and reconstructed via two popular compressors: sz 1.4.13 and zfp 0.5.3 with a number of different absolute error tolerances. Errors due to compression can be determined by comparing these reconstructed files to the original CESM-LENS timeseries data, and statistical methods can evaluate the errors at different spatiotemporal scales. While both compression algorithms show promising fidelity with the original output, detectable artifacts are introduced even at relatively tight error tolerances.

To Access Resource:

Questions? Email Resource Support Contact:

  • Allison Baker
    abaker@ucar.edu
    UCAR/NCAR - Computational and Information Systems Laboratory

Temporal Range

  • Begin:  1920-01-01
    End:  2005-12-31

Keywords

Resource Type dataset
Temporal Range Begin 1920-01-01
Temporal Range End 2005-12-31
Temporal Resolution N/A
Bounding Box North Lat 90.0
Bounding Box South Lat -90.0
Bounding Box West Long -180.0
Bounding Box East Long 180.0
Spatial Representation N/A
Spatial Resolution 1.0 degreesLatitude
1.0 degreesLongitude
Related Links N/A
Additional Information N/A
Resource Format Hierarchical Data Format File (application/x-hdf)
text/plain
Standardized Resource Format ASCII
HDF
Asset Size N/A
Legal Constraints

Creative Commons Attribution 4.0 International License.
Access Constraints None
Software Implementation Language N/A

Resource Support Name Allison Baker
Resource Support Email abaker@ucar.edu
Resource Support Organization UCAR/NCAR - Computational and Information Systems Laboratory
Distributor N/A
Metadata Contact Name GDEX Curator
Metadata Contact Email datahelp@ucar.edu
Metadata Contact Organization UCAR/NCAR - GDEX

Author Baker, Allison H
Hammerling, Dorit M
Publisher UCAR/NCAR - GDEX
Publication Date 2020-03-13
Digital Object Identifier (DOI) https://doi.org/10.5065/5sqy-zf23
Alternate Identifier N/A
Resource Version N/A
Topic Category N/A
Progress N/A
Metadata Date 2022-07-21T11:53:35-06:00
Metadata Record Identifier edu.ucar.gdex::1e1399d0-737b-4e93-b5a1-91f8b00817b1
Metadata Language eng; USA
Suggested Citation Baker, Allison H, Hammerling, Dorit M. (2020). A Statistical Analysis of Lossily Compressed CESM-LENS Data. UCAR/NCAR - GDEX. https://doi.org/10.5065/5sqy-zf23. Accessed 24 April 2024.

Harvest Source