Identification

Title

A Shallow-Tree Multi-resolution Approximation for Distributed and High-Performance Computing Systems

Abstract

We implement a parallel Multi-resolution Approximation (MRA) in Matlab using a Shallow-Tree approach designed for distributed computing environments and High-Performance Computing (HPC) systems. We significantly increase the data size that can be utilized for analysis by leveraging data parallelism to perform computations across nodes. In our novel Shallow-Tree parallelization scheme, the user specifies the first few levels to be computed in serial. After serial computations, different processing cores are assigned specific sections of the data with which to perform parallel calculations. By utilizing codistributed arrays in our parallelization scheme, we reduce the amount of memory overhead occurred on a single node and communication overhead between processors by ensuring that calculations are statistically independent. We apply our Shallow-Tree MRA to data sets of magnitudes ranging from 3 to 48 million observations, investigate the number of observations assigned to regions at the finest resolution, and perform timing studies reporting parallel performance metrics. We observe a decrease in execution time for data sets manageable with a prior MRA implementation. We also observe a wide range of parallel performance and associated computational cost for a given n, reinforcing the importance of judiciously configuring model parameters and parallel computing settings as a function of the data size and computational environment.

Resource type

document

Resource locator

Unique resource identifier

code

https://n2t.org/ark:/85065/d7k075sf

codeSpace

Dataset language

eng

Spatial reference system

code identifying the spatial reference system

Classification of spatial data and services

Topic category

geoscientificInformation

Keywords

Keyword set

keyword value

Text

originating controlled vocabulary

title

Resource Type

reference date

date type

publication

effective date

2016-01-01T00:00:00Z

Geographic location

West bounding longitude

East bounding longitude

North bounding latitude

South bounding latitude

Temporal reference

Temporal extent

Begin position

End position

Dataset reference date

date type

publication

effective date

2019-08-13T00:00:00Z

Frequency of update

Quality and validity

Lineage

Conformity

Data format

name of format

version of format

Constraints related to access and use

Constraint set

Use constraints

Limitations on public access

None

Responsible organisations

Responsible party

contact position

OpenSky Support

organisation name

UCAR/NCAR - Library

full postal address

PO Box 3000

Boulder

80307-3000

email address

opensky@ucar.edu

web address

http://opensky.ucar.edu/

name: homepage

responsible party role

pointOfContact

Metadata on metadata

Metadata point of contact