edu.ucar.opensky::articles:18942 UCAR/NCAR - Library OpenSky Support PO Box 3000 Boulder CO 80307-3000 opensky@ucar.edu http://opensky.ucar.edu/ homepage pointOfContact 2025-12-26T02:45:46.802023 ISO 19115-2 Geographic Information - Metadata - Part 2: Extensions for Imagery and Gridded Data ISO 19115-2:2009(E) https://n2t.org/ark:/85065/d7r2133m Estimating the accuracy of user surveys for assessing the impact of HPC systems 2016-08-01T00:00:00Z publication https://n2t.org/ark:/85065/d7r2133m https://doi.org/10.1145/2949550.2949640 Hart, David L. author Rishel, M. author Nychka, Douglas author UCAR/NCAR - Library publisher Each year, the Computational & Information Systems Laboratory (CISL) conducts a survey of its current and recent user community to gather a number of metrics about the scientific impact and outcomes from the use of CISL's high-performance computing systems, particularly peer-reviewed publications. However, with a modest response rate and reliance on selfreporting by users, the accuracy of the survey is uncertain as is the degree of that uncertainty. To quantify this uncertainty, CISL undertook a project that attempted to provide statistically supported limits on the accuracy and precision of the survey approach. We discovered limitations related to the range of users' HPC usage in our modeling phase, and several methods were attempted to adjust the model to fit the usage data. The resulting statistical models leverage data about the HPC usage associated with survey invitees to quantify the degree to which the survey undercounts the relevant publications. A qualitative assessment of the collected publications aligns with the statistical models, reiterates the challenges associated with acknowledgment for use of HPC resources, and suggests ways to improve the survey results further. UCAR/NCAR - Library OpenSky Support PO Box 3000 Boulder CO 80307-3000 opensky@ucar.edu http://opensky.ucar.edu/ homepage pointOfContact PDF Text theme Resource Type 2016-01-01T00:00:00Z publication Copyright 2016 Association for Computing Machinery. None eng geoscientificInformation