2023 journal article

NOAA Open Data Dissemination: Petabyte-scale Earth system data in the cloud

SCIENCE ADVANCES, 9(38).

By: D. Willett n, J. Brannock n, J. Dissen n, P. Keown *, K. Szura*, O. Brown n, A. Simonson *

TL;DR: How NODD works with a focus on provenance, key datasets, and use is documented to support open petabyte-scale Earth system data science in the cloud by onboarding additional NOAA data and exploring performant data formats. (via Semantic Scholar)
Source: Web Of Science
Added: November 6, 2023

NOAA Open Data Dissemination (NODD) makes NOAA environmental data publicly and freely available on Amazon Web Services (AWS), Microsoft Azure (Azure), and Google Cloud Platform (GCP). These data can be accessed by anyone with an internet connection and span key datasets across the Earth system including satellite imagery, radar, weather models and observations, ocean databases, and climate data records. Since its inception, NODD has grown to provide public access to more than 24 PB of NOAA data and can support billions of requests and petabytes of access daily. Stakeholders routinely access more than 5 PB of NODD data every month. NODD continues to grow to support open petabyte-scale Earth system data science in the cloud by onboarding additional NOAA data and exploring performant data formats. Here, we document how this program works with a focus on provenance, key datasets, and use. We also highlight how to access these data with the goal of accelerating use of NOAA resources in the cloud.