Interstate Data Moving and the Last Block Problem: Lessons Learned in CAPS Spring Experiment 2014

Abstract

Talk Abstract

In Spring of 2014, for the first time, CAPS endeavored to send complete high resolution 4D numerical weather prediction forecast files from the National Institute for Computational Sciences (NICS) in Oak Ridge TN to forecasters in the Hazardous Weather Testbed in the National Weather Center at the University of Oklahoma. Having the complete files would allow the use of 3D visualization tools and exploration of the forecast output not previously possible. As weather forecasts, the data were very perishable and prompt reliable throughput was essential. The issues around moving very large datasets in real time halfway across the country are explored from the end-user perspective, with some lessons learned and some future solutions presented.