Getting Started with the Burst Buffer: Using DataWarp
Technology
Presenters
Event Type
Tutorial
I/O
TimeMonday, November 13th8:30am -
12pm
Location207
DescriptionThe long-awaited Burst Buffer technology is now being
deployed on major supercomputing systems. In this
tutorial, we will introduce the Burst Buffers deployed
at the two latest supercomputers at NERSC (Cori) and
KAUST (Shaheen II) based on the Cray DataWarp, and
discuss in detail our experience with Burst Buffers from
both a system and a user’s perspective. Both KAUST and
NERSC have been supporting BB projects for more than a
year, and have developed a wealth of experience using
these resources efficiently. For this tutorial, we
combine the knowledge and experience of staff from both
sites to provide attendees with an effective
understanding of how to optimally use BB technology. We
focus on optimizing massively parallel I/O for SSDs, a
relatively new problem compared to well-established
optimizations for parallel I/O to disk-based file
systems. The tutorial will conclude with a live
demonstration of a complex workflow executed on the Cray
DataWarp, including simulation, analysis and
visualization. We will also include user applications as
case studies; we solicit user applications using this
form: https://goo.gl/M3dUv9.
