SC17 Denver, CO

P57: Adaptive Tier Selection for NetCDF and HDF5


Authors: Jakob Luettgau (German Climate Computing Center), Eugen Betke (German Climate Computing Center), Olga Perevalova (University of Hamburg), Julian Kunkel (German Climate Computing Center), Michael Kuhn (University of Hamburg)

Abstract: Scientific applications on supercomputers tend to be I/O-intensive. To achieve portability and performance, data description libraries such as HDF5 and NetCDF are commonly used. Unfortunately, the libraries often default to suboptimal access patterns for reading/writing data to multi-tier distributed storage. This work explores the feasibility of adaptively selecting tiers depending on an application's I/O behavior.
Award: Best Poster Finalist (BP): no

Poster: pdf
Two-page extended abstract: pdf


Poster Index