Títol:
|
ECHOFS: a scheduler-guided temporary filesystem to leverage node-local NVMS
|
Autor/a:
|
Miranda, Alberto; Nou Castell, Ramon; Cortés, Toni
|
Altres autors:
|
Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors; Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
Abstract:
|
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Abstract:
|
The growth in data-intensive scientific applications poses strong demands on the HPC storage subsystem, as data needs to be copied from compute nodes to I/O nodes and vice versa for jobs to run. The emerging trend of adding denser, NVM-based burst buffers to compute nodes, however, offers the possibility of using these resources to build temporary file systems with specific I/O optimizations for a batch job. In this work, we present echofs, a temporary filesystem that coordinates with the job scheduler to preload a job's input files into node-local burst buffers. We present the results measured with NVM emulation, and different FS backends with DAX/FUSE on a local node, to show the benefits of our proposal and such coordination. |
Abstract:
|
This work was partially supported by the Spanish Ministry of Science and Innovation
under the TIN2015–65316 grant, the Generalitat de Catalunya under contract 2014–
SGR–1051, as well as the European Union’s Horizon 2020 Research and Innovation
Programme, under Grant Agreement no. 671951 (NEXTGenIO). Source code available
at https://github.com/bsc-ssrg/echofs. |
Abstract:
|
Peer Reviewed |
Matèries:
|
-Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors::Arquitectures paral·leles -Computer storage devices -High performance computing -Parallel processing (Electronic computers) -Buffer storage -Metadata -Fuses -Nonvolatile memory -Hardware -Computer architecture -Random access memory -Ordinadors -- Memòries -Càlcul intensiu (Informàtica) -Processament en paral·lel (Ordinadors) |
Drets:
|
|
Tipus de document:
|
Article - Versió presentada Objecte de conferència |
Publicat per:
|
Institute of Electrical and Electronics Engineers (IEEE)
|
Compartir:
|
|