Título:
|
Productive programming of GPU clusters with OmpSs
|
Autor/a:
|
Bueno Hedo, Javier; Planas, Judit; Duran González, Alejandro; Badia Sala, Rosa Maria; Martorell Bofill, Xavier; Ayguadé Parra, Eduard; Labarta Mancho, Jesús José
|
Otros autores:
|
Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors; Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
Abstract:
|
Clusters of GPUs are emerging as a new computational
scenario. Programming them requires the use of
hybrid models that increase the complexity of the applications,
reducing the productivity of programmers.
We present the implementation of OmpSs for clusters of
GPUs, which supports asynchrony and heterogeneity for task
parallelism. It is based on annotating a serial application with
directives that are translated by the compiler. With it, the same
program that runs sequentially in a node with a single GPU
can run in parallel in multiple GPUs either local (single node)
or remote (cluster of GPUs). Besides performing a task-based
parallelization, the runtime system moves the data as needed
between the different nodes and GPUs minimizing the impact
of communication by using affinity scheduling, caching, and
by overlapping communication with the computational task.
We show several applicactions programmed with OmpSs
and their performance with multiple GPUs in a local node
and in remote nodes. The results show good tradeoff between
performance and effort from the programmer. |
Abstract:
|
Peer Reviewed |
Materia(s):
|
-Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors::Arquitectures distribuïdes -Computational grids (Computer systems) -Computació distribuïda |
Derechos:
|
|
Tipo de documento:
|
Artículo - Versión publicada Objeto de conferencia |
Compartir:
|
|