Simplifying the life-cycle management of HPC, data analytics and AI workflows

Relatore: Rosa M. Badia, BSC- Barcelona Supercomputing Center

Moderatore: Sandro Luigi Fiore, Dipartimento di Ingegneria e Scienza dell’Informazione, Università di Trento

Abstract

With Exaflop systems already here, High-Performance Computing (HPC) involves everytime larger and complex supercomputers. At the same time, the user community is aware of the underlying performance and eager to leverage it by providing more complex application workflows to leverage them.
What is more, current application trends aim to use data analytics and artificial intelligence combined with HPC modeling and simulation.
However, the programming models and tools are different in these fields, and there is a need for methodologies that enable the development of workflows that combine HPC software, data analytics, and artificial intelligence.

The eFlows4HPC project aims at providing a workflow software stack that fulfills this need. The project is also developing the HPC Workflows as a Service (HPCWaaS) methodology that aims at providing tools to simplify the development, deployment, execution, and reuse of workflows. The project showcases its advances with three application Pillars with industrial and social relevance: manufacturing, climate, and urgent computing for natural hazards. The talk will present the actual progress and findings of the project

About the speaker

Rosa M. Badia holds a PhD on Computer Science (1994) from the Technical University of Catalonia (UPC).

She is the manager of the Workflows and Distributed Computing research group at the Barcelona Supercomputing Center (BSC). Her current research interest are programming models for complex platforms (from edge, fog, to Clouds and large HPC systems).

The group led by Dr. Badia has been developing StarSs programming model for more than 15 years, with a high success in adoption by application developers. Currently the group focuses its efforts in PyCOMPSs/COMPSs, an instance of the programming model for distributed computing including Cloud.

Dr Badia has published near 200 papers in international conferences and journals in the topics of her research. Her group is very active in projects funded by the European Commission and in contracts with industry. Dr Badia is the PI of the eFlows4HPC project