Analysis of data on the load of high-performance platforms by user tasks on the example of a heterogeneous computing platform Hybrilit

Автор: Polegaeva Ekaterina I., Priakhina Daria I., Streltsova Oksana I.

Журнал: Сетевое научное издание «Системный анализ в науке и образовании» @journal-sanse

Статья в выпуске: 2, 2021 года.

Бесплатный доступ

The relevance of the research presented in this article lies in the ability to aggregate statistical in-formation about the use of platform resources by various user groups. The article analyzes the data on the use of the resources of the training and testing ground of the HybriLIT platform, on the basis of which it is possible to build models for predicting the further workload of the platform in order to rationally allocate the available computing resources and the data storage system, as well as increase the efficiency of their use. The purpose of the work is to present the research aimed at data mining of the resources used when launching tasks by various groups of users and the time of their execution on the training and testing ground of the HybrLIT platform. The heterogeneous HybriLIT computing platform, consisting of a training and testing ground and the Govorun supercomputer, is part of the multifunctional information and computing complex of the Meshcheryakov Information Technology Laboratory of the Joint Institute for Nuclear Research. The platform has a heterogeneous structure of computing nodes and allows you to run parallel applications for performing calculations on various computing architectures. The summary information about the tasks running on HybriLIT, which is automatically recorded in the database by the SLURM resource manager and scheduler, is of interest for analysis. As a result, a deep analysis of data was carried out according to several criteria for each resource and for each group of users of the training and testing ground of the heterogeneous HybriLIT platform.

Еще

Data mining, high performance computing platforms, efficient use of resources

Короткий адрес: https://sciup.org/14122738

IDR: 14122738

Статья научная