Using parallel Batcher sort in active storage system
Автор: Tyutlyaeva Ekaterina Olegovna
Журнал: Программные системы: теория и приложения @programmnye-sistemy
Рубрика: Программное и аппаратное обеспечение распределенных и суперкомпьютерных систем
Статья в выпуске: 4 (18) т.4, 2013 года.
Бесплатный доступ
This paper describes a modified parallel Batcher sort algorithm for big data processing. The main novelty of implemented sort algorithm is to integrate effective parallel batcher sort and Active Storage concept. We use Active Storage based on Lustre File System and TSim C++ template library for parallelization. This paper presents experimental testing results for scientific processing real seismic data. Presented results indicate that described algorithm can reach linear acceleration on sorting big data sets (More then 100 Gb). (in Russian)
Active storage, batcher sort, big data processing, distributed data processing, parallel sort
Короткий адрес: https://sciup.org/14335960
IDR: 14335960