학술논문
Performance of Parallel and Storage Intensive Jobs on Clustered Singularity Containers
Document Type
Conference
Author
Source
2023 IEEE 21st Jubilee International Symposium on Intelligent Systems and Informatics (SISY) Intelligent Systems and Informatics (SISY), 2023 IEEE 21st Jubilee International Symposium on. :000515-000520 Sep, 2023
Subject
Language
ISSN
1949-0488
Abstract
In this work, we present our findings regarding performance benchmarking of scientific calculations embedded into Singularity containers. We evaluate storage and parallelization performance, running jobs on a personal computer cluster. We demonstrate that containerization does not detrimentally impact the overall utilization and CPU time usage of jobs for intra-node parallelization, especially compared to the overhead of parallelization itself. For inter-node parallelization using MPI, we find that of its configurations, Singularity's bind model exhibits slightly superior efficiency. Regarding storage benchmarking, we find that using the /dev/shm in-memory filesystem yields optimal performance when it is feasible, otherwise the using host native file system with bind mounts serves as a viable alternative.