학술논문

Performance of Parallel and Storage Intensive Jobs on Clustered Singularity Containers
Document Type
Conference
Source
2023 IEEE 21st Jubilee International Symposium on Intelligent Systems and Informatics (SISY) Intelligent Systems and Informatics (SISY), 2023 IEEE 21st Jubilee International Symposium on. :000515-000520 Sep, 2023
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Engineering Profession
General Topics for Engineers
Power, Energy and Industry Applications
Robotics and Control Systems
Signal Processing and Analysis
File systems
Computational modeling
Containers
Benchmark testing
Microcomputers
Intelligent systems
Informatics
Singularity
container
benchmarking
HPC
High Performance Computing
storage
parallelization
MPI
Language
ISSN
1949-0488
Abstract
In this work, we present our findings regarding performance benchmarking of scientific calculations embedded into Singularity containers. We evaluate storage and parallelization performance, running jobs on a personal computer cluster. We demonstrate that containerization does not detrimentally impact the overall utilization and CPU time usage of jobs for intra-node parallelization, especially compared to the overhead of parallelization itself. For inter-node parallelization using MPI, we find that of its configurations, Singularity's bind model exhibits slightly superior efficiency. Regarding storage benchmarking, we find that using the /dev/shm in-memory filesystem yields optimal performance when it is feasible, otherwise the using host native file system with bind mounts serves as a viable alternative.