Further considerations
Last updated
Was this helpful?
Last updated
Was this helpful?
In this part, I would keep some notes on tools or softwares that I haven't fully determined to merge into the main workflow on HPC2, it is kept for possible future technology selections.
List of typical HPCs:
Not included, using spack instead
Not a valid option for debian?
Not included, using spack instead
Alternatives to spack.
Not included, using lmod by spack
Not a fan of this due to the language it utilized.
alternatives to modules, merged to the main workflow under spack
file system for HPC
Lustre: need patch on kernel, not considering for mini clusters.
Seems very promising and easy to configure, also more suitable for a small cluster. But after some reading, it seems not to be a good choice as the main fs for HPC.
large file transfer service
man NSSWITCH.CONF
decided to try this in main workflow
very cool and nice softwares with friendly and clear docs!
language designed for parallel
, note it has a github wiki page
, and possible an important list of softwares that might be useful for HPC in general.
Some comparison posts: ,
Some configuration reference on lustre:
Small files benchmarking on distrubuted FS
A remote server specially desinged for clusters:
See . Merged to the main workflow
openLDAP for user management:
openLDAP configure: