slurm Parallelizing Workloads With Slurm (Brute Force Edition) One of the reasons researchers turn to clusters and Slurm is to run many independent jobs. Recently, we posted about how to use Slurm job arrays to do this. Here we describe some additional intuitive ways of getting the job(s) done.
slurm Parallelizing Workloads with Slurm Job Arrays Do you have a script that needs to be run across many samples? Or maybe you need to parameter test a script with a variety of values? This blog post covers how to achieve this simply and efficiently with Slurm job arrays.
slurm A simple Slurm guide for beginners SLURM is a popular job scheduler that is used to allocate, manage and monitor jobs on your cluster. In this blog post we teach you the basics of submitting SLURM jobs on your very own auto scaling cluster in the cloud with RONIN.
parallel Parallelising Jobs with GNU Parallel In the cloud, you can easily scale the size of your computing resources to fit your needs, meaning you have the ability to run many commands or scripts in parallel. This is where GNU parallel comes in handy!
Getting Started Running Commands in the Background with GNU Screen Being able to run commands and scripts directly from the command-line is great; however, some commands or scripts may need to run for extended periods without interruption. GNU Screen provides a simple solution to ensure your analyses are never prematurely terminated again.
cluster Create an Auto Scale Cluster Auto Scale Clusters in RONIN are your very own High Performance Computers that automatically scale by CPU's as workloads get more intensive. They're really easy to fire up. No, really!