parallel - RONIN BLOG

Parallelizing Workloads With Slurm (Brute Force Edition)

One of the reasons researchers turn to clusters and Slurm is to run many independent jobs. Recently, we posted about how to use Slurm job arrays to do this. Here we describe some additional intuitive ways of getting the job(s) done.

slurm

Parallelizing Workloads with Slurm Job Arrays

Do you have a script that needs to be run across many samples? Or maybe you need to parameter test a script with a variety of values? This blog post covers how to achieve this simply and efficiently with Slurm job arrays.

slurm

A simple Slurm guide for beginners

SLURM is a popular job scheduler that is used to allocate, manage and monitor jobs on your cluster. In this blog post we teach you the basics of submitting SLURM jobs on your very own auto scaling cluster in the cloud with RONIN.

parallel

Parallelising Jobs with GNU Parallel

In the cloud, you can easily scale the size of your computing resources to fit your needs, meaning you have the ability to run many commands or scripts in parallel. This is where GNU parallel comes in handy!

Getting Started

Running Commands in the Background with GNU Screen

Being able to run commands and scripts directly from the command-line is great; however, some commands or scripts may need to run for extended periods without interruption. GNU Screen provides a simple solution to ensure your analyses are never prematurely terminated again.

cluster

Create an Auto Scale Cluster

Auto Scale Clusters in RONIN are your very own High Performance Computers that automatically scale by CPU's as workloads get more intensive. They're really easy to fire up. No, really!

Common Searches