Light-weight job dispatch on multiple machines

[Petter Adsen]

On 01/07/17 19:02, Peng Yu wrote:
> Hi, I'd like a command line job dispatch tool to dispatch jobs (each
> job is independent from each other and may have different input
> parameters) on multiple linux machines.
> 
> I am not looking for complex tools like sun grid engine or torque.
> Rather, I am looking for something with very little configuration (for
> example, the minumal configure is just the machine names and how many
> jobs each machine can run in parallel).
> 
> Do anybody know if such a light weighted tool available? Thanks.

You could check out GNU Parallel (Ubuntu package 'parallel'). I've
barely used it myself, but it's easy to work with and quite flexible.

Petter