load balancing tools across multiple machines

[Shahar Dag]

----- Original Message ----- 
From: "Peng Yu" <pengyu.ut at gmail.com>
To: "Ubuntu user technical support,not for general discussions" 
<ubuntu-users at lists.ubuntu.com>
Sent: Monday, July 19, 2010 11:16 PM
Subject: load balancing tools across multiple machines


> Hi,
>
> I have a job to run a several program with a set of different input
> files. And I have several linux multi-core machines to run such a job.
> Whenever the program run, it takes several MB input file and write a
> several MB output file. The input files are at a file system. Each
> machine has its own local file system. Therefore, it is better to copy
> the input file if the file is not on the local disk where a program is
> going to run. The output file is always written on the local disk.
>
> I'm wondering what are the best load best tool on linux that can
> handle many instance of the same program (with different input) on
> multiple multicore machines.
>
> -- 
> Regards,
> Peng
>
> -- 
> ubuntu-users mailing list
> ubuntu-users at lists.ubuntu.com
> Modify settings or unsubscribe at: 
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-users
>

Hi Peng

You can try http://www.cs.wisc.edu/condor/
I do not work with it personally, but I know others that do.

Shahar