batch/job processing apps

Nigel Wade nmw at ion.le.ac.uk
Tue Jan 9 09:43:31 UTC 2007


bruce wrote:
> hi...
> 
> i'm considering a project where i'm going to have to process a number of
> apps (1000s). i'm looking into various frameworks (condor/openpbs/boinc) to
> see if there is a reasonable lightweight method of creating a distributed
> processing environment for managing the processes on a distributed network.
> 
> i envision having 10-20 servers as client machines. i'd like to be able to
> create an app, and have the child app submitted to a client server, where it
> would be run. i'd like to allow the client machine to be able to accomodate
> multiple (20-100) simultaneous child apps at a time.
> 
> this kind of approach would allow me to have 100s of child apps to be
> running at the same time across the network.
> 
> is anyone familiar with any kind of framework that would allow this to
> occur?
> 
> thanks
> 
> -bruce
> 

For batch processing Sun GridEngine should do what you require.
It's no lightweight solution, though - but it is free.

-- 
Nigel Wade, System Administrator, Space Plasma Physics Group,
             University of Leicester, Leicester, LE1 7RH, UK
E-mail :    nmw at ion.le.ac.uk
Phone :     +44 (0)116 2523548, Fax : +44 (0)116 2523555




More information about the fedora-list mailing list