batch/job processing apps
Nigel Wade
nmw at ion.le.ac.uk
Tue Jan 9 09:43:31 UTC 2007
bruce wrote:
> hi...
>
> i'm considering a project where i'm going to have to process a number of
> apps (1000s). i'm looking into various frameworks (condor/openpbs/boinc) to
> see if there is a reasonable lightweight method of creating a distributed
> processing environment for managing the processes on a distributed network.
>
> i envision having 10-20 servers as client machines. i'd like to be able to
> create an app, and have the child app submitted to a client server, where it
> would be run. i'd like to allow the client machine to be able to accomodate
> multiple (20-100) simultaneous child apps at a time.
>
> this kind of approach would allow me to have 100s of child apps to be
> running at the same time across the network.
>
> is anyone familiar with any kind of framework that would allow this to
> occur?
>
> thanks
>
> -bruce
>
For batch processing Sun GridEngine should do what you require.
It's no lightweight solution, though - but it is free.
--
Nigel Wade, System Administrator, Space Plasma Physics Group,
University of Leicester, Leicester, LE1 7RH, UK
E-mail : nmw at ion.le.ac.uk
Phone : +44 (0)116 2523548, Fax : +44 (0)116 2523555
More information about the fedora-list
mailing list