batch/job processing apps

Douglas Phillipson phillipd at oem.doe.gov
Mon Jan 8 20:27:50 UTC 2007



bruce wrote:
> hi...
> 
> i'm considering a project where i'm going to have to process a number of
> apps (1000s). i'm looking into various frameworks (condor/openpbs/boinc) to
> see if there is a reasonable lightweight method of creating a distributed
> processing environment for managing the processes on a distributed network.
> 
> i envision having 10-20 servers as client machines. i'd like to be able to
> create an app, and have the child app submitted to a client server, where it
> would be run. i'd like to allow the client machine to be able to accomodate
> multiple (20-100) simultaneous child apps at a time.
> 
> this kind of approach would allow me to have 100s of child apps to be
> running at the same time across the network.
> 
> is anyone familiar with any kind of framework that would allow this to
> occur?
> 
> thanks
> 
> -bruce
> 
I've used OpenMosix (http://openmosix.sourceforge.net/).  It will 
distribute your processes to the least used node and it's easy to set up 
on many machines.

Doug P




More information about the users mailing list