batch/job processing apps
Douglas Phillipson
phillipd at oem.doe.gov
Mon Jan 8 20:27:50 UTC 2007
bruce wrote:
> hi...
>
> i'm considering a project where i'm going to have to process a number of
> apps (1000s). i'm looking into various frameworks (condor/openpbs/boinc) to
> see if there is a reasonable lightweight method of creating a distributed
> processing environment for managing the processes on a distributed network.
>
> i envision having 10-20 servers as client machines. i'd like to be able to
> create an app, and have the child app submitted to a client server, where it
> would be run. i'd like to allow the client machine to be able to accomodate
> multiple (20-100) simultaneous child apps at a time.
>
> this kind of approach would allow me to have 100s of child apps to be
> running at the same time across the network.
>
> is anyone familiar with any kind of framework that would allow this to
> occur?
>
> thanks
>
> -bruce
>
I've used OpenMosix (http://openmosix.sourceforge.net/). It will
distribute your processes to the least used node and it's easy to set up
on many machines.
Doug P
More information about the users
mailing list