boost.MPI for a scheduler design
Hi, I want to design an application program (C++) that can distribute computing tasks on a cluster with MPI installed. I would like to use boost.MPI to do the data communication and Rhapsodia.Schedulerto do the task scheduling. For example, I need to solve a big problem, which can be divided into multiple small tasks. These small tasks can be done independently on different nodes. So, when they are done, they return their results to one node, which combine their results into a solution for the big problem. Right now, the big problem has been programmed with C++. It is a sequential algorithm. I need to design a task/job scheduler that can do the above scheduling on cluster system so that the small tasks can be run in parallel. In this way, we can improve the performance of the sequential algorithm. Does my idea make sense ? Any help is appreciated. thanks Jack May 29 2010 _________________________________________________________________ Hotmail is redefining busy with tools for the New Busy. Get more from your inbox. http://www.windowslive.com/campaign/thenewbusy?ocid=PID28326::T:WLMTAGL:ON:W...
Hi, My questions : (1) My cluster has been installed with Open MPI, if I install boost.MPI on it, is there some conflict ? boost.MPI provides all functions of OpenMPI ? (2) Does boost.MPI support Rhapsodia.Scheduler to do the task scheduling. ? (3) I need to parallelize an algorithm so that a big problem is decomposed into small tasks, which can be distributed to other nodes by the Rhapsodia.Scheduler and after being solved, the results of these tasks are returned to the node with the Rhapsodia.Scheduler, which will distribute more tasks on the base of the collected results. Does boost.MPI support this ? Any help is appreciated. thanks Jack May 29 2010
Date: Sat, 29 May 2010 20:54:16 +0200 From: joel.falcou@lri.fr To: boost-users@lists.boost.org Subject: Re: [Boost-users] boost.MPI for a scheduler design
Jack Bryan wrote:
<snip>, What's the boost related question ?
Boost-users mailing list Boost-users@lists.boost.org http://lists.boost.org/mailman/listinfo.cgi/boost-users
_________________________________________________________________ The New Busy think 9 to 5 is a cute idea. Combine multiple calendars with Hotmail. http://www.windowslive.com/campaign/thenewbusy?tile=multicalendar&ocid=PID28326::T:WLMTAGL:ON:WL:en-US:WM_HMP:042010_5
Jack Bryan wrote:
(1) My cluster has been installed with Open MPI, if I install boost.MPI on it, is there some conflict ? boost.MPI provides all functions of OpenMPI ?
Boost.MPI is a C++ binding to w/e MPI runtime and library you may have. It does NOT reimpelment MPI.
(2) Does boost.MPI support Rhapsodia.Scheduler to do the task scheduling. ? No scheduling are done in MPI nor Boost.MPI, you have to handle that yourself (3) I need to parallelize an algorithm so that a big problem is decomposed into small tasks, which can be distributed to other nodes by the Rhapsodia.Scheduler and after being solved, the results of these tasks are returned to the node with the Rhapsodia.Scheduler, which will distribute more tasks on the base of the collected results. Does boost.MPI support this ? Boost.MPI support MPI v2 standard, no more than that.
participants (2)
-
Jack Bryan -
joel falcou