Minimal, fast single node queue software

Greg Lindahl lindahl at keyresearch.com
Mon Dec 16 13:21:35 PST 2002


On Mon, Dec 16, 2002 at 12:47:02PM -0800, David Mathog wrote:

> I have an application which is very simple and efficient
> so that the parallel compute node part can run in much less
> than 1 second.  And therein lies the rub - nothing I've tried
> so far can handle job queues across 20 nodes nearly that fast. 

"Doctor, it hurts when I do this."

What you want to do instead is write a "worker" which asks some server
for work units. You aren't going to get there with anything that opens
lots of sockets, generates lots of new processes, etc.

-- greg




More information about the Beowulf mailing list