[Beowulf] Infiniband for MPI computations setup guide

John Hearns hearnsj at gmail.com
Wed Oct 20 18:36:32 UTC 2021


As Paul says - start a subnet manager.  I guess you are using the distro
supplied IB stack?
Run the following commands:
sminfo
ibdiagnet

these will check out your subnet manager and your fabric

On Wed, 20 Oct 2021 at 17:21, Paul Edmon via Beowulf <beowulf at beowulf.org>
wrote:

> Oh you will also need a IB subnet manager (opensm) running since you have
> an unmanaged switch.  You can start this on one of the compute nodes.   I
> would probably start up 2 so you have redundancy.
>
> -Paul Edmon-
> On 10/20/2021 6:08 AM, leo camilo wrote:
>
>  I have recently acquired a few ConnectX-3 cards and an unmanaged IB
> switch (IS5022) to upgrade my department's beowulf cluster.
>
> Thus far, I have been able to verify that the cards and switch work via
> the MFT and opensource tools in ubuntu,
>
> Though, I was wondering if anyone knew of any guide or resources for
> setting up a cluster for MPI based computations in a linux/debian
> environment? Some guides about how to make it work with SLURM would also be
> appreciated.
>
> Thanks in advance for any suggestions, I am often a user of clusters, but
> it is my first time setting one up.
>
> Cheers,
>
> Leonardo
>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit
> https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20211020/2717ceb8/attachment.htm>


More information about the Beowulf mailing list