[Beowulf] NFS HPC survey results.

[Elken, Tom]

I was a little surprised that no one reported using NFS over RDMA on an IB network.
I believe it is included in the distros now and more stable than several years ago.
Has anyone tried it and gave up?

-Tom

From: Beowulf [mailto:beowulf-bounces at beowulf.org] On Behalf Of Scott Atchley
Sent: Friday, July 22, 2016 4:48 AM
To: Christopher Samuel
Cc: Beowulf Mailing List
Subject: Re: [Beowulf] NFS HPC survey results.

Did you mean IB over Ethernet (IBoE)? I thought IB over IP has been around long before RoCE.

On Thu, Jul 21, 2016 at 7:34 PM, Christopher Samuel <samuel at unimelb.edu.au<mailto:samuel at unimelb.edu.au>> wrote:
Thanks so much Bill, very much appreciated!

On 21/07/16 09:19, Bill Broadley wrote:

> 15) If IB what transport (10 responses)
>     100% IPoIB
>        0% Other

I learnt of one group yesterday who have recently started using NFS over
RDMA over "IB over IP" (what used to be called RoCE) on 100gigE Mellanox
gear.  It's too early to know how stable it is but they do report much
improved performance, especially with latency.

All the best,
Chris
--
 Christopher Samuel        Senior Systems Administrator
 VLSCI - Victorian Life Sciences Computation Initiative
 Email: samuel at unimelb.edu.au<mailto:samuel at unimelb.edu.au> Phone: +61 (0)3 903 55545<tel:%2B61%20%280%293%20903%2055545>
 http://www.vlsci.org.au/      http://twitter.com/vlsci
_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org<mailto:Beowulf at beowulf.org> sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.beowulf.org/pipermail/beowulf/attachments/20160723/e4b364cb/attachment.html>