FBSD to FBSD NFS Mounts over IB.

Janky Jay, III jankyj at unfs.us
Thu May 15 20:34:10 UTC 2014


On 05/15/2014 11:22 AM, Janky Jay, III wrote:
> Hello Karl,
>
> On 05/15/2014 10:50 AM, Karl Pielorz wrote:
>>
>>
>> --On 15 May 2014 08:50:25 -0600 "Janky Jay, III" <jankyj at unfs.us> wrote:
>>
>>>     I have set up one of the FBSD systems to run OpenSM and also be an
>>> NFS
>>> server which all the systems seem to be able to mount over the IB
>>> devices
>>> without any issue at all. Small reads and writes to and from the NFS
>>> server to all the other nodes also seems to work without any issue.
>>> However, if I try to dump large amounts of data using "dd" (in order to
>>> test speeds and stability), the FBSD NFS client craps out immediately. I
>>> just get the following message(s) over and over:
>>>
>>> newnfs server 10.11.1.1:/data: not responding
>>> newnfs server 10.11.1.1:/data: not responding
>>
>> Can both sides 'ping' each other when this happens?
>>
>
>      I just tested this while node2 was hanging with another NFS
> transfer (just a "cp /home/file /data/file") and both nodes (1 and 2)
> can ping each other without any issues.
>
	Quick update: I rebuild the kernel without the IPOIB_CM to get rid of
connected mode and everything seems to be working fine now. Hopefully this
will turn out to be as stable as I need and we can use ZFS for cluster 
storage. Thanks again for the replies and help, Karl!

Regards,
Janky Jay, III





More information about the freebsd-infiniband mailing list