Poor performance on Intel P3600 NVME driver

[Mihai Vintila]

I've tried to increase it and obtained around 90k iops for write, but 
now i only get :

nvme0: WRITE sqid:6 cid:125 nsid:1 lba:3907028496 len:16
nvme0: WRITE FAULTS (02/80) sqid:6 cid:125 cdw0:0
nvme0: async event occurred (log page id=0x1)
nvme0: WRITE sqid:6 cid:126 nsid:1 lba:528 len:16
nvme0: WRITE FAULTS (02/80) sqid:6 cid:126 cdw0:0
nvme0: async event occurred (log page id=0x1)
nvme0: WRITE sqid:6 cid:127 nsid:1 lba:3907027984 len:16
nvme0: WRITE FAULTS (02/80) sqid:6 cid:127 cdw0:0
nvme0: async event occurred (log page id=0x1)

Best regards,
Vintila Mihai Alexandru

On 1/15/2015 7:59 PM, Slawa Olhovchenkov wrote:
> On Thu, Jan 15, 2015 at 07:22:49PM +0200, Mihai Vintila wrote:
>
>> /etc/sysctl.conf
>>
>> net.inet.tcp.fast_finwait2_recycle=1
>> net.inet.ip.portrange.randomized=0
>> net.inet.ip.portrange.first=1024
>> net.inet.ip.portrange.last=65535
>> net.inet.tcp.recvbuf_max=16777216
>> net.inet.tcp.sendbuf_max=16777216
>> net.inet.tcp.recvbuf_inc=65536
>> vfs.zfs.vdev.trim_on_init=0
>> #close time_wait connections at 2*7500ms
>> net.inet.tcp.msl=7500
>> kern.ipc.somaxconn=4096
>> net.inet.icmp.icmplim=2000
>>
>> #zfs
>> vfs.zfs.txg.timeout=5
>> vfs.zfs.prefetch_disable=1
>
>> Any help to bring this device to proper speed will be welcomed.
> Do you try to increase vfs.zfs.top_maxinflight?