AHCI SATA controller timeouts

[Paul Esson]

Hi Folks,

I have a bhyve FreeBSD guest 11.2-RELEASE running on a FreeBSD host 11.2-RELEASE that is experiencing issues with a zvol presented from the host as a BHYVE SATA DISK and used by the guest to create a zpool.  I used the ahci-hd block driver because it supported TRIM and I did not have the virtio-scsi driver available.

Anyway, I have this configuration running on a number of Dell PowerEdge R730xd servers without issue, but we recently purchased a next generation R740xd model and suddenly when I am generating lots of writes to the guest zpool via a zfs send/receive I see the following timeout messages causing the i/o to terminate.

I've noted some online conversation around examples in a physical hardware context but not virtual and wondered if anyone had seen anything similar?

Nov 20 10:54:45 dc2-olbp-sn-15b kernel: ahcich6: Timeout on slot 14 port 0
Nov 20 10:54:52 dc2-olbp-sn-15b kernel: ahcich6: is 00000008 cs 00000000 ss 00000000 rs 00006000 tfd 50 serr 00000000 cmd 0001ce17
Nov 20 10:54:52 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): SEND_FPDMA_QUEUED DATA SET MANAGEMENT. ACB: 64 01 00 00 00 40 00 00 00 00 00 00
Nov 20 10:54:52 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): CAM status: Command timeout
Nov 20 10:54:52 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): Retrying command
Nov 21 15:12:09 dc2-olbp-sn-15b kernel: ahcich6: Timeout on slot 24 port 0
Nov 21 15:12:09 dc2-olbp-sn-15b kernel: ahcich6: is 00000000 cs 00000000 ss 03000000 rs 03000000 tfd 50 serr 00000000 cmd 0001d917
Nov 21 15:12:09 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 b0 50 b5 40 22 00 00 01 00 00
Nov 21 15:12:09 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): CAM status: Command timeout
Nov 21 15:12:09 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): Retrying command

Regards,

Paul Esson  |  Redstor Limited
t  +44 (0)118 951 5235  |   m  +44 (0)776 690 6514
e  paul.esson at redstor.com<mailto:paul.esson at redstor.com>
www.redstor.com<http://www.redstor.com/>
[http://partners.redstor.com/files/redstor_email_signatures_linkedin_icon_padding.png]<https://www.linkedin.com/company/50079>[http://partners.redstor.com/files/redstor_email_signatures_twitter_icon_padding.png]<https://twitter.com/@redstor>[http://partners.redstor.com/files/redstor_email_signatures_facebook_icon_padding.png]<https://www.facebook.com/Redstor/>[http://partners.redstor.com/files/redstor_email_signatures_youtube_icon_padding.png]<https://www.youtube.com/user/RedstorVideo>
[http://partners.redstor.com/files/NEW_logo_larger.png]<http://www.redstor.com/>