[Bug 247944] nvme missing interrupt on ESXi 6.7 PCIe passthrough

[bugzilla-noreply at freebsd.org]

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=247944

            Bug ID: 247944
           Summary: nvme missing interrupt on ESXi 6.7 PCIe passthrough
           Product: Base System
           Version: 12.1-STABLE
          Hardware: i386
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: bugs at FreeBSD.org
          Reporter: freebsd at darkain.com

Created attachment 216411
  --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=216411&action=edit
missing interrupt

I'm using Intel Optane NVMe drives on a Dell R720 server running vSphere ESXi
6.7 using PCIe passthrough to FreeBSD guests. In my particular case, I'm just
trying to boot the amd64.iso installer images.


12.1-RELEASE:
crashes due to a bug in the NVMe driver that has since been fixed.


12.1-STABLE 2020-07-09 snapshot:
produces the screen shot listed below. console flooded with "nvme0: Missing
interrupt" messages and a few other error messages. Having let it run for a
length of time, the messages just cycle over and over again in that exact
pattern. Never fully boots into the FreeBSD installer.


12.1-STABLE 2020-07-09 snapshot (workaround):
pciPassthru0.msiEnabled = "FALSE"

setting that value in the .vmx file for the passthrough device allows it to
work. so there appears to be some other bug effecting MSI-X interrupts between
ESXi and FreeBSD 12.1-STABLE. I've been trying to play around with the info in
bug #203874 with no luck either way so far.


11.4-RELEASE and 11.4-STABLE 2020-07-09 snapshot:
same as 12.1-STABLE


13.0-CURRENT:
no issue at all. works exactly as expected.


Intel ARK:
https://ark.intel.com/content/www/us/en/ark/products/135581/intel-optane-memory-m10-series-16gb-m-2-80mm-pcie-3-0-20nm-3d-xpoint.html

Boot messages:
https://vincerants.com/public/freebsd/nvme-missing-interrupt.png

Workaround found at:
https://redmine.ixsystems.com/issues/26508#note-68

Possibly related:
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203874

-- 
You are receiving this mail because:
You are the assignee for the bug.