[Bug 266325] vm ivhd bhyve nic passthru completely broken in 13.1

From: <bugzilla-noreply_at_freebsd.org>
Date: Fri, 09 Sep 2022 18:46:18 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=266325

            Bug ID: 266325
           Summary: vm ivhd bhyve nic passthru completely broken in 13.1
           Product: Base System
           Version: 13.1-RELEASE
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Many People
          Priority: ---
         Component: bhyve
          Assignee: virtualization@FreeBSD.org
          Reporter: attila.kover@guardian.co.uk

Symptom:
Starting any vm with pci passthru result thousands of error messages on the
host in a couple of seconds. If I don't issue a reboot command very soon then
the host completely freezes, only hard reboot helps.

 Hardware:
CPU: AMD FX(tm)-6300 Six-Core Processor
Motherboard: M5A99X EVO R2.0
NICs: Intel 82580 (HP NC365T)
      Intel I350-T4 (CISCO 74-10521-01)
      Broadcom BCM5720 (HP 332T)

 OS:
Host OS: FreeBSD 13.1-RELEASE-p2 (same since 13.1-RELEASE)
Guest OS: FreeBSD 13.1-RELEASE-p2

 cat /boot/loader.conf|grep ^ppt
pptdevs="2/0/3 9/0/3 7/0/1"
pptdevs2="2/0/1 2/0/2 9/0/2"
pptdevs3="9/0/1 7/0/0"


 one of the vm configs:
loader="bhyveload"
cpu=1
memory=1G
network0_type="virtio-net"
network0_switch="gyumi"
passthru0="9/0/1"
passthru1="2/0/1"
disk0_type="virtio-blk"
disk0_name="szerver-node5.img"
uuid="eef22ae1-6b38-11ec-91a4-ac162da2c818"
network0_mac="xx:xx:xx:xx:xx:xx"


 Error messages:
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 0 Status:0x1a EVT Head:0x0
Tail:0x10]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x23] Tail:0x230, Head:0x230.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x0 Tail:0x10]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 1 Status:0x1a EVT Head:0x10
Tail:0x20]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x23] Tail:0x230, Head:0x230.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x10 Tail:0x20]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 2 Status:0x1a EVT Head:0x20
Tail:0x30]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x23] Tail:0x230, Head:0x230.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x20 Tail:0x30]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 3 Status:0x1a EVT Head:0x30
Tail:0x40]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x23] Tail:0x230, Head:0x230.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x30 Tail:0x40]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 4 Status:0x1a EVT Head:0x40
Tail:0x50]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x23] Tail:0x230, Head:0x230.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x40 Tail:0x50]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 5 Status:0x1a EVT Head:0x50
Tail:0x60]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x23] Tail:0x230, Head:0x230.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x50 Tail:0x60]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 6 Status:0x1a EVT Head:0x60
Tail:0x70]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x25] Tail:0x250, Head:0x250.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x60 Tail:0x70]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 7 Status:0x1a EVT Head:0x70
Tail:0x80]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x25] Tail:0x250, Head:0x250.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x70 Tail:0x80]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 8 Status:0x1a EVT Head:0x80
Tail:0x90]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x25] Tail:0x250, Head:0x250.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x80 Tail:0x90]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 9 Status:0x1a EVT Head:0x90
Tail:0xa0]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x25] Tail:0x250, Head:0x250.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0x90 Tail:0xa0]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 10 Status:0x1a EVT Head:0xa0
Tail:0xb0]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x25] Tail:0x250, Head:0x250.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0xa0 Tail:0xb0]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]
Sep  9 16:43:19 fx kernel: ivhd0: EVT INTR 11 Status:0x1a EVT Head:0xb0
Tail:0xc0]
Sep  9 16:43:19 fx kernel:   [CMD Total 0x25] Tail:0x250, Head:0x250.
Sep  9 16:43:19 fx kernel: ivhd0:       [Event0: Head:0xb0 Tail:0xc0]
Sep  9 16:43:19 fx kernel:      [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3
tr:0]


 Workaround: freebsd-update rollback (...to an EOLd system - apologies for
calling this a workaround)

-- 
You are receiving this mail because:
You are the assignee for the bug.