FreeBSD hangs during boot when assigned a controller via vt-d

[Robert Sevat]

Greetings,

I have a problem with forwarding an LSI 2308 via vt-d in KVM to a FreeBSD virtual machine. FreeBSD (9.2 and 10.0 beta 3) will 

hang during the boot.

Hardware Setup:

Supermicro X10SL7-F with LSI 2308 flashed to IT mode
8x4 GB ecc ram
Haswell Xeon E3-1230V3

Software Setup:
Ubuntu 12.04.3 LTS 64 bit + latest KVM version.

uname -a
Linux Secretum 3.8.0-33-generic #48~precise1-Ubuntu SMP Thu Oct 24 16:28:06 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

dpkg --list | grep kvm 
ii  kvm          1:84+dfsg-0ubuntu16+1.0+noroms+0ubuntu14.12 dummy transitional package from kvm to qemu-kvm
ii  kvm-ipxe     1.0.0+git-3.55f6c88-0ubuntu1                PXE ROM's for KVM
ii  qemu-kvm     1.0+noroms-0ubuntu14.12                     Full virtualization on i386 and amd64 hardware



Under KVM I have the following 3 virtual machines installed, I have tried forwarding the LSI 2308 to all three virtual machines. 

It works perfectly under Ubuntu, but both FreeBSD vms will hang during the boot.

FreeBSD 9.2
FreeBSD 10.0 beta 3
FreeBSD 10.0 live cd
Ubuntu 12.04 LTS

If I run FreeBSD 10.0 beta 3 directly on the hardware, it does recognize the raid controller and it'll use the mps0 driver. 

Everything works fine then.

So the problem is that for some reason FreeBSD hangs during boot if you forward the LSI 2308 via vt-d, and I have no idea why.

It will hang and give the following error:

http://i.imgur.com/hAMxwR7.png
http://i.imgur.com/rKALeXZ.png

While doing so the FreeBSD virtual machine uses 300% cpu, so it maxes out 3 cores. And it will stay like that.

After googling a bit some people suggested turning off msi / msix in the loader.conf

hw.pci.enable_msi="0"
hw.pci.enable_msix="0"

I have tried this on both freebsd virtual machines, it makes no difference. It still hangs.

Could somebody point me in the right direction of what I could still try? Should I submit this as a bug? Should I ask this on another mailing list?

Kind Regards

Robert Sevat