bhyve PCIe passthrough on AMD Epyc

[Ka Ho Ng]

On 3/1/19 2:30 am, toasty at dragondata.com (Kevin Day) wrote:
>> On Feb 28, 2019, at 12:28 PM, Anish <akgupt3 at gmail.com> wrote:
>>
>> Hi Kevin,
>>> I'm just pointing out that it's an AMD Epyc because I know the AMD IOMMU/AMD-Vi code was added somewhat more recently than Intel's and is maybe less tested.
>> I tested on Ryzen-I, not sure if anyone tried it on newer Ryzen/Epyc systems.
>>
>>> CPU0: local APIC error 0x40
>> This is concerning, as per AMD docs, bit6 is for illegal vector which indicate CPU is getting invalid interrupts.
>>
>> Can you share hw.vmm sysctl output?
>>
>> -Anish
> 
> Sure:
> 
> hw.vmm.amdvi.domain_id: 4
> hw.vmm.amdvi.disable_io_fault: 0
> hw.vmm.amdvi.ptp_level: 4
> hw.vmm.amdvi.host_ptp: 1
> hw.vmm.amdvi.enable: 1

Could you try https://reviews.freebsd.org/D28945 and
https://reviews.freebsd.org/D28984 ?

Ka Ho