From nobody Tue Dec 20 14:26:32 2022 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NbzQx0Kr9z1HGmK for ; Tue, 20 Dec 2022 14:26:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NbzQw5HTNz4Kb0 for ; Tue, 20 Dec 2022 14:26:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671546392; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=B9Kuc6FGKCvdMtOTyvG+T8S6yftrNGuIyKl86Zfwsk0=; b=SDZBbmVoJylJmp+LSAZ3V/t3jI0p+mif3pxK0izfOY19TIY/sdZIXJx+QG8SNsMZ9g3z7U CSMdxlZGxmS69i549g121dLZ+huEYZVH7A8VBU/ZUcaTKI5d0KtA3vQCF9VHc2o6kXJexA Z4gfIn2JkZDkGOFYqyfP+151DImyyIFlwiA/zC2DYc3JE7n6Uqp+cm3q2cSfw/fzVAP1h9 OoFcJhOnM7Ao86I5dFePFHsXS6fhmwiz0au/QDUTFPy/zKe33BafUsU94f2t3rujNY0x7g MVvd71mdMlY4B8ZPsj7KjJRx2g21VvYTxW+M3uQon8SxQ1QyiHKrNeHg+dGDcA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671546392; a=rsa-sha256; cv=none; b=eYo6Y6phAUB40fCQqO/D8N3xqfI7av3QoVFofe7GIfY4St7lixJaCNyZg5Wlf951pWmnEn P/AEmvYD+tRZH/qr3uPnlfOO+2/mPkPknLNAw7+CCQKJ7S5jHX9pOga73RiATONeexAc7u NshC7K9tA/Irx1543RipdkWfqxLaoHXEHNmW7MMXzreP0yHgooQN3BLadvCyDQlwj7mxpf Nk21etwWdeI/9h6leUu20Fwk4hfa1LnmxjFCecG+KuavvSVzJO8dTdF03XUA+iWKduuB95 c5ySYocB/m8s4RqQfRrh/yK2Xl4LgebNQiBZpm6UXtean3tLyPugduM6A28Naw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NbzQw4HKBzdNt for ; Tue, 20 Dec 2022 14:26:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BKEQW1Y085236 for ; Tue, 20 Dec 2022 14:26:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BKEQWuV085235 for bugs@FreeBSD.org; Tue, 20 Dec 2022 14:26:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 268486] panic: vtd_add_device: device 0 is not in scope for any DMA remapping unit Date: Tue, 20 Dec 2022 14:26:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: pkubaj@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268486 Bug ID: 268486 Summary: panic: vtd_add_device: device 0 is not in scope for any DMA remapping unit Product: Base System Version: 13.1-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: pkubaj@FreeBSD.org I'm on FreeBSD 13.1-RELEASE-p5 on amd64. My kernel configuration is: include GENERIC options DDB # required to enable dumps options KDB_UNATTENDED # required to enable dumps options INVARIANTS options INVARIANT_SUPPORT nodevice em nodevice ixl nodevice iavf nodevice ice nodevice ix I have two Dell R750, one with Intel X722 adapter and another with Intel X7= 10 (both use ixl driver on FreeBSD). After unloading the driver, I'm trying to passthrough them to the VM. /boot/loader.conf: vmm_load=3D"YES" pptdevs=3D"179/0/0" pciconf -lv: ppt0@pci0:179:0:0: class=3D0x020000 rev=3D0x04 hdr=3D0x00 vendor=3D0x8= 086 device=3D0x37d0 subvendor=3D0x8086 subdevice=3D0x0002 vendor =3D 'Intel Corporation' device =3D 'Ethernet Connection X722 for 10GbE SFP+' class =3D network subclass =3D ethernet I can start VM just fine (with FreeBSD 12.4-RELEASE), however, when I try starting with the passthrough, I get the following panic on the host: panic: vtd_add_device: device 0 is not in scope for any DMA remapping unit Backtrace is: __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(stru= ct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3Dtextdump@entry=3D0) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff804b131a in db_dump (dummy=3D, dummy2=3D, dummy3=3D, dummy4=3D) at /usr/src/sys/ddb/db_command.c:575 #3 0xffffffff804b11d2 in db_command (last_cmdp=3D, cmd_table=3D, dopager=3Ddopager@entry=3D1) at /usr/src/sys/ddb/db_command.c:482 #4 0xffffffff804b0e2d in db_command_loop () at /usr/src/sys/ddb/db_command.c:535 #5 0xffffffff804b42a6 in db_trap (type=3D, code=3D) at /usr/src/sys/ddb/db_main.c:270 #6 0xffffffff80c20c56 in kdb_trap (type=3Dtype@entry=3D3, code=3Dcode@entr= y=3D0, tf=3Dtf@entry=3D0xfffffe019a333820) at /usr/src/sys/kern/subr_kdb.c:733 #7 0xffffffff810997b9 in trap (frame=3D0xfffffe019a333820) at /usr/src/sys/amd64/amd64/trap.c:607 #8 #9 kdb_enter (why=3D0xffffffff8122185d "panic", msg=3D) at /usr/src/sys/kern/subr_kdb.c:506 #10 0xffffffff80bd37a0 in vpanic ( fmt=3D0xffffffff8215136a "vtd_add_device: device %x is not in scope for= any DMA remapping unit", ap=3Dap@entry=3D0xfffffe019a333980) at /usr/src/sys/kern/kern_shutdown.c:908 #11 0xffffffff80bd3533 in panic ( fmt=3D0xffffffff8190aa70 "\310\320\022\201\377\377\377\377\n") at /usr/src/sys/kern/kern_shutdown.c:= 844 #12 0xffffffff82147bc9 in vtd_add_device (arg=3D, rid=3D0) at /usr/src/sys/amd64/vmm/intel/vtd.c:461 #13 0xffffffff821350fe in IOMMU_ADD_DEVICE (domain=3D, rid= =3D128) at /usr/src/sys/amd64/vmm/io/iommu.c:125 #14 iommu_add_device (dom=3D, rid=3D128) at /usr/src/sys/amd64/vmm/io/iommu.c:327 #15 iommu_init () at /usr/src/sys/amd64/vmm/io/iommu.c:238 #16 iommu_create_domain (maxaddr=3D268435456) at /usr/src/sys/amd64/vmm/io/iommu.c:271 #17 0xffffffff8212a927 in vm_assign_pptdev (vm=3D0xfffffe006e7eb000, bus=3D= 177, slot=3D0, func=3D0) at /usr/src/sys/amd64/vmm/vmm.c:988 #18 0xffffffff8212f1aa in vmmdev_ioctl (cdev=3D, cmd=3D21483= 00328, data=3D0xfffffe019a333d50 "\261", fflag=3D, td=3D) at /usr/src/sys/amd64/vmm/vmm_dev.c:545 #19 0xffffffff80a6a8cc in devfs_ioctl (ap=3D0xfffffe019a333ba8) at /usr/src/sys/fs/devfs/devfs_vnops.c:944 #20 0xffffffff80cd0041 in vn_ioctl (fp=3D0xfffff8000b47e2d0, com=3D, data=3D0xfffffe019a333d50, active_cred=3D0xfffff8000bbf6d00, td=3D0x0) at /usr/src/sys/kern/vfs_vnops.c:1696 #21 0xffffffff80a6afae in devfs_ioctl_f ( fp=3D0xffffffff8190aa70 , com=3D128, data=3D0xffffffff811ed308, cred=3D0x1, td=3D0xfffffe01652bf720) at /usr/src/sys/fs/devfs/devfs_vnops.c:875 #22 0xffffffff80c44242 in fo_ioctl (fp=3D, com=3D2148300328, data=3D0x20, active_cred=3D0x1, td=3D0xfffffe01652bf720) at /usr/src/sys/sys/file.h:361 #23 kern_ioctl (td=3D, td@entry=3D0xfffffe01652bf720, fd=3D, com=3Dcom@entry=3D2148300328, data=3D0x20 , data@entry=3D0xfffffe019a333d50 "\261") at /usr/src/sys/kern/sys_generic.c:803 #24 0xffffffff80c43f96 in sys_ioctl (td=3D0xfffffe01652bf720, uap=3D0xfffffe01652bfb08) at /usr/src/sys/kern/sys_generic.c:711 #25 0xffffffff8109a53e in syscallenter (td=3D) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189 #26 amd64_syscall (td=3D0xfffffe01652bf720, traced=3D0) at /usr/src/sys/amd64/amd64/trap.c:1185 #27 #28 0x0000000801619c2a in ?? () --=20 You are receiving this mail because: You are the assignee for the bug.=