From nobody Sat Dec 07 22:38:57 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5NN34g8Gz5gKCy for ; Sat, 07 Dec 2024 22:39:15 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5NN24cGgz4P4M for ; Sat, 7 Dec 2024 22:39:14 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.18.1/8.18.1) with ESMTPS id 4B7McwEb005245 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Sat, 7 Dec 2024 17:38:58 -0500 (EST) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:1dd9:4f60:be7e:ab1] ([IPv6:2607:f3e0:0:4:1dd9:4f60:be7e:ab1]) by pyroxene2a.sentex.ca (8.18.1/8.15.2) with ESMTPS id 4B7McuQU064306 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Sat, 7 Dec 2024 17:38:57 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: Date: Sat, 7 Dec 2024 17:38:57 -0500 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Tap device problem on FreeBSD 14.2-RELEASE To: Thomas Laus , freebsd-virtualization@freebsd.org References: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> Content-Language: en-US From: mike tancsa Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.86 X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Queue-Id: 4Y5NN24cGgz4P4M X-Spamd-Bar: ---- On 12/7/2024 4:37 PM, Thomas Laus wrote: > I used FreeBSD-update to go from 14.1-RELEASE to 14.2-RELEASE and > there is an issue with creating and using the tap device.  The device > doesn't get created during the boot process and can't be created or > used after the system is up.  The UPDATING file has just one entry > concerning the tap device and that is change the 'tap' name in all > configuration files with 'tuntap'. I did that and get an invalid > device reply.  I installed the latest package for vm-bhyve which did > not make any difference.  I also deleted /usr/obj/* and checked out a > fresh /usr/src and rebuilt FreeBSD-14.2-RELEASE from source without > anything working differently. > > If anyone has a working tap device using FreeBSD 14.2-RELEASE, I would > appreciate you sharing your bhyve portions of /etc/rc.conf, > /etc/sysctl.conf and /boot/loader.conf files. > I dont have anything unusual in my config. I am running just a few days ahead of 14.2, but I dont think that makes a difference  kldstat Id Refs Address                Size Name  1   47 0xffffffff80200000  1f3d9c0 kernel  2    1 0xffffffff8213f000   5da658 zfs.ko  3    1 0xffffffff8271a000     36c8 coretemp.ko  4    2 0xffffffff8271e000    8dae8 pf.ko  5    1 0xffffffff827ac000     77d8 cryptodev.ko  6    1 0xffffffff827b4000     3c58 pflog.ko  7    1 0xffffffff83c20000     3390 acpi_wmi.ko  8    1 0xffffffff83c24000     4250 ichsmb.ko  9    1 0xffffffff83c29000     2178 smbus.ko 10    1 0xffffffff83c2c000     7798 if_bridge.ko 11    1 0xffffffff83c34000     60e0 bridgestp.ko 12    1 0xffffffff83c3b000     33c0 uchcom.ko 13    1 0xffffffff83c3f000     4e10 ucom.ko 14    1 0xffffffff83e00000   33e438 vmm.ko 15    1 0xffffffff83c44000     4850 nullfs.ko Starting up a vm works as before for me  vmrun.sh -t tap0 -d /baseimage/14-1VM-p6.raw -E  vm0 Launching virtual machine "vm0" ... fbuf frame buffer base: 0x2be256a00000 [sz 16777216] 3h 3h 3h BdsDxe: loading Boot0001 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x3,0x0) BdsDxe: starting Boot0001 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x3,0x0) Consoles: EFI console     Reading loader env vars from /efi/freebsd/loader.env Setting currdev to disk0p2: FreeBSD/amd64 EFI loader, Revision 1.1    Command line arguments: loader.efi    Image base: 0x1e27a000    EFI version: 2.70    EFI Firmware: BHYVE (rev 1.00)    Console: efi (0x20001000)    Load Path: \EFI\BOOT\BOOTX64.EFI    Load Device: PciRoot(0x0)/Pci(0x3,0x0)/HD(2,GPT,E140336F-1F4D-11EF-AE18-002590EC5BF2,0x17B,0x10418)    BootCurrent: 0001    BootOrder: 0000 0001[*] 0002 0003 0004    BootInfo Path: PciRoot(0x0)/Pci(0x3,0x0) Ignoring Boot0001: Only one DP found Trying ESP: PciRoot(0x0)/Pci(0x3,0x0)/HD(2,GPT,E140336F-1F4D-11EF-AE18-002590EC5BF2,0x17B,0x10418) Setting currdev to disk0p2: Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(1,GPT,E1403365-1F4D-11EF-AE18-002590EC5BF2,0x22,0x159) Setting currdev to disk0p1: Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(3,GPT,E1403374-1F4D-11EF-AE18-002590EC5BF2,0x10593,0x200000) Setting currdev to disk0p3: Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(4,GPT,E1403378-1F4D-11EF-AE18-002590EC5BF2,0x210593,0x11FFF6D) Setting currdev to zfs:zroot/ROOT/default: - Loading /boot/defaults/loader.conf Loading /boot/defaults/loader.conf Loading /boot/device.hints Loading /boot/loader.conf Loading /boot/loader.conf.local ?c\ |  ______               ____   _____ _____   |  ____|             |  _ \ / ____|  __ \   | |___ _ __ ___  ___ | |_) | (___ | |  | |   |  ___| '__/ _ \/ _ \|  _ < \___ \| |  | |   | |   | | |  __/  __/| |_) |____) | |__| |   | |   | | |    |    ||     |      |      | . . . root@freebsd:~ # ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8): 56 data bytes 64 bytes from 8.8.8.8: icmp_seq=0 ttl=114 time=28.173 ms ^C --- 8.8.8.8 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 28.173/28.173/28.173/0.000 ms root@freebsd:~ # shutdown -p now Shutdown NOW! ... The bridge to tap0 works as expected. It gets auto created for me I can create new ones too # ifconfig tap1 create # ifconfig tap1 tap1: flags=8802 metric 0 mtu 1500         options=4080000         ether 58:9c:fc:10:63:02         groups: tap         media: Ethernet 1000baseT         status: no carrier         nd6 options=29 On an actually 14.2R box, if I add to rc.conf cloned_interfaces="bridge0 tap0" it gets created at boot % ifconfig tap0 tap0: flags=8802 metric 0 mtu 1500         options=80000         ether 58:9c:fc:10:ff:ed         groups: tap         media: Ethernet 1000baseT         status: no carrier         nd6 options=29