From nobody Sat Nov 08 16:35:13 2025 X-Original-To: x11@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4d3hNx6qdcz6GFBx for ; Sat, 08 Nov 2025 16:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R12" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4d3hNx6CMxz3ZDJ for ; Sat, 08 Nov 2025 16:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1762619713; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/STC2t9JUpG5Mg4GyqNNj5qILncfZf3QlmZkJAFfojc=; b=AAXjk6gQXQNXRUfu+54FbJC69IXyYV+Y1osc41s89n5ZjM4paRMcT4dKDleB94DTzhxPGi vsIqtPBrh1GoqB5aiFGAFFQUa1CYQ6In81un9EbPlEo5psgc6NsWpPl8lIhI7Uj3QHV5Mz AHt2CbBimKpqc3DZIebxhf6n7/RRloi45bPe2BYHRhUq6jlBHBM6fmudS440rIBPPszZgS 9WFahvutz5kzeso3D3GsP/G+KELHFZuQWHNHPLlcow63yfyTzQzzCGSKrqA9J+chdoRuio vrBY4OlUh/pXNmezWD9F1Pl3//2LPPQE5rhemxVkU0cW8j1cOGeCTzQEssK96g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1762619713; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/STC2t9JUpG5Mg4GyqNNj5qILncfZf3QlmZkJAFfojc=; b=xjZRmNrv49DOcHwgXQ+/8hksV4rVFMQcN97CW+gToHS2iUwjeBdmrJCuZBD1TRCRdVGfSy owHN2331KXdiTpYQG0dbBjeTJ0aon+Q/PViS1GZjhB5BEP37GrzrSxsk6FKX+bs6ENS0er Xe655LlHMuLJHN3vNBFPB+yYkdT5rl95vJUnP6kA3d2+uvX4E4a3ZTuRXRTz3kVQO+rBPZ URNUrQ0myYUdQARb5iAGMmyCLtC/JjyZChsATK1P2avCstF1XHfmrYJxKlCnbBP9CNO0Dd NcluiuJtbkQkDj4FLetRjFIdSu7EtYVk9n7PFk4XsXUUmcT/PWEODe/UplOmmA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1762619713; a=rsa-sha256; cv=none; b=xWe+ACYA26+ZVTUjlT/VM4dl8Yu84cTTbB+1eZqkNbWKKT7IAKl25GVDl4ea7e2ktscPVg IomVf/N2K+fWcKXPkT+leoWSSmGEEVpczrY6HH3WpKbne5gWBRpNZ+5QMUgmZ3qFbZ5qj/ 01yYwV8TZWcEZd+NYZnRzbNUqE4VwFLJFKVNCwMSTY7A6cuw3mQXT9HnlvWvMh/fTjKlfN fJ4HA+ZTdZQspHuSTN7++tIO2MgaDjzziGeNoY7PokRVNWjftSbi8VFBnLRRz/lsNzRk+s 5ltlXGbi8bVLX4QtVJ5j2LzlmTTtYKJ/fqSLnj/VVLCOHigqsyonFz8RS+eoTQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4d3hNx5XZfzswG for ; Sat, 08 Nov 2025 16:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 5A8GZDdG026728 for ; Sat, 8 Nov 2025 16:35:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 5A8GZD1L026726 for x11@FreeBSD.org; Sat, 8 Nov 2025 16:35:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: x11@FreeBSD.org Subject: [Bug 287453] x11/nvidia-driver: Vulkan and OpenGL are broken on RTX 5000 series Date: Sat, 08 Nov 2025 16:35:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: scf@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: x11@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: X11 List-Archive: https://lists.freebsd.org/archives/freebsd-x11 List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-x11@freebsd.org Sender: owner-freebsd-x11@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287453 --- Comment #29 from Sean Farley --- (In reply to Tomasz "CeDeROM" CEDRO from comment #28) Actually, llama.cpp uses Vulkan successfully without needing CUDA: ggml_vulkan: Found 1 Vulkan devices: ggml_vulkan: 0 =3D NVIDIA GeForce RTX 4070 (NVIDIA) | uma: 0 | fp16: 1 | bf= 16: 1 | warp size: 32 | shared memory: 49152 | int dot: 1 | matrix cores: NV_coop= mat2 build: 6795 (unknown) with FreeBSD clang version 19.1.7 (https://github.com/llvm/llvm-project.git llvmorg-19.1.7-0-gcd708029e0b2) f= or x86_64-unknown-freebsd14.3 system info: n_threads =3D 28, n_threads_batch =3D 28, total_threads =3D 28 llama.cpp works for me on my RTX 4070 (12GB) even though I have the same is= sue of having to restart it at least once to actually start processing requests= .=20 The first time, it will claim to be processing but never succeed. I wonder= if it is a timing issue due to a loading a large LLM. The second time it is r= un, the LLM file has a good portion cached in memory to make loading faster. The options I pass to llama.cpp: --device Vulkan0 --no-warmup --n-gpu-laye= rs 2 --threads 28 --mlock The LLM is about 46GB and takes awhile to load in a 14700K system with 128GB RAM, but longer the first time. --=20 You are receiving this mail because: You are the assignee for the bug.=