From nobody Mon Nov 16 09:10:45 2026 X-Original-To: dev-commits-src-all@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4jShsx5Jbsz71Zml for ; Mon, 16 Nov 2026 09:10:45 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4jShsx4cyHz4RmK for ; Mon, 16 Nov 2026 09:10:45 +0000 (UTC) (envelope-from git@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1794820245; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=qOM3fXMlK40yXKYjKIX5hy6MOZTd0r25WOASC01bp5E=; b=V+1lWsOsm2ogBaVEAfuxlXBHZjh/NGv2Srh6yPZAmFR78hBFxGzn8townl6psQbgebJBDE Lcv4762T76yBkHkqt3lcYOI6dZ+09S2EVM92E5fGZfyDL9VU3ce4eTxWsFciwuw7H0jXWm st2dZTRyBkWq9qj7ubZvgJyu6zT/CBsgQ+Zprerut/TOYVWOFaC62FBVuU5gar9wluzBGA TjAzcZ5eOmhQ/zUzNRlTGNzuIvQZvtt7CVW0FdCY9SxqBtLIpQ3duAECGPJmQtLQDE0NU2 xO4uk6vE4ll5rpvrUX3LwW1TkYK/sGEQhO5NnK+5GofWTkS+JAX6xt/ySo46GA== ARC-Seal: i=1; a=rsa-sha256; d=freebsd.org; s=dkim; cv=none; t=1794820245; b=gqhD36b17omTar0u5FzYhOr4UoV47cW2XQ+HZxM6s46ARUBV0ytQB9fpWPSkEFdk/NdKkU Hb/T37mWtSB6lJ/XJIq/lAWvPu+1MmBo+WHbwdUx+Z6hWMzPy2NAFTYcNu6aY7gsz9tZaw XqazVo8gLELDgulnU8LB6ahX6E0JkL12wQ6Kl/2EC41LM/a5LaSIW2RWjtnwjCMFLSOUuB jgP3uoVbKX/b0lh27pxoKYpk40PoA5Q7ovZeViowW7JQd5FXkCo17uIohRPilkmuV0tHe7 YitKaKdFvhi9CwZnSLG8yzyTyp5WGNaEphEnnnhK2xah1qH4ob945t3z6S4GbA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1794820245; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=qOM3fXMlK40yXKYjKIX5hy6MOZTd0r25WOASC01bp5E=; b=ZhCx9p38YbzefRPhL3HndQD09Vy5kMxmyoMV2DIsSl77ihcSID0aqYP//OpcqUbFQBdAee V935/1RuK4/WPkEmGONEm7SPVkqYCe1S9OPbW/0Tv1VwmHVfthIJuTe8BARLovtopJs71U 29nPpJ092bIbEk7iZOSxaseExigDS9sag+f9xT3l7YxlI6GAt0cpa3TIWYFHdNL8hcBlBg Gmg4sxVnQ4kNjRyG5oAoM9bqpI3DWCR1LWtytgIldUgZDAbpR0xlhgYqXVRfY9Tnni5tGX VWFJMjvF5y3YREK6QKTYWzNzbTi4V2kJXvcWwEub5Q71oReZ4ZfIBmgV+sSN+g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from gitrepo.freebsd.org (gitrepo.freebsd.org [IPv6:2610:1c1:1:6068::e6a:5]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 4jShsx4H2dznpH for ; Mon, 16 Nov 2026 09:10:45 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from git (uid 1279) (envelope-from git@FreeBSD.org) id 639d by gitrepo.freebsd.org (DragonFly Mail Agent v0.13+ on gitrepo.freebsd.org); Mon, 16 Nov 2026 09:10:45 +0000 To: src-committers@FreeBSD.org, dev-commits-src-all@FreeBSD.org, dev-commits-src-branches@FreeBSD.org From: Piotr Kubaj Subject: git: 870e5b895050 - stable/14 - powerpc/pmap: Use dcbz to zero pages in the radix pmap List-Archive: https://lists.freebsd.org/archives/dev-commits-src-all X-BeenThere: dev-commits-src-all@freebsd.org List-Id: Commit messages for all branches of the src repository List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Git-Committer: pkubaj X-Git-Repository: src X-Git-Refname: refs/heads/stable/14 X-Git-Reftype: branch X-Git-Commit: 870e5b895050bc8842c74cea933466bcd9e2040c Auto-Submitted: auto-generated Date: Mon, 16 Nov 2026 09:10:45 +0000 Message-Id: <6afac895.639d.5dc65f6f@gitrepo.freebsd.org> The branch stable/14 has been updated by pkubaj: URL: https://cgit.FreeBSD.org/src/commit/?id=870e5b895050bc8842c74cea933466bcd9e2040c commit 870e5b895050bc8842c74cea933466bcd9e2040c Author: Piotr Kubaj AuthorDate: 2026-09-08 11:22:58 +0000 Commit: Piotr Kubaj CommitDate: 2026-11-16 08:47:58 +0000 powerpc/pmap: Use dcbz to zero pages in the radix pmap pagezero() was a plain store loop (bzero), which under the kernel build flags (-mno-vsx -msoft-float) compiles to byte stores. dcbz establishes a zeroed cache line directly in the cache without a read-for-ownership fetch from memory, roughly halving the memory transactions of page zeroing. Measured on POWER9 (Raptor Blackbird, DD2.3, bare metal), zeroing a cold 256 MB buffer with 128-byte scalar loops: byte stores (current libkern memset) 8.6 GB/s doubleword (std) stores 26.8 GB/s dcbz 34.6 GB/s dcbz raises an alignment interrupt on caching-inhibited mappings, and the kernel does not emulate it, so mmu_radix_zero_page() falls back to bzero() for any page whose memattr is not the write-back default. The internal pagezero() callers only touch freshly allocated page-table pages, which are always write-back. Note: dcbz helps only zeroing, where there is no source to read. For page copying it is a pessimization (it adds a redundant zeroing pass on top of the mandatory source read), so mmu_radix_copy_page() is left as a plain bcopy(). Differential Revision: https://reviews.freebsd.org/D59507 Reviewed by: jhibbits (cherry picked from commit 1d4a00d455617e150da5a7c3076579a7e612d33d) --- sys/powerpc/aim/mmu_radix.c | 19 ++++++++++++++++--- 1 file changed, 16 insertions(+), 3 deletions(-) diff --git a/sys/powerpc/aim/mmu_radix.c b/sys/powerpc/aim/mmu_radix.c index a02c4101de77..bedbda607039 100644 --- a/sys/powerpc/aim/mmu_radix.c +++ b/sys/powerpc/aim/mmu_radix.c @@ -890,12 +890,22 @@ pmap_resident_count_dec(pmap_t pmap, int count) pmap->pm_stats.resident_count -= count; } +/* + * dcbz establishes a zeroed cache line without fetching it from memory, + * but raises an alignment interrupt on caching-inhibited mappings, so it + * may only be used on write-back memory. The internal callers only zero + * freshly allocated page table pages, which are always write-back; the + * vm_page facing entry point guards on the page's memattr. + */ static void pagezero(vm_offset_t va) { - va = trunc_page(va); + vm_offset_t off; - bzero((void *)va, PAGE_SIZE); + va = trunc_page(va); + for (off = 0; off < PAGE_SIZE; off += cacheline_size) + __asm __volatile("dcbz 0,%0" :: + "r"(va + off) : "memory"); } static uint64_t @@ -5759,7 +5769,10 @@ mmu_radix_zero_page(vm_page_t m) CTR2(KTR_PMAP, "%s(%p)", __func__, m); addr = PHYS_TO_DMAP(VM_PAGE_TO_PHYS(m)); - pagezero(addr); + if (__predict_true(m->md.mdpg_cache_attrs == VM_MEMATTR_DEFAULT)) + pagezero(addr); + else + bzero((void *)addr, PAGE_SIZE); } void