From nobody Tue Nov 17 19:51:53 2026 X-Original-To: dev-commits-src-all@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4jTb3G1PYhz71ldH for ; Tue, 17 Nov 2026 19:51:54 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4jTb3F4y3Gz3G45 for ; Tue, 17 Nov 2026 19:51:53 +0000 (UTC) (envelope-from git@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1794945113; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=YRXqjt0txkrKNsiJS14x/xVeiFN2w94BwYgZTgA0u0Y=; b=BIsld/FniFLBTkg2YmrNxB4jfeVUnqwN3x09ITvtfatJjck+aPpUT/0waBG4+1WVEgEBL2 Y/wsEeuglv6aE3mh+7Hhd2G0u34IJR+Sh5VZVW5HRhX0vHMvoGX3IGSgxN+KFOH+XeoRXI D6287ZM1Zha1/m3F0A3KnQGuAUEbJ3PtdLRoAmXebimjejvWlxhUDiS0X8g6GO18i/5aeV glXR01zLSj4SioN+PZRB0jNPrcpRiKWb08xg4Af9fCbOJfd2fNWUiBdITX87qX6pBQDK1n P1rI2BES7VFA+AAvp8Jxh6sQivmk+uH6pxpE3SoieTHh0S/lzLGosf8ofKI4eg== ARC-Seal: i=1; a=rsa-sha256; d=freebsd.org; s=dkim; cv=none; t=1794945113; b=yTZAMhkC/LcEcegWFL/RGfX+lrUGkqgC2i6rg4kyLyG+QFD6WUFRXBVxuO2VIUsSskHbBp YkWL3nvJOKSrCs9esl2fiboGxukCoksqbyVWfdWvbOWNP6tbuVuxhTfOew0JeI4f2egksk p6roJTAx47aR/Ty1mSFChNwQckMiPNJnVxUHp75JNR5iEg8fo2hBSQxzCJEQYq2Ts/Z+Yj b/+6njf72yDM5QgjfF22NJy6l2PvNVG+3a8K9JY1YzAP7WaNOQcamK3ds2OjO5CdswYjY2 EGhsNwgRM5BM+gjfHpLIu5Rt1jwttrW4LmBVkZXlpzcchl2Y7Cy7fo/ocX9KqA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1794945113; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=YRXqjt0txkrKNsiJS14x/xVeiFN2w94BwYgZTgA0u0Y=; b=AcLACdTvortgsi3nsjc+4MNEubC7U9puG3XPoQ5hTLXW9gSlGRlVBdwUV36AwjyuPp0gwC BA/P7F7xqMGsx6Sp8TbckmhWcFSGrlaUwV74MSKDt2vAuwtnrXchDx/3XvYvvig9NVewuD kfyQgdiU3LiWW1irCbYChKPo7MMBNnvn7K2v2mCgXVIoSae1h76s40nSAV2nxRCQ7bpB3Q NjEfczVuKC3m4NtgC/20btWFxsdwwoMEKpGJIxwJaeHT1Jem0gePnqJLhLwDpT8Km/w+Il 9Y4AqpmzMWkBOaiCX2bAM99WAXEJ0FBViUTqj52ZPM/qztQ3VoB5Mc+Ete4SJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from gitrepo.freebsd.org (gitrepo.freebsd.org [IPv6:2610:1c1:1:6068::e6a:5]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 4jTb3F3ly9zxSf for ; Tue, 17 Nov 2026 19:51:53 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from git (uid 1279) (envelope-from git@FreeBSD.org) id 11267 by gitrepo.freebsd.org (DragonFly Mail Agent v0.13+ on gitrepo.freebsd.org); Tue, 17 Nov 2026 19:51:53 +0000 To: src-committers@FreeBSD.org, dev-commits-src-all@FreeBSD.org, dev-commits-src-branches@FreeBSD.org Cc: Piotr Kubaj From: Colin Percival Subject: git: f7cbc4d75975 - releng/15.2 - powerpc/pmap: Use dcbz to zero pages in the radix pmap List-Archive: https://lists.freebsd.org/archives/dev-commits-src-all X-BeenThere: dev-commits-src-all@freebsd.org List-Id: Commit messages for all branches of the src repository List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Git-Committer: cperciva X-Git-Repository: src X-Git-Refname: refs/heads/releng/15.2 X-Git-Reftype: branch X-Git-Commit: f7cbc4d759756599e1e47ab0220978b41c4db94d Auto-Submitted: auto-generated Date: Tue, 17 Nov 2026 19:51:53 +0000 Message-Id: <6afcb059.11267.1c1183fd@gitrepo.freebsd.org> The branch releng/15.2 has been updated by cperciva: URL: https://cgit.FreeBSD.org/src/commit/?id=f7cbc4d759756599e1e47ab0220978b41c4db94d commit f7cbc4d759756599e1e47ab0220978b41c4db94d Author: Piotr Kubaj AuthorDate: 2026-09-08 11:22:58 +0000 Commit: Colin Percival CommitDate: 2026-11-17 19:50:36 +0000 powerpc/pmap: Use dcbz to zero pages in the radix pmap pagezero() was a plain store loop (bzero), which under the kernel build flags (-mno-vsx -msoft-float) compiles to byte stores. dcbz establishes a zeroed cache line directly in the cache without a read-for-ownership fetch from memory, roughly halving the memory transactions of page zeroing. Measured on POWER9 (Raptor Blackbird, DD2.3, bare metal), zeroing a cold 256 MB buffer with 128-byte scalar loops: byte stores (current libkern memset) 8.6 GB/s doubleword (std) stores 26.8 GB/s dcbz 34.6 GB/s dcbz raises an alignment interrupt on caching-inhibited mappings, and the kernel does not emulate it, so mmu_radix_zero_page() falls back to bzero() for any page whose memattr is not the write-back default. The internal pagezero() callers only touch freshly allocated page-table pages, which are always write-back. Note: dcbz helps only zeroing, where there is no source to read. For page copying it is a pessimization (it adds a redundant zeroing pass on top of the mandatory source read), so mmu_radix_copy_page() is left as a plain bcopy(). Approved by: re (cperciva) Differential Revision: https://reviews.freebsd.org/D59507 Reviewed by: jhibbits (cherry picked from commit 1d4a00d455617e150da5a7c3076579a7e612d33d) (cherry picked from commit afeeac4f9cb08a2ea15dfd94f90486a6ddf29d88) --- sys/powerpc/aim/mmu_radix.c | 19 ++++++++++++++++--- 1 file changed, 16 insertions(+), 3 deletions(-) diff --git a/sys/powerpc/aim/mmu_radix.c b/sys/powerpc/aim/mmu_radix.c index f1f1a06ecd67..83af83b14bb2 100644 --- a/sys/powerpc/aim/mmu_radix.c +++ b/sys/powerpc/aim/mmu_radix.c @@ -891,12 +891,22 @@ pmap_resident_count_dec(pmap_t pmap, int count) pmap->pm_stats.resident_count -= count; } +/* + * dcbz establishes a zeroed cache line without fetching it from memory, + * but raises an alignment interrupt on caching-inhibited mappings, so it + * may only be used on write-back memory. The internal callers only zero + * freshly allocated page table pages, which are always write-back; the + * vm_page facing entry point guards on the page's memattr. + */ static void pagezero(vm_offset_t va) { - va = trunc_page(va); + vm_offset_t off; - bzero((void *)va, PAGE_SIZE); + va = trunc_page(va); + for (off = 0; off < PAGE_SIZE; off += cacheline_size) + __asm __volatile("dcbz 0,%0" :: + "r"(va + off) : "memory"); } static uint64_t @@ -5808,7 +5818,10 @@ mmu_radix_zero_page(vm_page_t m) CTR2(KTR_PMAP, "%s(%p)", __func__, m); addr = PHYS_TO_DMAP(VM_PAGE_TO_PHYS(m)); - pagezero(addr); + if (__predict_true(m->md.mdpg_cache_attrs == VM_MEMATTR_DEFAULT)) + pagezero(addr); + else + bzero((void *)addr, PAGE_SIZE); } void