From nobody Tue Apr 01 10:17:36 2025 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZRkTj6WS6z5sHXG for ; Tue, 01 Apr 2025 10:18:01 +0000 (UTC) (envelope-from dch@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZRkTj5fN3z3Hsh for ; Tue, 01 Apr 2025 10:18:01 +0000 (UTC) (envelope-from dch@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1743502681; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=8hawD4bssdGU2myKy5oPGmJGZrUIoKiJCTtqGbqtpN4=; b=W6Xgc33jNQHq2RKgx/AwDnfirTwTcGQma2GG56PyqppE/7GkCMaRcEQlJCBsPuiRpCzGUx QjGFbZfZrmiWLOr8IQvKKIbI1TJA4XwUS+9023bNRIsnUWuL0O9eOD27OAWq7zmVOhyCJ8 8FONtavHy6inM45ZWYQiT29WuK188EL2RL+5OfyorZvaIzW3SaGgi7/h4rvkCvJes3ajyT 0WVnfetGYKUtRnnW2WZZkalBvKDnV57JPZsE1x0AkWo4ZrSLnPD1GDd11ZoZQXyl44OL+p YJtDwt5nX7kWeqN8QAJBfyIQQKWPanciCOZUMvTjfep6eLtyZfMm7kZ0kWBMug== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1743502681; a=rsa-sha256; cv=none; b=n+uNVZyIWxtBZmxUcI35gaoPTDxUd4YiM2Lb7R2j1UiiS0HbSYbWFemfkj8IaVZB+bgTbc qio6kV420CCNvXI4mEhNF5B5/e6KRKvHFE0/CW8m/DJitfg6S+AxKv+mbfSYpq3lF36GM4 ce+KZM0v3oS1EBGicyflF1/UOv3tevyYjl7JvINOu3fKP5pLj4qjxR3s905AsuoDskZwrb UaHgYcPF/DuCwCTNEs6MLJo8M5aIXZNhtphs7Zms0l81/y4APLKiVNqyZMoXXBEt0YkVoV nUwtByC2Dzl1EcRbc6OddNvsWyRGOryITDjZmWAFtXKVxEWTT4lMyuspcE+A6Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1743502681; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=8hawD4bssdGU2myKy5oPGmJGZrUIoKiJCTtqGbqtpN4=; b=qWURm8GJAJqfzh1PRV+zeCKwYz2BAfiH4vv+RoojtM/k2S8lEOHF5NpOXQ/I9tgmCxADyp ZmYD5Sp70zO7CM5cOaI2aUtcND3M/XB39hVX7mflcemupa8PbXDiYEMuWRcK43bzXxnpCs CSGkXs/cfPNJ803SiHmJ/0LDM8FviQuYyPYxrPPAubmo4RWUvfiyRHw5eTvDE9heaYHhmH flZ7acwLo+hMnf3QJlN/UdHfi7/z4gCLhlJpDS232jWKbSdy4hZz2/NsTDQegTnD9a387Y 6G4qr0C/ibxqb9vPT33HWdWc3uCCrQRzkZ8815zCojIsT7GBYfBH7moI6KkqyA== Received: from fauth-a2-smtp.messagingengine.com (fauth-a2-smtp.messagingengine.com [103.168.172.201]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: dch/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4ZRkTj4W37z8Fc for ; Tue, 01 Apr 2025 10:18:01 +0000 (UTC) (envelope-from dch@FreeBSD.org) Received: from phl-compute-08.internal (phl-compute-08.phl.internal [10.202.2.48]) by mailfauth.phl.internal (Postfix) with ESMTP id 10EF5120007A for ; Tue, 1 Apr 2025 06:17:57 -0400 (EDT) Received: from phl-imap-15 ([10.202.2.104]) by phl-compute-08.internal (MEProxy); Tue, 01 Apr 2025 06:17:57 -0400 X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgddukedvhedvucetufdoteggodetrf dotffvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggv pdfurfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefogg ffhffvkffutgfgsehtqhertdertdejnecuhfhrohhmpedfffgrvhgvucevohhtthhlvghh uhgsvghrfdcuoegutghhsefhrhgvvgeuufffrdhorhhgqeenucggtffrrghtthgvrhhnpe eggfeifeejvddvueeikeejtefguefftedvhfefueetheffvddtkeduheevieeludenucff ohhmrghinhepohhpvghnshhushgvrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenuc frrghrrghmpehmrghilhhfrhhomhepuggthhdomhgvshhmthhprghuthhhphgvrhhsohhn rghlihhthidquddvgeeluddtfeeguddquddvudefuddujeejqdgutghhpeephfhrvggvue fuffdrohhrghesfhgrshhtmhgrihhlrdhfmhdpnhgspghrtghpthhtohepuddpmhhouggv pehsmhhtphhouhhtpdhrtghpthhtoheptghurhhrvghnthesfhhrvggvsghsugdrohhrgh X-ME-Proxy: Feedback-ID: icedc46df:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id D453E78006A; Tue, 1 Apr 2025 06:17:56 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Date: Tue, 01 Apr 2025 10:17:36 +0000 From: "Dave Cottlehuber" To: current@freebsd.org Message-Id: <7d155dfe-800c-4ba4-b59b-bf710ab45991@app.fastmail.com> Subject: nfs4: some shares have invisible files & directories Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable TLDR I have working nfs4 mounts but in some mounts, none of the files are visible to ls etc. But if you know the filename, you can still access it directly by name. Why? I should have a very simple setup for nfsv4. What I need is to have ro exports /usr/{ports,obj,src} available to clients, all=20 FreeBSD. I can mount all exported filesystems, but only /usr/obj has visible files on the client, and I don't understand why. This behaviour is consistent across clients. during beinstall.sh from clients, they are unable to access files that definitely exist in /usr/obj/* such as /usr/bin/cc & /bin/rm.=20 It was "resolved" by `zfs destroy zroot/usr/{ports,src}` & recreating them. I don't recall ever using getfacl/setfacl, and I can't think of anything else that might make the mount work but the files be invisible. Sadly I did not think to just rename the afflicted datasets. Does anybody know what might cause this? I did find a mention of this from SUSE linux, but in 2011, and I don't see any interesting commits related to readdir recently. https://forums.opensuse.org/t/11-4-strange-nfs-v4-problem-invisible-file= s/63107 ## server - fast build box running nfsv4 only - 15-CURRENT, up to date - providing /usr/{src,obj,ports} to 3 clients - this is a zfs system, and each are on separate datasets ``` # egrep -hr 'nfs|mount' /etc/rc.conf* mountd_enable=3DYES nfs_server_enable=3DYES nfsv4_server_enable=3DYES nfsv4_server_only=3DYES # cat /etc/exports V4: /usr -sec=3Dsys /usr/src -ro /usr/obj -ro /usr/ports -ro # ls -AFGhld /usr/{src,obj,ports} drwxr-xr-x 3 dch wheel 3B Feb 28 23:27 /usr/obj/ drwxr-xr-x 70 dch wheel 86B Apr 1 06:55 /usr/ports/ drwxr-xr-x 27 dch wheel 47B Mar 31 13:26 /usr/src/ # getfacl /usr/src # file: /usr/src # owner: dch # group: wheel owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:r-x---a-R-c--s:-------:allow # getfacl /usr/src/COPYRIGHT # file: /usr/src/COPYRIGHT # owner: dch # group: wheel owner@:rw-p--aARWcCos:-------:allow group@:rw-p--a-R-c--s:-------:allow everyone@:r-----a-R-c--s:-------:allow ``` # clients - either 14.2-RELEASE or also 15-CURRENT - no daemons ``` # mount_nfs -o vers=3D4,nolockd,retrycnt=3D0,noatime,ro 172.16.1.4:/obj = /usr/obj # ls /usr/obj/usr/src/amd64.amd64/ bin/ ... lots more files, very good # mount_nfs -o vers=3D4,nolockd,retrycnt=3D0,noatime,ro 172.16.1.4:/src = /usr/src # mkdir /usr/src/foo mkdir: /usr/src/foo: Read-only file system # good its clearly mounted # ls -AFGhl /usr/src total 0 # head /usr/src/COPYRIGHT The compilation of software known as FreeBSD is distributed under the following terms: .... what how is this file even here? ls shows nothing, tar also fails ``` A+ Dave =E2=80=94=E2=80=94=E2=80=94 O for a muse of fire, that would ascend the brightest heaven of inventio= n!