From nobody Tue Aug 15 21:03:17 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RQNz82MvQz4qQJZ for ; Tue, 15 Aug 2023 21:03:32 +0000 (UTC) (envelope-from joe@via.net) Received: from smtp3.via.net (smtp3.via.net [157.22.3.7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "via.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RQNz800W7z3cl9 for ; Tue, 15 Aug 2023 21:03:31 +0000 (UTC) (envelope-from joe@via.net) Authentication-Results: mx1.freebsd.org; none Received: from mail.via.net (mail.via.net [157.22.3.34]) by smtp3.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id 37FL3TWb025687 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Tue, 15 Aug 2023 14:03:30 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.1 at smtp3.via.net Received: from smtpclient.apple ([209.81.2.65]) by mail.via.net (8.15.2/8.14.1-VIANET) with ESMTP id 37FL3RRf017532; Tue, 15 Aug 2023 14:03:27 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.1 at mail.via.net From: joe mcguckin Message-Id: <20BA3146-9448-4B34-9B2A-ED591664B68F@via.net> Content-Type: multipart/alternative; boundary="Apple-Mail=_4232FA49-C650-4C57-B92E-09FD76B590F5" List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.1\)) Subject: Re: Speed improvements in ZFS Date: Tue, 15 Aug 2023 14:03:17 -0700 In-Reply-To: Cc: Mateusz Guzik , current@freebsd.org To: Alexander Leidinger References: <61ca9df1b15c0e5477ff51196d0ec073@Leidinger.net> X-Mailer: Apple Mail (2.3696.120.41.1.1) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (smtp3.via.net [157.22.3.7]); Tue, 15 Aug 2023 14:03:30 -0700 (PDT) X-Rspamd-Queue-Id: 4RQNz800W7z3cl9 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US] --Apple-Mail=_4232FA49-C650-4C57-B92E-09FD76B590F5 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii When I watch the activity leds of the disks on one of our ZFS servers, I = notice there will be a burst of activity for 3 or 4 seconds, then no = activity for a couple of seconds, then it repeats. Is that normal? Thanks, joe Joe McGuckin ViaNet Communications joe@via.net 650-207-0372 cell 650-213-1302 office 650-969-2124 fax > On Aug 15, 2023, at 12:33 PM, Alexander Leidinger = wrote: >=20 > Am 2023-08-15 14:41, schrieb Mateusz Guzik: >=20 >> With this in mind can you provide: sysctl kern.maxvnodes >> vfs.wantfreevnodes vfs.freevnodes vfs.vnodes_created vfs.numvnodes >> vfs.recycles_free vfs.recycles >=20 > After a reboot: > kern.maxvnodes: 10485760 > vfs.wantfreevnodes: 2621440 > vfs.freevnodes: 24696 > vfs.vnodes_created: 1658162 > vfs.numvnodes: 173937 > vfs.recycles_free: 0 > vfs.recycles: 0 >=20 >> Meanwhile if there is tons of recycles, you can damage control by >> bumping kern.maxvnodes. >=20 > Looks like there are not much free directly after the reboot. I will = check the values tomorrow after the periodic run again and maybe = increase by 10 or 100 so see if it makes a difference. >=20 >> If this is not the problem you can use dtrace to figure it out. >=20 > dtrace-count on vnlru_read_freevnodes() and vnlru_free_locked()? Or = something else? >=20 > Bye, > Alexander. >=20 > --=20 > http://www.Leidinger.net Alexander@Leidinger.net: PGP = 0x8F31830F9F2772BF > http://www.FreeBSD.org netchild@FreeBSD.org : PGP = 0x8F31830F9F2772BF --Apple-Mail=_4232FA49-C650-4C57-B92E-09FD76B590F5 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii When = I watch the activity leds of the disks on one of our ZFS servers, I = notice there will be a burst of activity for 3 or 4 seconds, then no = activity for a couple of seconds, then it repeats.
Is = that normal?

Thanks,

joe


Joe = McGuckin
ViaNet Communications

650-207-0372 cell
650-213-1302 = office
650-969-2124 fax



On Aug 15, 2023, at 12:33 PM, Alexander Leidinger <Alexander@Leidinger.net> wrote:

Am = 2023-08-15 14:41, schrieb Mateusz Guzik:

With this in mind can = you provide: sysctl kern.maxvnodes
vfs.wantfreevnodes = vfs.freevnodes vfs.vnodes_created vfs.numvnodes
vfs.recycles_free vfs.recycles

After a reboot:
kern.maxvnodes: 10485760
vfs.wantfreevnodes: 2621440
vfs.freevnodes: = 24696
vfs.vnodes_created: 1658162
vfs.numvnodes: 173937
vfs.recycles_free: 0
vfs.recycles: 0

Meanwhile if there is tons of recycles, you can = damage control by
bumping kern.maxvnodes.

Looks like there are not much = free directly after the reboot. I will check the values tomorrow after = the periodic run again and maybe increase by 10 or 100 so see if it = makes a difference.

If this is not the problem you can use dtrace to figure it = out.

dtrace-count on = vnlru_read_freevnodes() and vnlru_free_locked()? Or something else?

Bye,
Alexander.

--
http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF
http://www.FreeBSD.org    netchild@FreeBSD.org =  : PGP 0x8F31830F9F2772BF

= --Apple-Mail=_4232FA49-C650-4C57-B92E-09FD76B590F5--