From nobody Thu Apr 21 20:56:14 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C91F011DF20B for ; Thu, 21 Apr 2022 20:56:26 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.129.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KkqZx6Pldz3p29 for ; Thu, 21 Apr 2022 20:56:25 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-393-Bu9LdJvgPCiwVX5DLW24hQ-1; Thu, 21 Apr 2022 16:56:16 -0400 X-MC-Unique: Bu9LdJvgPCiwVX5DLW24hQ-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Thu, 21 Apr 2022 16:56:15 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.033; Thu, 21 Apr 2022 16:56:15 -0400 From: Michael Jung To: Alan Somers CC: freebsd-fs Subject: RE: ZFS reservations for type=volume Thread-Topic: ZFS reservations for type=volume Thread-Index: AdhVu5cQcIQitTxvR6aGtLet26JbwgAJfmSAAAgCV9A= Date: Thu, 21 Apr 2022 20:56:14 +0000 Message-ID: References: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local> In-Reply-To: Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Type: multipart/alternative; boundary="MCBoundary=_12204211656173051" X-Rspamd-Queue-Id: 4KkqZx6Pldz3p29 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.129.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-3.78 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.993]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.129.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.984]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:~,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.128.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.129.197:from] X-ThisMailContainsUnwantedMimeParts: N --MCBoundary=_12204211656173051 Content-Language: en-US Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 T2sgdGhhdCBtYWtlcyBzZW5zZS4uLiBzbyBldmVuIHRob3VnaCBydW5uaW5nIFpGUyBzaW5jZSA5 LnggSSdsbCBhc2sgdGhlIG5ld2JpZSBxdWVzdGlvbi4uDQoNCklmIGl0IGNvbnRyaWJ1dGVzIHRv IHRoZSBwYXJlbnRzICJ1c2VkIiB2YWx1ZSB3aHkgaXMgbm90IHJlZmxlY3RlZCBoZXJlIGluICJV U0VEIiBvciBpbiAiQVZBSUwiPw0KDQpJIHdvdWxkIGV4cGVjdCBVU0VEIHRvIGJlIG15IHJlc2Vy dmF0aW9uIGFtb3VudCBvZiAxNS42VCArIHdoYXRldmVyIHNwYWNlIHdhcw0KYmVpbmcgdXNlZCBi eSBvdGhlciB0aGluZ3Mgb24gdGhlIHBvb2wuICAiVVNFRCIgc3RpbGwgc2l0cyBhdCAxLjUyVC4N Cg0KTkFNRSAgICAgICAgIFRZUEUgICBVU0VEICBBVkFJTCAgUkFUSU8gIENPTVBSRVNTICAgICAg ICBSRVNFUlYgIFJFRlJFU0VSViAgVk9MU0laRQ0KcmFpZC01NDAwLTEgIDI0LjZUICAxLjUyVCAg MjMuMVQgICAgICAgIC0gICAgICAgICAtICAgICAyJSAgICAgNiUgIDEuMDB4ICAgIE9OTElORQ0K DQpUaGFua3MgYWdhaW4uDQoNCi0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQpGcm9tOiBBbGFu IFNvbWVycyBbbWFpbHRvOmFzb21lcnNAZnJlZWJzZC5vcmddDQpTZW50OiBUaHVyc2RheSwgQXBy aWwgMjEsIDIwMjIgNDo0MCBQTQ0KVG86IE1pY2hhZWwgSnVuZyA8bWlrZWpAcGF5bWVudGFsbGlh bmNlaW50bC5jb20+DQpDYzogZnJlZWJzZC1mcyA8ZnJlZWJzZC1mc0BmcmVlYnNkLm9yZz4NClN1 YmplY3Q6IFJlOiBaRlMgcmVzZXJ2YXRpb25zIGZvciB0eXBlPXZvbHVtZQ0KDQpBIGRhdGFzZXQn cyByZXNlcnZhdGlvbiBpcyBsb2NhbC4gIEl0IGRvZXNuJ3QgY29udHJpYnV0ZSB0byBpdHMgcGFy ZW50J3MgcmVzZXJ2YXRpb24uICBPdGhlcndpc2UsIHlvdSB3b3VsZG4ndCBiZSBhYmxlIHRvIHNl cGFyYXRlbHkgc2V0IGEgcmVzZXJ2YXRpb24gb24gdGhlIHBhcmVudC4gIEJ1dCBpdCBfZG9lc18g Y29udHJpYnV0ZSB0byB0aGUgcGFyZW50J3MgInVzZWQiIHZhbHVlLiAgSW4gdGhhdCB3YXksIHlv dSdyZSBwcmV2ZW50ZWQgZnJvbSByZXNlcnZpbmcgdG9vIG11Y2ggZGF0YSBvbiB0aGUgcGFyZW50 J3MgY2hpbGRyZW4uDQotQWxhbg0KDQpPbiBUaHUsIEFwciAyMSwgMjAyMiBhdCAyOjI4IFBNIE1p Y2hhZWwgSnVuZyA8bWlrZWpAcGF5bWVudGFsbGlhbmNlaW50bC5jb20+IHdyb3RlOg0KPg0KPiBJ IGhhdmUgYSB6ZnMgYmxvY2sgZGF0YXNldCByYWlkLTU0MDAtMS9lc3hpLXN0b3JlMSB0aGF0IEkg c2hhcmUgYXMgYW4NCj4gaXNjc2kgdGFyZ2V0IGFuZCB0aGF0IHdvcmtzIGdyZWF0LiAgSSBoYXZl IHNldCBhIHJlc2VydmF0aW9uDQo+DQo+IG9uIHRoYXQgYmxvY2sgZGV2aWNlIGVxdWFsIHRvIGl0 cyBzaXplIHNvIHRoYXQgaXMgbm90IHNwYXJzZSBhbmQgdGh1cw0KPiB3aGlsZSBJIGNvdWxkIG92 ZXIgcHJvdmlzaW9uIGd1ZXN0cyBvbiB0aGUgcHJvdmlkZWQgTFVOLA0KPg0KPiB0aGUgc3RvcmFn ZSBwcmVzZW50ZWQgYXMgdGhlIExVTiBjYXBhY2l0eSB3aWxsIGFsd2F5cyBiZSBhdmFpbGFibGUu ICBBdCBsZWFzdCB0aGlzIGlzIHdoYXQgSSB3YW50IHRvIGFjaGlldmUuDQo+DQo+DQo+DQo+IFdo YXQgSSBmaW5kIHN0cmFuZ2UgaXMgdGhhdCB0aGUgcmVzZXJ2YXRpb24gZG9lcyBub3Qgc2VlbSB0 byBiZQ0KPiBhcHBsaWVkIHRvIHRoZSBaRlMgcG9vbCDigJhyYWlkLTU0MDAtMeKAmS4gIERvIHlv dSByZWFsbHkgbmVlZA0KPg0KPiB0byBzZXQgeW91ciBtYXhpbXVtIHJlc2VydmF0aW9uIGF0IHRo ZSBwb29sIGxldmVsLCBhbmQgdGhlbiBhcHBseQ0KPiByZXNlcnZhdGlvbnMgdG8gYWxsIGRhdGFz ZXRzIG9uIHRoYXQgdm9sdW1lPyAgQW5kIGlmIHNvDQo+DQo+IEkgd291bGQgYXNzdW1lIHlvdSBj b3VsZCBuZXZlciBzZXQgcmVzZXJ2YXRpb25zIGZvciBkYXRhc2V0cyB0b3RhbGluZyBtb3JlIHRo YW4gd2hhdCB3YXMgcmVzZXJ2ZWQgZm9yIHRoZSBwb29sIOKAmHJhaWQtNTQwMC0x4oCZLg0KPg0K Pg0KPg0KPiBJIGNvdWxkIGJ1aWxkIG91dCBhIHRlc3QgZW52aXJvbm1lbnQgYW5kIGZpZ3VyZSBv dXQgY29uc3RyYWludHMgYnV0IEnigJlkIHJlYWxseSBsaWtlIHRvIGtub3cgdGhlIOKAnGhvdyBp dCBpcyBzdXBwb3NlZCB0byB3b3Jr4oCdDQo+DQo+IG5vdCB0aGUg4oCcaG93IEkgZmluZCBpdCB0 byB3b3Jr4oCdLg0KPg0KPg0KPg0KPiBUaGFua3MgaW4gYWR2YW5jZS4NCj4NCj4NCj4NCj4gRnJl ZUJTRCAxNC4wLUNVUlJFTlQgIzQgbWFpbi1uMjUzODc1LThlNzJmNDU4YzZkOg0KPg0KPg0KPg0K PiAodGhpcyBpcyBhIHJhaWR6MiBwb29sIOKAkyBub3QgbXkgZHJhaWQgcG9vbCkNCj4NCj4NCj4N Cj4NCj4NCj4gcm9vdEBkcmFpZDovdXNyL3NyYy9jb250cmliL2JlYXJzc2wgIyB6ZnMgbGlzdCAt bw0KPiBuYW1lLHR5cGUsdXNlZCxhdmFpbCxyYXRpbyxjb21wcmVzc2lvbixyZXNlcnZhdGlvbixy ZWZyZXNlcnZhdGlvbix2b2xzDQo+IGl6ZSByYWlkLTU0MDAtMQ0KPg0KPiBOQU1FICAgICAgICAg VFlQRSAgIFVTRUQgIEFWQUlMICBSQVRJTyAgQ09NUFJFU1MgICAgICAgIFJFU0VSViAgUkVGUkVT RVJWICBWT0xTSVpFDQo+DQo+IHJhaWQtNTQwMC0xICBmaWxlc3lzdGVtICAxOC4wVCAgMi4wOFQg IDEuMzZ4ICBvbiAgICAgICAgICAgICAgICBub25lICAgICAgIG5vbmUgICAgICAgIC0gICAgICAg ICAgICAgICA8LSBubyByZXNlcnZhdGlvbiBAcG9vbA0KPg0KPiByb290QGRyYWlkOi91c3Ivc3Jj L2NvbnRyaWIvYmVhcnNzbCAjDQo+DQo+DQo+DQo+IHJvb3RAZHJhaWQ6L3Vzci9zcmMvY29udHJp Yi9iZWFyc3NsICMgemZzIGxpc3QgLW8NCj4gbmFtZSx0eXBlLHVzZWQsYXZhaWwscmF0aW8sY29t cHJlc3Npb24scmVzZXJ2YXRpb24scmVmcmVzZXJ2YXRpb24sdm9scw0KPiBpemUgcmFpZC01NDAw LTEvZXN4aS1zdG9yZTENCj4NCj4gTkFNRSAgICAgICAgICAgICAgICAgICAgIFRZUEUgICBVU0VE ICBBVkFJTCAgUkFUSU8gIENPTVBSRVNTICAgICAgICBSRVNFUlYgIFJFRlJFU0VSViAgVk9MU0la RQ0KPg0KPiByYWlkLTU0MDAtMS9lc3hpLXN0b3JlMSAgdm9sdW1lICAxNi45VCAgMTguNVQgIDEu Nzh4ICB6c3RkICAgICAgICAgICAgIDE1LjZUICAgICAgMTYuOVQgICAgMTUuNlQgICAgICAgIDwt IHJlc2VydmF0aW9uIEBkYXRhc2V0DQo+DQo+DQo+DQo+IHJvb3RAZHJhaWQ6L3Vzci9zcmMvY29u dHJpYi9iZWFyc3NsICMgenBvb2wgbGlzdA0KPg0KPiBOQU1FICAgICAgICAgIFNJWkUgIEFMTE9D ICAgRlJFRSAgQ0tQT0lOVCAgRVhQQU5EU1ogICBGUkFHICAgIENBUCAgREVEVVAgICAgSEVBTFRI ICBBTFRST09UDQo+DQo+IGNjYWNoZSAgICAgICA5LjUwRyAgOS4xMEcgICA0MDZNICAgICAgICAt ICAgICAgICAgLSAgICA4OCUgICAgOTUlICAxLjAweCAgICBPTkxJTkUgIC0NCj4NCj4gcmFpZC01 NDAwLTEgIDI0LjZUICAxLjUyVCAgMjMuMVQgICAgICAgIC0gICAgICAgICAtICAgICAyJSAgICAg NiUgIDEuMDB4ICAgIE9OTElORSAgLSAgICAgICAgICAgICAgICAgICAgIDwtIEZyZWUgZG9lcyBu b3QgcmVmbGVjdCByZXNlcnZhdGlvbiBAcG9vbA0KPg0KPiB0YW5rICAgICAgICAgMTguNVQgICA2 MDVHICAxNy45VCAgICAgICAgLSAgICAgICAgIC0gICAgIDAlICAgICAzJSAgMS4wMHggICAgT05M SU5FICAtDQo+DQo+IHpmc3Jvb3QgICAgICAgMTAzRyAgMzMuM0cgIDY5LjdHICAgICAgICAtICAg ICAgICAgLSAgICAzMSUgICAgMzIlICAxLjAweCAgICBPTkxJTkUgIC0NCj4NCj4gcm9vdEBkcmFp ZDovdXNyL3NyYy9jb250cmliL2JlYXJzc2wgIw0KPg0KPg0KPg0KPg0KPg0KPiBDT05GSURFTlRJ QUxJVFkgTk9URTogVGhpcyBtZXNzYWdlIGlzIGludGVuZGVkIG9ubHkgZm9yIHRoZSB1c2Ugb2Yg dGhlDQo+IGluZGl2aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRkcmVzc2VkIGFuZCBt YXkgY29udGFpbg0KPiBpbmZvcm1hdGlvbiB0aGF0IGlzIHByaXZpbGVnZWQsIGNvbmZpZGVudGlh bCwgYW5kIGV4ZW1wdCBmcm9tDQo+IGRpc2Nsb3N1cmUgdW5kZXIgYXBwbGljYWJsZSBsYXcuIElm IHRoZSByZWFkZXIgb2YgdGhpcyBtZXNzYWdlIGlzIG5vdA0KPiB0aGUgaW50ZW5kZWQgcmVjaXBp ZW50LCB5b3UgYXJlIGhlcmVieSBub3RpZmllZCB0aGF0IGFueQ0KPiBkaXNzZW1pbmF0aW9uLCBk aXN0cmlidXRpb24gb3IgY29weWluZyBvZiB0aGlzIGNvbW11bmljYXRpb24gaXMNCj4gc3RyaWN0 bHkgcHJvaGliaXRlZC4gSWYgeW91IGhhdmUgcmVjZWl2ZWQgdGhpcyB0cmFuc21pc3Npb24gaW4g ZXJyb3IsDQo+IHBsZWFzZSBub3RpZnkgdXMgYnkgdGVsZXBob25lIGF0ICg1MDIpIDIxMi00MDAw IG9yIG5vdGlmeSB1cyBhdDogUEFJLA0KPiBEZXB0LiA5OSwNCj4gMjEwMSBIaWdoIFdpY2toYW0g UGxhY2UsIFN1aXRlIDEwMSwgTG91aXN2aWxsZSwgS1kgNDAyNDUNCj4NCj4NCj4NCj4NCj4NCj4g RGlzY2xhaW1lcg0KPg0KPiBUaGUgaW5mb3JtYXRpb24gY29udGFpbmVkIGluIHRoaXMgY29tbXVu aWNhdGlvbiBmcm9tIHRoZSBzZW5kZXIgaXMgY29uZmlkZW50aWFsLiBJdCBpcyBpbnRlbmRlZCBz b2xlbHkgZm9yIHVzZSBieSB0aGUgcmVjaXBpZW50IGFuZCBvdGhlcnMgYXV0aG9yaXplZCB0byBy ZWNlaXZlIGl0LiBJZiB5b3UgYXJlIG5vdCB0aGUgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSBu b3RpZmllZCB0aGF0IGFueSBkaXNjbG9zdXJlLCBjb3B5aW5nLCBkaXN0cmlidXRpb24gb3IgdGFr aW5nIGFjdGlvbiBpbiByZWxhdGlvbiBvZiB0aGUgY29udGVudHMgb2YgdGhpcyBpbmZvcm1hdGlv biBpcyBzdHJpY3RseSBwcm9oaWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdmdWwuDQo+DQo+IFRoaXMg ZW1haWwgaGFzIGJlZW4gc2Nhbm5lZCBmb3IgdmlydXNlcyBhbmQgbWFsd2FyZSwgYW5kIG1heSBo YXZlIGJlZW4gYXV0b21hdGljYWxseSBhcmNoaXZlZCBieSBNaW1lY2FzdCwgYSBsZWFkZXIgaW4g ZW1haWwgc2VjdXJpdHkgYW5kIGN5YmVyIHJlc2lsaWVuY2UuIE1pbWVjYXN0IGludGVncmF0ZXMg ZW1haWwgZGVmZW5zZXMgd2l0aCBicmFuZCBwcm90ZWN0aW9uLCBzZWN1cml0eSBhd2FyZW5lc3Mg dHJhaW5pbmcsIHdlYiBzZWN1cml0eSwgY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNh cGFiaWxpdGllcy4gTWltZWNhc3QgaGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3JnYW5p emF0aW9ucyBmcm9tIG1hbGljaW91cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hub2xv Z3kgZmFpbHVyZTsgYW5kIHRvIGxlYWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBhIG1v cmUgcmVzaWxpZW50IHdvcmxkLiBUbyBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS4N Cg0KDQoNCg0KQ09ORklERU5USUFMSVRZIE5PVEU6IFRoaXMgbWVzc2FnZSBpcyBpbnRlbmRlZCBv bmx5IGZvciB0aGUgdXNlDQpvZiB0aGUgaW5kaXZpZHVhbCBvciBlbnRpdHkgdG8gd2hvbSBpdCBp cyBhZGRyZXNzZWQgYW5kIG1heQ0KY29udGFpbiBpbmZvcm1hdGlvbiB0aGF0IGlzIHByaXZpbGVn ZWQsIGNvbmZpZGVudGlhbCwgYW5kDQpleGVtcHQgZnJvbSBkaXNjbG9zdXJlIHVuZGVyIGFwcGxp Y2FibGUgbGF3LiBJZiB0aGUgcmVhZGVyDQpvZiB0aGlzIG1lc3NhZ2UgaXMgbm90IHRoZSBpbnRl bmRlZCByZWNpcGllbnQsIHlvdSBhcmUgaGVyZWJ5DQpub3RpZmllZCB0aGF0IGFueSBkaXNzZW1p bmF0aW9uLCBkaXN0cmlidXRpb24gb3IgY29weWluZw0Kb2YgdGhpcyBjb21tdW5pY2F0aW9uIGlz IHN0cmljdGx5IHByb2hpYml0ZWQuIElmIHlvdSBoYXZlDQpyZWNlaXZlZCB0aGlzIHRyYW5zbWlz c2lvbiBpbiBlcnJvciwgcGxlYXNlIG5vdGlmeSB1cyBieQ0KdGVsZXBob25lIGF0ICg1MDIpIDIx Mi00MDAwIG9yIG5vdGlmeSB1cyBhdCBQQUksIERlcHQuIDk5LA0KMjEwMSBIaWdoIFdpY2toYW0g UGxhY2UsIFN1aXRlIDEwMSwgTG91aXN2aWxsZSwgS1kgNDAyNDUNCg0KRGlzY2xhaW1lcg0KDQpU aGUgaW5mb3JtYXRpb24gY29udGFpbmVkIGluIHRoaXMgY29tbXVuaWNhdGlvbiBmcm9tIHRoZSBz ZW5kZXIgaXMgY29uZmlkZW50aWFsLiBJdCBpcyBpbnRlbmRlZCBzb2xlbHkgZm9yIHVzZSBieSB0 aGUgcmVjaXBpZW50IGFuZCBvdGhlcnMgYXV0aG9yaXplZCB0byByZWNlaXZlIGl0LiBJZiB5b3Ug YXJlIG5vdCB0aGUgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSBub3RpZmllZCB0aGF0IGFueSBk aXNjbG9zdXJlLCBjb3B5aW5nLCBkaXN0cmlidXRpb24gb3IgdGFraW5nIGFjdGlvbiBpbiByZWxh dGlvbiBvZiB0aGUgY29udGVudHMgb2YgdGhpcyBpbmZvcm1hdGlvbiBpcyBzdHJpY3RseSBwcm9o aWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdmdWwuDQoNClRoaXMgZW1haWwgaGFzIGJlZW4gc2Nhbm5l ZCBmb3IgdmlydXNlcyBhbmQgbWFsd2FyZSwgYW5kIG1heSBoYXZlIGJlZW4gYXV0b21hdGljYWxs eSBhcmNoaXZlZCBieSBNaW1lY2FzdCwgYSBsZWFkZXIgaW4gZW1haWwgc2VjdXJpdHkgYW5kIGN5 YmVyIHJlc2lsaWVuY2UuIE1pbWVjYXN0IGludGVncmF0ZXMgZW1haWwgZGVmZW5zZXMgd2l0aCBi cmFuZCBwcm90ZWN0aW9uLCBzZWN1cml0eSBhd2FyZW5lc3MgdHJhaW5pbmcsIHdlYiBzZWN1cml0 eSwgY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNhcGFiaWxpdGllcy4gTWltZWNhc3Qg aGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3JnYW5pemF0aW9ucyBmcm9tIG1hbGljaW91 cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hub2xvZ3kgZmFpbHVyZTsgYW5kIHRvIGxl YWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBhIG1vcmUgcmVzaWxpZW50IHdvcmxkLiBU byBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS4NCg== --MCBoundary=_12204211656173051 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8 Ok that makes sense... so even though running ZFS s= ince 9.x I'll ask the newbie question..

If it contributes to the parents "used" value why is not reflecte= d here in "USED" or in "AVAIL"?

I would expect USED to be my reservation amount of 15.6T + whatever space w= as
being used by other things on the pool. "USED" still sits at 1.5= 2T.

NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV = VOLSIZE
raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x = ONLINE

Thanks again.

-----Original Message-----
From: Alan Somers [mailto:asomers@freebsd.org]
Sent: Thursday, April 21, 2022 4:40 PM
To: Michael Jung <mikej@paymentallianceintl.com>
Cc: freebsd-fs <freebsd-fs@freebsd.org>
Subject: Re: ZFS reservations for type=3Dvolume

A dataset's reservation is local. It doesn't contribute to its parent's re= servation. Otherwise, you wouldn't be able to separately set a reservation= on the parent. But it _does_ contribute to the parent's "used" = value. In that way, you're prevented from reserving too much data on the p= arent's children.
-Alan

On Thu, Apr 21, 2022 at 2:28 PM Michael Jung <mikej@paymentallianceintl.= com> wrote:
>
> I have a zfs block dataset raid-5400-1/esxi-store1 that I share as an<= BR> > iscsi target and that works great. I have set a reservation
>
> on that block device equal to its size so that is not sparse and thus<= BR> > while I could over provision guests on the provided LUN,
>
> the storage presented as the LUN capacity will always be available. A= t least this is what I want to achieve.
>
>
>
> What I find strange is that the reservation does not seem to be
> applied to the ZFS pool =E2=80=98raid-5400-1=E2=80=99. Do you really = need
>
> to set your maximum reservation at the pool level, and then apply
> reservations to all datasets on that volume? And if so
>
> I would assume you could never set reservations for datasets totaling = more than what was reserved for the pool =E2=80=98raid-5400-1=E2=80=99.
>
>
>
> I could build out a test environment and figure out constraints but I= =E2=80=99d really like to know the =E2=80=9Chow it is supposed to work=E2= =80=9D
>
> not the =E2=80=9Chow I find it to work=E2=80=9D.
>
>
>
> Thanks in advance.
>
>
>
> FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d:
>
>
>
> (this is a raidz2 pool =E2=80=93 not my draid pool)
>
>
>
>
>
> root@draid:/usr/src/contrib/bearssl # zfs list -o
> name,type,used,avail,ratio,compression,reservation,refreservation,vols=
> ize raid-5400-1
>
> NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRES= ERV VOLSIZE
>
> raid-5400-1 filesystem 18.0T 2.08T 1.36x on none = none - <- no reservation @pool
>
> root@draid:/usr/src/contrib/bearssl #
>
>
>
> root@draid:/usr/src/contrib/bearssl # zfs list -o
> name,type,used,avail,ratio,compression,reservation,refreservation,vols=
> ize raid-5400-1/esxi-store1
>
> NAME TYPE USED AVAIL RATIO COMPRESS RE= SERV REFRESERV VOLSIZE
>
> raid-5400-1/esxi-store1 volume 16.9T 18.5T 1.78x zstd = 15.6T 16.9T 15.6T <- reservation @dataset
>
>
>
> root@draid:/usr/src/contrib/bearssl # zpool list
>
> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DED= UP HEALTH ALTROOT
>
> ccache 9.50G 9.10G 406M - - 88% 95% 1.0= 0x ONLINE -
>
> raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.0= 0x ONLINE - <- Free does not reflect reservation= @pool
>
> tank 18.5T 605G 17.9T - - 0% 3% 1.0= 0x ONLINE -
>
> zfsroot 103G 33.3G 69.7G - - 31% 32% 1.0= 0x ONLINE -
>
> root@draid:/usr/src/contrib/bearssl #
>
>
>
>
>
> CONFIDENTIALITY NOTE: This message is intended only for the use of the=
> individual or entity to whom it is addressed and may contain
> information that is privileged, confidential, and exempt from
> disclosure under applicable law. If the reader of this message is not<= BR> > the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication is
> strictly prohibited. If you have received this transmission in error,<= BR> > please notify us by telephone at (502) 212-4000 or notify us at: PAI,<= BR> > Dept. 99,
> 2101 High Wickham Place, Suite 101, Louisville, KY 40245
>
>
>
>
>
> Disclaimer
>
> The information contained in this communication from the sender is con= fidential. It is intended solely for use by the recipient and others author= ized to receive it. If you are not the recipient, you are hereby notified t= hat any disclosure, copying, distribution or taking action in relation of t= he contents of this information is strictly prohibited and may be unlawful.=
>
> This email has been scanned for viruses and malware, and may have been= automatically archived by Mimecast, a leader in email security and cyber r= esilience. Mimecast integrates email defenses with brand protection, securi= ty awareness training, web security, compliance and other essential capabil= ities. Mimecast helps protect large and small organizations from malicious = activity, human error and technology failure; and to lead the movement towa= rd building a more resilient world. To find out more, visit our website.



CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245


<= b>Disclaimer

The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.

This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.

--MCBoundary=_12204211656173051--