From nobody Fri Aug 20 08:18:49 2021 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 89C641772641 for ; Fri, 20 Aug 2021 08:18:58 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GrZKY393Rz4yws for ; Fri, 20 Aug 2021 08:18:57 +0000 (UTC) (envelope-from ben.rubson@gmx.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1629447529; bh=SoAXD0jHrw17xK5hv+80zERoNdWWmxc0boWX0KoAbjw=; h=X-UI-Sender-Class:From:Subject:Date:References:To:In-Reply-To; b=fzJXaBBYUruRw5P043Hsx5u5UfWR20LpZ8hbqBT64ztAvIOqBsdB0gxBi6c/yMPuB N09soyyeEIAaFAknZc0piGQ69goZY5HeUn5S2aSae7Jvhg7u+PwFrx4rKN53oltQbG g5DSN+n9j6e3D55qyGx19NKuH144CymmR3IDxlY4= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from smtpclient.apple ([185.101.28.209]) by mail.gmx.net (mrgmx005 [212.227.17.184]) with ESMTPSA (Nemesis) id 1MysVs-1n2vjH2ojq-00w0fv for ; Fri, 20 Aug 2021 10:18:49 +0200 From: Ben RUBSON Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: ZFS on high-latency devices Date: Fri, 20 Aug 2021 10:18:49 +0200 References: To: freebsd-fs@freebsd.org In-Reply-To: Message-Id: <023225AD-2A97-47C5-9FE4-3ABF1BFD66F1@gmx.com> X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Provags-ID: V03:K1:X616uPTyBQLFkxESmGa0lRTaK8EC5kX8EoBnH3vjLW3kmppFnDx mjc5OoOmPiMK9+/cS6EqUzuqhg1L4+DZQkjsiscyCxzXrvgGSJGQz5XPuQnIZSRtGzBPBgM MtG8iayjjVzvt3g7T8HMVj63Ssiz8+aASIah2Mdldxezoo/g5X2c3gLLwgd3Wa8/f4Ap3zK P8zbBY+3mBvHpol00paxQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:l8hEDiO9HFg=:SWsqvsFiF8yZ4LICIFeTSA 7JbdbBgrCfuOy6Uxf12YYZx9XHXLl4JlXeei5HWcNICSycxMW7ZLyZggT9r6WM7H0Vq8E7Wtd zpSlFweYlSqzp9qGH37NepNrtnWAL3EVE5feSlDntXGoSPmOVPLOd2gOdO7C3+ZCY9iTbCADv KhoiSnYNbK7I783IR6nud9NCE5M77YKSQjG6AcZ/hlRH/CSdZJKUtdcdVj29vwXV5cHzLloIA wsYbKvTsygra9KdsX+D4D04w3E8Afm25M1/Oevrp4lL3WDvEHpB+wJqq2gG/Pkc3CsD0bC6Q1 LJMVlBFgM3oKdskIh/sgtUZMlFs1Moj1M9vlUOv5ghIhDiEMZJ6mT6VxOczFP15j0Ik4V0vMO Psef3wiXdKV1n9eja3gntzGrEUQWo2H1J0NLrLnNoU8vl5arlA2ZaqDVuwU/NNuvmDYsNiXRK 7wtNlE8fehhRGGVb2f9YGYqV+73y7IuUM35cjmizTfOvp3ESfjzelxvxmc3vdQ5+j53Gr/vXW W9XhQzp2HXwBR0gN1EpO/2LjewdLjpMQT2PWXNdOQkYik4IF6Ykwu2p/BL0rny7b9ikD2lQ4E bWlYA+cry74mkXKFp4/s0hCiiUjqA7cohH7LAMPDHYxNq4/kyYCEi5orNKvi/24OSF1Datf8T 3WlafS1Q09XtvuqXfgIjsL5aWc82LlldrzHjyZNqtmY1t3g0WMDgJh2Zt97GH43aaeSV5V7Fy vZdbXj/evV9stop19YGVHN1wBpdnfxyxUIYcBW82A8CGBz3KerQT7lkoyiB2VZrDsSOh0vkoZ jZxMXYEu3Y1suwxz/8bFs9I23pY2gjo+1Pm1q45nR4byUasFBlQnXzfYBbjkYX8ppGSq1ZfZo zWinjrI/DSmhyBZNHdTxd08tA9dL35ny6D4uJqdmPP7DDkPEZlZBtxMFyk69MrdGr1reWQXxq jFoGzw7WCvHNZMQI+Ie3Rn9pxUGSTFI4gCDq2GgwyWU/Yit5x3/u4k9Hgjqm3RzhscluOD2Y+ LS757A4D8bGnBhjoKyvAYUnqHuAwxAz87Br0lgEBFwHoBSKLHGyRa1IdyQdCFAL8yBU9J8wO6 CX49hi+d5A2K6X6CArr4nMJJQQMsMxpOq7kxzaURoaBMiWEJe51d/zMAQ== X-Rspamd-Queue-Id: 4GrZKY393Rz4yws X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=fzJXaBBY; dmarc=pass (policy=none) header.from=gmx.com; spf=pass (mx1.freebsd.org: domain of ben.rubson@gmx.com designates 212.227.15.19 as permitted sender) smtp.mailfrom=ben.rubson@gmx.com X-Spamd-Result: default: False [-4.46 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[212.227.15.19:from]; FREEMAIL_FROM(0.00)[gmx.com]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/24]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.com,none]; NEURAL_HAM_SHORT(-0.86)[-0.855]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmx.com]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.19:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[gmx.net:dkim]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N > On 19 Aug 2021, at 11:37, Peter Jeremy wrote: >=20 > (...) or a way to improve throughput doing "zfs recv" to a pool with a = high RTT. You should use zfs send/receive through mbuffer, which will allow to = sustain better throughput over high latency links. Feel free to play with its buffer size parameters to find the better = settings, depending on your link characteristics. Ben