From nobody Wed Feb 01 20:14:27 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4P6Y6p5DRQz3bvbl for ; Wed, 1 Feb 2023 20:14:42 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from plan-b.pwste.edu.pl (plan-b.pwste.edu.pl [IPv6:2001:678:618::40]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "plan-b.pwste.edu.pl", Issuer "GEANT OV RSA CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4P6Y6p1gbTz3wrL for ; Wed, 1 Feb 2023 20:14:42 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Authentication-Results: mx1.freebsd.org; none Received: from [192.168.7.70] (dom.potoki.eu [62.133.140.50]) (authenticated bits=0) by plan-b.pwste.edu.pl (8.17.1/8.17.1) with ESMTPSA id 311KESnA067087 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Wed, 1 Feb 2023 21:14:29 +0100 (CET) (envelope-from zarychtam@plan-b.pwste.edu.pl) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=plan-b.pwste.edu.pl; s=plan-b-mailer; t=1675282470; bh=T6ElMDJIX2AcyeUT+ZNsN0eq6/FAJnw1yO0Fo2cJg98=; h=Date:To:Cc:References:From:Subject:In-Reply-To; b=gMf01PqMOu9hvyn8JZH1RQOXKRq8tRv9Fo3VmBmb1wpeOOd29/uKgD2XdPAu6Xz/E h8cv8v2UbJnyaLw+upFuUSmetfAkxw8/WGq7FW5Fp75curl3tqGV8jaIPP2wP1PWdS UnalBNJQxHTms+pF7XdkzOeT803GmaC+JsUALKPRJh/sIiQOfjp6Z9rWMn7VuHBQDf u/53WVrIiwlgMRwfSyKcaUtf6kvE+CO/r9T5et4XUHiLqNJOHO/aCM4tACKZIIeOfX zWVupBzZFf1G3TukGLp2Gm8LO+etj9XT/T2hPYyliQqjd2spr2sDJfELCILyyVCXR4 pigVTY3LvOYTA== X-Authentication-Warning: plan-b.pwste.edu.pl: Host dom.potoki.eu [62.133.140.50] claimed to be [192.168.7.70] Message-ID: Date: Wed, 1 Feb 2023 21:14:27 +0100 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.7.1 Content-Language: pl, en-US To: Paul Mather Cc: stable@freebsd.org References: <95EDCFCA-7E3F-458F-85A6-856D606B9D98@gromit.dlib.vt.edu> <4ed8b724-041f-f561-ae60-ab966aefbb68@plan-b.pwste.edu.pl> <282AF730-E5E0-4A50-9F47-E7301B36E5C8@gromit.dlib.vt.edu> <2ed582b9-b544-74bb-2047-99d04924b46b@plan-b.pwste.edu.pl> <8AE3B49C-6C7F-4A20-B2DC-0D4B1343FB59@gromit.dlib.vt.edu> <83E43236-60F8-4949-8840-54E66D327EE9@gromit.dlib.vt.edu> From: Marek Zarychta Subject: Re: Slow WAN traffic to FreeBSD hosts but not to Linux hosts---how to debug/fix? In-Reply-To: <83E43236-60F8-4949-8840-54E66D327EE9@gromit.dlib.vt.edu> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------oOJZwKLrW0ToGWFwxvjkqwIY" X-Rspamd-Queue-Id: 4P6Y6p1gbTz3wrL X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:206006, ipnet:2001:678:618::/48, country:PL] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------oOJZwKLrW0ToGWFwxvjkqwIY Content-Type: multipart/mixed; boundary="------------npqkMrGMtkisS9hPTh2XgOFc"; protected-headers="v1" From: Marek Zarychta To: Paul Mather Cc: stable@freebsd.org Message-ID: Subject: Re: Slow WAN traffic to FreeBSD hosts but not to Linux hosts---how to debug/fix? References: <95EDCFCA-7E3F-458F-85A6-856D606B9D98@gromit.dlib.vt.edu> <4ed8b724-041f-f561-ae60-ab966aefbb68@plan-b.pwste.edu.pl> <282AF730-E5E0-4A50-9F47-E7301B36E5C8@gromit.dlib.vt.edu> <2ed582b9-b544-74bb-2047-99d04924b46b@plan-b.pwste.edu.pl> <8AE3B49C-6C7F-4A20-B2DC-0D4B1343FB59@gromit.dlib.vt.edu> <83E43236-60F8-4949-8840-54E66D327EE9@gromit.dlib.vt.edu> In-Reply-To: <83E43236-60F8-4949-8840-54E66D327EE9@gromit.dlib.vt.edu> --------------npqkMrGMtkisS9hPTh2XgOFc Content-Type: multipart/alternative; boundary="------------1juhIJZ2T2YNrkGgKNMy09EZ" --------------1juhIJZ2T2YNrkGgKNMy09EZ Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: base64 VyBkbml1IDEuMDIuMjAyMyBvwqAyMDozMywgUGF1bCBNYXRoZXIgcGlzemU6DQo+IEl0IGxv b2tzIGxpa2Ugd2UgbWF5IGhhdmUgYSB3aW5uZXIsIGZvbGtzLiAgSSBidWlsdCBhbmQgZW5h YmxlZCB0aGUgZXh0cmEgVENQIHN0YWNrcyBhbmQgZm9yIHRoZSBmaXJzdCB0aW1lIHdhcyBh YmxlIHRvIG1heCBvdXQgbXkgY29ubmVjdGlvbiB0byB0aGUgcmVtb3RlIEZyZWVCU0Qgc3lz dGVtLiAgSSBnZXQgY29uc2lzdGVudGx5IGhpZ2hlciB0aHJvdWdocHV0IG92ZXIgdGhlIDE1 LWhvcCBXQU4gcGF0aCB0byB0aGUgcmVtb3RlIEZyZWVCU0Qgc3lzdGVtIHdoZW4gdXNpbmcg dGhlIFJBQ0sgVENQIHN0YWNrIHRoYW4gd2hlbiB1c2luZyB0aGUgZGVmYXVsdCAiZnJlZWJz ZCIgc3RhY2suDQo+DQo+IEFsdGhvdWdoIHRoZSBzcGVlZHMgYXJlIGNvbnNpc3RlbnRseSBo aWdoZXIgd2hlbiB1c2luZyB0aGUgc2V0dGluZyAibmV0LmluZXQudGNwLmZ1bmN0aW9uc19k ZWZhdWx0PXJhY2siLCB0aGV5IGFyZSBzdGlsbCB2YXJpYWJsZS4gIEhvd2V2ZXIsIHJhdGhl ciB0aGFuIHRoZSAzLS00IE1CL3MgSSBzYXcgdGhhdCBraWNrZWQgb2ZmIHRoaXMgdGhyZWFk LCBJIG5vdyBhdmVyYWdlIG92ZXIgMTAgTUIvcy4NCj4NCj4gSSBhY3R1YWxseSBnZXQgdGhl IGJlc3QgcmVzdWx0cyB3aXRoICJuZXQuaW5ldC50Y3AuZnVuY3Rpb25zX2RlZmF1bHQ9YmJy IiAoaGF2aW5nIGxvYWRlZCB0Y3BfYmJyKS4gIFRoYXQgYmVoYXZlcyB2ZXJ5IG11Y2ggbGlr ZSB0aGUgTGludXggaG9zdHMgaW4gdGhhdCBzcGVlZHMgY2xpbWIgdmVyeSBxdWlja2x5IHVu dGlsIGl0IHNhdHVyYXRlcyB0aGUgV0FOIGNvbm5lY3Rpb24uICBJIGdldCB0aGUgc2FtZSBo aWdoIHNwZWVkcyBmcm9tIHRoZSByZW1vdGUgRnJlZUJTRCBzeXN0ZW0gdXNpbmcgdGNwX2Ji ciBhcyBJIGRvIHRvIHRoZSBMaW51eCBob3N0cy4gIEkgd2lsbCBzdGljayB3aXRoIHRjcF9i YnIgZm9yIG5vdyBhcyB0aGUgZGVmYXVsdCBvbiBteSByZW1vdGUgRnJlZUJTRCBzZXJ2ZXJz LiAgSXQgYXBwZWFycyB0byBwdXQgdGhlbSBvbiBhIHBhciB3aXRoIExpbnV4IGZvciB0aGlz IFdBTiBsaW5rLg0KDQpUaGFua3MgZm9yIHRoZSBmZWVkYmFjayBQYXVsLiBQbGVhc2UgYmVh ciBpbiBtaW5kIHRoYXQgQkJSIDEgd2hpY2ggaXMgDQppbXBsZW1lbnRlZCBpbiBGcmVlQlNE IGlzIG5vdCBhIGZhaXJbMV0gY29uZ2VzdGlvbiBjb250cm9sIGFsZ29yaXRobS4gDQpNYXli ZSBpbiB0aGUgZnV0dXJlLCB3ZSB3aWxsIGhhdmUgQkJSIHYyIGluIHRoZSBzdGFjaywgYnV0 IGZvciBub3csIEkgDQpkb24ndCByZWNvbW1lbmQgdXNpbmcgQkJSLCB1bmxlc3MgeW91IHdh bnQgdG8gYWN0IHNsaWdodGx5IGFzIGEgaG0uLi4uIA0KbmV0d29yayBsZWVjaGVyLiBNYXli ZSBMaW51eCBob3N0cyBiZWhhdmUgdGhpcyB3YXksIG1heWJlIHRoZXkgaGF2ZSANCmltcGxl bWVudGVkIEJCUiB2MiwgSSBhbSBub3QgZmFtaWxpYXIgd2l0aCBMaW51eCBUQ1Agc3RhY2sg ZW5oYW5jZW1lbnRzLiANCk9uIHRoZSBvdGhlciBoYW5kLCB0Y3BfcmFjayg0KSBpcyBwZXJm b3JtYW50LCB3ZWxsLXRlc3RlZCBpbiB0aGUgRnJlZUJTRCANCnN0YWNrLCBjb25zaWRlcmVk IGZhaXIgYW5kIG1vcmUgYWNjZXB0YWJsZSBmb3IgYSBmaWxlc2VydmVyLCB0aG91Z2ggbm90 IA0KaWRlYWwsIGllLiBwcm9iYWJseSBtb3JlIGNvbXB1dGF0aW9uYWxseSBleHBlbnNpdmUg YW5kIHN0aWxsIG1pc3NpbmcgDQpzb21lIGZlYXR1cmVzIGxpa2UgVENQLU1ENS4NCg0KWzFd IGh0dHBzOi8vd3d3Lm1kcGkuY29tLzE0MjQtODIyMC8yMS8xMi80MTI4DQoNCg0KQ2hlZXJz DQoNCi0tIA0KTWFyZWsgWmFyeWNodGENCg0K --------------1juhIJZ2T2YNrkGgKNMy09EZ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
W dniu 1.02.2023 o=C2=A020:33, Paul Ma= ther pisze: 
It looks like we may have a =
winner, folks.  I built and enabled the extra TCP stacks and for the firs=
t time was able to max out my connection to the remote FreeBSD system.  I=
 get consistently higher throughput over the 15-hop WAN path to the remot=
e FreeBSD system when using the RACK TCP stack than when using the defaul=
t "freebsd" stack.

Although the speeds are consistently higher when using the setting "net.i=
net.tcp.functions_default=3Drack", they are still variable.  However, rat=
her than the 3--4 MB/s I saw that kicked off this thread, I now average o=
ver 10 MB/s.

I actually get the best results with "net.inet.tcp.functions_default=3Dbb=
r" (having loaded tcp_bbr).  That behaves very much like the Linux hosts =
in that speeds climb very quickly until it saturates the WAN connection. =
 I get the same high speeds from the remote FreeBSD system using tcp_bbr =
as I do to the Linux hosts.  I will stick with tcp_bbr for now as the def=
ault on my remote FreeBSD servers.  It appears to put them on a par with =
Linux for this WAN link.

https://www.mdpi.com/1424-8220/21/12/4128


Cheers

--=20
Marek Zarychta
--------------1juhIJZ2T2YNrkGgKNMy09EZ-- --------------npqkMrGMtkisS9hPTh2XgOFc-- --------------oOJZwKLrW0ToGWFwxvjkqwIY Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEnjwyTmqn2oNX6C8qHZW8vIFppoIFAmPayCMFAwAAAAAACgkQHZW8vIFppoKk /wf/W7qkjE1lkJPFLmhobbvHb51raYKTMEC590cMQKQWAe5zLveiIQou1ABiWKM/9qzThaPByc45 axnTvl3ABqd/Lr6z0k4MZFLkhfZzPs/iUHYWOlPvjCv2L2HiZq8I/MHZib1LLTJasmrk/MIbjKgs 2R+An9qvyXv9RcdvV/ZMVHkHCKyFdmGkZ30eFx4TayCfibLbfF9Py92VrgotC43PiNNRfvP0VxjX wk/sJuszfr5ND4KaRGMZJP4FKWqQuFUoNV4Vd9sl3Td4rQGyB2YOVugmzfbgO9TQZta6m1CLCecT gTg482tb+TOcEEqyyQtQQnSJe1GvQ4WK9F8tHLzJcA== =OCFE -----END PGP SIGNATURE----- --------------oOJZwKLrW0ToGWFwxvjkqwIY--