Re: Odd fetch failure when using https://git.FreeBSD.org/src.git ("curl 18 transfer closed with outstanding read data remaining")

From: Philip Paeps <philip_at_freebsd.org>
Date: Sat, 09 Dec 2023 03:52:52 UTC
On 2023-12-09 10:48:49 (+0800), Mark Millard wrote:
> On Dec 8, 2023, at 18:19, Philip Paeps <philip@freebsd.org> wrote:
>> On 2023-12-09 05:34:05 (+0800), Mark Millard wrote:
>>> On multiple system on the same local network, when I have:
>>>
>>> [remote "freebsd"]
>>>        fetch = +refs/notes/*:refs/notes/*
>>>        url = https://git.FreeBSD.org/src.git
>>>        fetch = +refs/heads/*:refs/remotes/freebsd/*
>>>
>>> I've been getting:
>>>
>>> # git -C /usr/main-src/ fetch
>>> error: RPC failed; curl 18 transfer closed with outstanding read 
>>> data remaining
>>> error: 59 bytes of body are still expected
>>> fatal: expected flush after ref listing
>>
>> Some of the mirrors are running out of space.  We're really tight on 
>> space in a couple of locations while we have to support 12.4, 13.2, 
>> 14.0 and 15-CURRENT packages.  We'll be in much better shape again 
>> when we can stop building/distributing 12.4 packages at the end of 
>> this year.
>>
>> (We do monitor disk space.  We also have automation that tries to 
>> stop disks from getting full.  Unfortunately, the automation 
>> struggles when there is very little margin.  And we don't have human 
>> bandwidth to babysit the automation.)
>
> armv6 is tier 3 for 14.x : https://www.freebsd.org/platforms/
>
> Would temporarily removing having:
>
> https://pkg.freebsd.org/FreeBSD:14:armv6/latest/...
>
> files on the various mirrors until 12.x is gone be of some use?
> (May be even removed on the original servers.)
>
> (Just an idea, given the lack of guarantees for tier 3.)
>
> https://pkg.freebsd.org/FreeBSD:14:armv6/latest/... could be
> repopulated after 12's materials are gone from the mirrors
> (and other servers).

Thanks for pointing those out.  That'll buy us a bit more time without 
having to resort to more brute force methods (like temporarily breaking 
up mirrored pairs of disks.) :-)

Philip

-- 
Philip Paeps
Senior Reality Engineer
Alternative Enterprises