From nobody Tue Dec 14 00:51:54 2021 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8DAC918D1EDF for ; Tue, 14 Dec 2021 00:51:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JCfwB27Kbz4nZ0 for ; Tue, 14 Dec 2021 00:51:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2A4491ED09 for ; Tue, 14 Dec 2021 00:51:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BE0psv0081436 for ; Tue, 14 Dec 2021 00:51:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BE0psUX081424 for bugs@FreeBSD.org; Tue, 14 Dec 2021 00:51:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 260399] freebsd-update: Downloading patches often fails repeatedly Date: Tue, 14 Dec 2021 00:51:54 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: somesignup@icloud.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: koobs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639443114; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BfBdhyDJgtbsqzgXNgpvgXfiNRVY5fOGfpLw+Tg9erw=; b=bfU6eRfh4UtUZ7w2EnUIgoe1o1vP/rOEj0ffeZBfULg3/SeFqeq5xQCMB7jkisJeG1NowS /JLXsK9g8U//JjYR1y09uEkTK9ChE91QoAef6dgIim5ygI/Fo98s52s6fKp7IeVyWI2NJN w0KdSTs7G5dzJ0WnjR8rhKCxOiz62LQyoGTV3291WmFXYMfEZVCIgl/uKHCiAM+rxsubGL sGWFZ2BJYUE/L4sqMSKnxIqeUrh/6Dgwdc3Gg+XM7LXsepHBzCJ4DiqexxUVF67X2uvVr9 rzdC5DXMvF4iH3crXnmcL/SRitVALZQonrBRWd8uNd58/gfXsOaRP4YcQcvp6w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639443114; a=rsa-sha256; cv=none; b=eYmi6vUvqw/4WhfM1P1iflBP59fDmu0mRQikZApDEjYCpIvCV7B8ulqXgGn+VQ+9F5OMz+ bt2XSbIVcP0hJcru5B2PUgcVpCoDichtraURCpN7BmV0O3R8oArsr1p/GAMjXyl+sBSJjH gBm8XFLwP7fLbvi8ACQu9FRry/4JYDV9TYP7FsllyNEa/7/XA/hJSj6qI/FUW/wEJX6S14 RgQrdxWuVW8Etzu9wbRYmRepv9HSe1W7FEKClm3KNVsVujFmYJxeiKcanIlHNn5QMd2VB9 s4Nrmkq+LWAXyBsyaVV446GFaOQkc+HNzCUkHNMVWJ9y0UozXjto43LN1dWcvA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260399 --- Comment #2 from Some Signup --- It's not related to a version of FreeBSD. It's related solely to freebsd-up= date itself (and portsnap). The simple fact is freebsd-update is not a reliable tool. I am willing to b= et that if I wrote a dead simple shell script to iterate over a list of 7736 f= iles and to fetch/curl/wget/whatever them one at a time I would get 7736 (or clo= se to that) files at the first attempt. And if I had a file with mapping files= to checksums, I could check each file and see if it matches, and if any one or more files do not match their checksums or were not fetched, I could re-fet= ch them. I would report that at the end of the big fetch process, and retry ju= st the files with mismatched checksums. But apparently that is too much for freebsd-update and portsnap to handle. Instead it wants to refetch thousand= s of patches files all over again. Seriously... this is utter madness. I do not = for one second believe that, in the example shown below, 7129 patches were some= how broken the first time round. It just don't believe it. At some point you ha= ve to look at the individual tool and not the system as a whole. Now, I'm aware that freebsd-update does a lot more than just fetch a load of files. But this is where it fails. I am not alone in seeing this.=20 I've used FreeBSD for over 20 years and I'm a big fan. I've even bought Fre= eBSD goodies to directly support the project. But I have to be honest and vent my spleen here about this sub-standard tool. It really is not good enough.=20 I manage numerous machines remotely. They are not even in the same country.= I am not confident in freebsd-update to update them to a new release. Patch l= evel updates work, seemingly because not 'too many' files are involved. But rele= ase -> release updates are a whole different thing. The fault is solely with freebsd-update (and its ugly cousin portsnap). I've read the reports, and I know that it is not me doing something wrong nor the way my systems are configured. If you think it's related to any of my machines, it is not. In which case h= ere is some useless information : root@bsddev-12:/usr/home/unhappyuser # freebsd-update upgrade -r 12.3-RELEA= SE Looking up update.FreeBSD.org mirrors... 2 mirrors found. Fetching metadata signature for 12.2-RELEASE from update2.freebsd.org... do= ne. Fetching metadata index... done. Fetching 1 metadata files... done. Inspecting system... done. The following components of FreeBSD seem to be installed: kernel/generic src/src world/base world/doc world/lib32 The following components of FreeBSD do not seem to be installed: kernel/generic-dbg world/base-dbg world/lib32-dbg Does this look reasonable (y/n)? y Fetching metadata signature for 12.3-RELEASE from update2.freebsd.org... do= ne. Fetching metadata index... done. Fetching 1 metadata patches. done. Applying metadata patches... done. Fetching 1 metadata files... done. Inspecting system... done. Fetching files from 12.2-RELEASE for merging... done. Preparing to download files... done. Fetching 41704 patches.....10.. ... ....41690....41700.. done. Fetching 7736 files... ....10....20 ... ....7730... failed. Today this is trying to update from 12.2-RELEASE-p7 -> 12.3 RELEASE. But I'= ve seen it going back for ages and ages. This is connecting to: 69.11.15.204.in-addr.arpa is an alias for 69.64/27.11.15.204.in-addr.arpa. 69.64/27.11.15.204.in-addr.arpa domain name pointer update2.freebsd.org. --=20 You are receiving this mail because: You are on the CC list for the bug.=