From nobody Tue Oct 19 18:35:14 2021 X-Original-To: dev-ci@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7D18F1816D89 for ; Tue, 19 Oct 2021 18:35:52 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-io1-f51.google.com (mail-io1-f51.google.com [209.85.166.51]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HYj9c3wm2z3h1r; Tue, 19 Oct 2021 18:35:48 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-io1-f51.google.com with SMTP id i189so21579173ioa.1; Tue, 19 Oct 2021 11:35:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=jYvB6oUvy6N2QD+AoW8yaIIgvnRqQBqSvYBj+o4I1ck=; b=NRuhllYzd31u3eKebGBuGIUrmZjj9bgXsasi1jGnMggh5aUaq5p0IYt7Kin5vngV+f KEvcmeM7Hvjcl0rms034BNOmIFloDsKezDvnxyHc05Bd2r7R80r3ZQIlx7313SBf2VUs BXn2rkmtVRzcUqodah0TF/Sd7EK0Xg5bdoW+8uYTDtX7+z1qbkZS6aMYbttnrbbaJ7rP Az9j8FwL3HPmPtdDskFGSmFpoE1LPWEoEq1PrTN8Nx49z8/4bMcZbjRiitlY241ilKqh mXFBxrqXfdaPZ9vzPMMiFLuxb0tCgJhsdDwT+dqmgRYduSdUzQFVbe3D9RsL7BnIdStr BSZg== X-Gm-Message-State: AOAM532jOc1pFKpcH8XFPx7mldBIxMEG5iGgHdy7+enXVjQnGA3Tq6kB bwXnkk0GvhVDlldi0FjGXCsAguhvbbHpxGmUzcAZyLEQXEs= X-Google-Smtp-Source: ABdhPJwnZsl8b8HUkr1gEsbQS33rXRdEp+cglil7iQnxgtFuPYmG9Xf4BScL5V0x+g61SSwkEc+7bC1c9E4i6uZnZtQ= X-Received: by 2002:a5d:9d9a:: with SMTP id ay26mr19935618iob.37.1634668541557; Tue, 19 Oct 2021 11:35:41 -0700 (PDT) List-Id: Continuous Integration Build and Test Results List-Archive: https://lists.freebsd.org/archives/dev-ci List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-ci@freebsd.org X-BeenThere: dev-ci@freebsd.org MIME-Version: 1.0 References: <198014378.1711.1634250618738@jenkins.ci.freebsd.org> In-Reply-To: <198014378.1711.1634250618738@jenkins.ci.freebsd.org> From: Ed Maste Date: Tue, 19 Oct 2021 14:35:14 -0400 Message-ID: Subject: Re: FreeBSD-main-amd64-test - Build #19523 - Unstable To: jenkins-admin@freebsd.org Cc: dev-ci@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4HYj9c3wm2z3h1r X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.51 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-1.29 / 15.00]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[carpeddiem]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[freebsd.org]; NEURAL_SPAM_MEDIUM(0.56)[0.556]; RCVD_TLS_ALL(0.00)[]; NEURAL_HAM_LONG(-0.92)[-0.923]; NEURAL_HAM_SHORT(-0.92)[-0.922]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.51:from]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.51:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Thu, 14 Oct 2021 at 18:30, wrote: > > FreeBSD-main-amd64-test - Build #19523 (86929782cfab2664010a31979e9e3c0626721ebb) - Unstable > > Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19523/ > Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19523/changes > Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19523/console > > Status explanation: > "Unstable" - some tests are suspected being broken by the following changes > "Still Unstable" - the failing test cases have not been fixed by these > following changes and this is a notification to note that > these changes have not been fully tested by the CI system > > Change summaries: > (Those commits are likely but not certainly responsible) > > 1adebca1fc9f6def501f7a5c2b2bde5fe9049477 by kib: > Style > > 86929782cfab2664010a31979e9e3c0626721ebb by kib: > Fix typo in comment > > > > The failed test cases: > > 1 tests failed. > FAILED: sys.netpfil.pf.killstate.v6 > > Error Message: > atf-check failed; see the output of the test for details I wonder how we can make the test results more accessible, so that a committer can quickly determine that this is most likely a false positive unrelated to their change (as here). Perhaps a link to the individual test results, i.e. https://ci.freebsd.org/job/FreeBSD-main-amd64-test/19523/testReport/junit/sys.netpfil.pf/killstate/v6/? Although it would be really nice if we could include a useful line or two from the test output I think it's unfeasible to programmatically find the appropriate information, and it may not exist anyway. (In this case the best we can probably extract is "Fail: incorrect exit status: 1, expected: 0" which is not really any help.)