From nobody Wed Oct 18 16:19:51 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9bfN0WPJz4xDVn for ; Wed, 18 Oct 2023 16:19:56 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9bfM0fXCz4Krj for ; Wed, 18 Oct 2023 16:19:54 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of guru@unixarea.de designates 178.254.4.101 as permitted sender) smtp.mailfrom=guru@unixarea.de; dmarc=none Received: from [188.174.53.121] (helo=c720-1400094.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qt9Gy-00DA8M-O0 for freebsd-current@freebsd.org; Wed, 18 Oct 2023 18:19:52 +0200 Received: from c720-1400094.fritz.box (localhost [127.0.0.1]) by c720-1400094.unixarea.de (8.17.1/8.14.9) with ESMTP id 39IGJqgR002105 for ; Wed, 18 Oct 2023 18:19:52 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by c720-1400094.fritz.box (8.17.1/8.14.9/Submit) id 39IGJppV002104 for freebsd-current@freebsd.org; Wed, 18 Oct 2023 18:19:51 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: c720-1400094.fritz.box: guru set sender to guru@unixarea.de using -f Date: Wed, 18 Oct 2023 18:19:51 +0200 From: Matthias Apitz To: freebsd-current@freebsd.org Subject: Re: poudriere job && find jobs which received signal 11 Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: freebsd-current@freebsd.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 14.0-CURRENT r1400094 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.53.121 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.27 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.969]; R_SPF_ALLOW(-0.20)[+ip4:178.254.4.101]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[unixarea.de]; RCVD_COUNT_THREE(0.00)[3]; HAS_REPLYTO(0.00)[guru@unixarea.de]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; HAS_XOIP(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE]; REPLYTO_EQ_FROM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_XAW(0.00)[]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4S9bfM0fXCz4Krj El día miércoles, octubre 18, 2023 a las 12:10:27p. m. +0200, Alexander Leidinger escribió: > Am 2023-10-18 09:54, schrieb Matthias Apitz: > > Hello, > > > > I'm compiling with poudriere on 14.0-CURRENT 1400094 amd64 "my" ports, > > from git October 14, 2023. In the last two day 2229 packages were > > produced fine, on job failed (p5-Gtk2-1.24993_3 for been known broken). > > > > This morning I was looking for something in /var/log/messages and > > accidentally I detected that yesterday a few compilations failed: > > > > # grep 'signal 11' /var/log/messages | grep -v conftest > > Oct 17 10:58:02 jet kernel: pid 12765 (cc1plus), jid 24, uid 65534: > > exited on signal 11 (core dumped) > > Oct 17 10:59:32 jet kernel: pid 27104 (cc1plus), jid 24, uid 65534: > > exited on signal 11 (core dumped) > > Oct 17 12:07:38 jet kernel: pid 85640 (cc1plus), jid 24, uid 65534: > > exited on signal 11 (core dumped) > > Oct 17 12:08:17 jet kernel: pid 94451 (cc1plus), jid 24, uid 65534: > > exited on signal 11 (core dumped) > > Oct 17 12:36:01 jet kernel: pid 77914 (cc1plus), jid 24, uid 65534: > > exited on signal 11 (core dumped) > > > > As I said, without that any of the 2229 jobs were failing: > > > > # cd /usr/local/poudriere/data/logs/bulk/140-CURRENT-ports20231014/latest-per-pkg > > # ls -C1 | wc -l > > 2229 > > # grep -l 'build failure' * > > p5-Gtk2-1.24993_3.log > > > > How this is possible, that the make engines didn't failing? The uid > > That can be part of configure runs which try to test some features. > > > 65534 is the one used by poudriere, can I use the jid 24 somehow to find > > the job which received the signal 11? Or is the time the only way to > > jid = jail ID, the first column in the output of "jls". If you have the > ... Thanks for the detailed explanation and hints. I don't have logged the stdout of the poudriere, I only have the build logs of all 2229 jobs. I managed to identify the 47 builds which where running at that time between 10:00 and 13:00 (with some grep commands, cutting away all builds which ended before 10:00, and then all which started after 13:00). I run the build for the 47 ports again, one after the other with only one builder. The culprit seems to be lang/gcc10 which is still running at the moment of typing but already produce again two times: Oct 18 17:44:45 jet kernel: pid 21011 (cc1plus), jid 169, uid 65534: exited on signal 11 (core dumped) Oct 18 17:45:17 jet kernel: pid 30102 (cc1plus), jid 169, uid 65534: exited on signal 11 (core dumped) Will dig into its build log later ... Yours matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub