From nobody Mon Sep 11 00:46:58 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkSj268bdz4sjVR; Mon, 11 Sep 2023 00:47:02 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-oo1-xc30.google.com (mail-oo1-xc30.google.com [IPv6:2607:f8b0:4864:20::c30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkSj16FwQz4LGd; Mon, 11 Sep 2023 00:47:01 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=VAFbChq7; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::c30 as permitted sender) smtp.mailfrom=mavbsd@gmail.com; dmarc=none Received: by mail-oo1-xc30.google.com with SMTP id 006d021491bc7-5735282d713so2503973eaf.2; Sun, 10 Sep 2023 17:47:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694393221; x=1694998021; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:from:to:cc:subject:date:message-id:reply-to; bh=buJAsJJVHxKaYmZsgABtVavZ3eRTKrJqcejeMpZLNT4=; b=VAFbChq7mZl5fnk/siYjDIvNpyUmwoHma1oNrwz1sil3nREK/hcYBE8Rb/GijhuBDf 02r2+gHvHkkpRthj834Skj3sbgDHmz9hnyo7nBXJSDSI4w1qPPaje1qcrqQT6+HCpKz/ 5XGFE1f+GDh8GaIDXMVGQZ9l3vODoFtLnVXX5TpBEWnxHx11mo4owVeIbF25/gCQCQbV e/x3Ur8h+D7srJYtt64rmasn87M6CWDz/KE1vmbHIj6EVp38St+Ga6myhKmR5o5zp6pJ +Cj19/5H0ivBQjkrnL33A+KEfV66FpGTPYp9r6BWBNiEfcJw7rHka5k/8MZ/ZLkagIh8 A/ag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694393221; x=1694998021; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=buJAsJJVHxKaYmZsgABtVavZ3eRTKrJqcejeMpZLNT4=; b=lTu5dtdddFwBJfX1Jtbc+bXr45wTf6Uqq+vZl+yGepTGDXp1gycCQkSLyEJc69cyz4 kSWwH1YdYJjyIhjP/HHwGUYrZxCuPi69ujNc4oA6rvje6ujKypFQfiY23ry7JtGWXSzd wXFsZj7lqhlxxeDCd1W9lMO2bbFczji1YUnEG9WZkLCsoDjYMaxtYwYpsLJW9bL3xntc sNILgTIfiI9QOoW77qEQh6On1dyxA4YPhbTUV9n3OgZiyL+hiat/yZeGfgUpNWXFSpLa YLD9hS9QX1vByWmibPTyHxjeBavyXx8FLT26rMItWg6FoSlhLYavuOlalq3nAwhEecD3 2wzg== X-Gm-Message-State: AOJu0YwVELk5Nl/cuaYrWRzT/S8VxZftTUqL4YrL3GvTNCV3U0OXMvbl SfqDcbnZtyNEOQDOe5WlLFk= X-Google-Smtp-Source: AGHT+IH+4k+lh0keo1dafVbpLyOX1WKAGn+6LnyTdcrMifsrgzB3c140iu7B5bafB6vd2QzHILVjcQ== X-Received: by 2002:a05:6358:720e:b0:13c:a9c9:c04a with SMTP id h14-20020a056358720e00b0013ca9c9c04amr10006579rwa.20.1694393220750; Sun, 10 Sep 2023 17:47:00 -0700 (PDT) Received: from ?IPV6:2600:1700:3580:3560:228:f8ff:fe04:d12? ([2600:1700:3580:3560:228:f8ff:fe04:d12]) by smtp.gmail.com with ESMTPSA id n128-20020a0de486000000b00589c103d00asm1678719ywe.79.2023.09.10.17.46.59 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 10 Sep 2023 17:47:00 -0700 (PDT) Message-ID: Date: Sun, 10 Sep 2023 20:46:58 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics Content-Language: en-US To: Mark Millard , Martin Matuska , Glen Barber Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> <8746A218-F83A-40E7-95F8-5EC1E36411C1@yahoo.com> <1B343698-6865-4761-B514-1539AAE291BC@yahoo.com> From: Alexander Motin In-Reply-To: <1B343698-6865-4761-B514-1539AAE291BC@yahoo.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.19 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.992]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DMARC_NA(0.00)[freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c30:from]; ARC_NA(0.00)[]; BLOCKLISTDE_FAIL(0.00)[2600:1700:3580:3560:228:f8ff:fe04:d12:server fail,2607:f8b0:4864:20::c30:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,freebsd-stable@freebsd.org]; FREEMAIL_TO(0.00)[yahoo.com,FreeBSD.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkSj16FwQz4LGd On 09.09.2023 12:32, Mark Millard wrote: > On Sep 8, 2023, at 21:54, Mark Millard wrote: >> On Sep 8, 2023, at 18:19, Mark Millard wrote: >>> On Sep 8, 2023, at 17:03, Mark Millard wrote: >>>> On Sep 8, 2023, at 15:30, Martin Matuska wrote: >>>> On 9. 9. 2023 0:09, Alexander Motin wrote: >>>>> Thank you, Martin. I was able to reproduce the issue with your script and found the cause. >>>>> >>>>> I first though the issue is triggered by the `cp`, but it appeared to be triggered by `cat`. It also got copy_file_range() support, but later than `cp`. That is probably why it slipped through testing. This patch fixes it for me: https://github.com/openzfs/zfs/pull/15251 . >>>>> >>>>> Mark, could you please try the patch? > > I finally stopped it at 7473 built (a little over 13 hrs elapsed): > > ^C[13:08:30] Error: Signal SIGINT caught, cleaning up and exiting > [main-amd64-bulk_a-default] [2023-09-08_19h51m52s] [sigint:] Queued: 34588 Built: 7473 Failed: 23 Skipped: 798 Ignored: 335 Fetched: 0 Tobuild: 25959 Time: 13:08:26 > [13:08:30] Logs: /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-08_19h51m52s > [13:08:31] Cleaning up > [13:17:10] Unmounting file systems > Exiting with status 1 > > In part that was more evidence for deadlocks at least being fairly > rare as well. > > None of the failed ones looked odd. (A fair portion are because the > bulk -a was mostly doing WITH_DEBUG= builds. Many upstreams change > library names, some other file names, or paths used for debug > builds and ports generally do not cover well building the debug > builds for such. I've used these runs to extend my list of > exceptions that avoid using WITH_DEBUG .) So no evidence of > corruptions. Thank you, Mark. The patch was accepted upstream and merged to both master and zfs-2.2-release branches. -- Alexander Motin