From nobody Wed Dec 15 17:55:09 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 76C8918EED0D for ; Wed, 15 Dec 2021 17:55:21 +0000 (UTC) (envelope-from freebsd@walstatt-de.de) Received: from smtp6.goneo.de (smtp6.goneo.de [85.220.129.31]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JDjZc2ySPz3Drs; Wed, 15 Dec 2021 17:55:20 +0000 (UTC) (envelope-from freebsd@walstatt-de.de) Received: from hub2.goneo.de (hub2.goneo.de [85.220.129.53]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by smtp6.goneo.de (Postfix) with ESMTPS id E3A4610A330B; Wed, 15 Dec 2021 18:55:12 +0100 (CET) Received: from hub2.goneo.de (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by hub2.goneo.de (Postfix) with ESMTPS id BAFBC10A3306; Wed, 15 Dec 2021 18:55:10 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=walstatt-de.de; s=DKIM001; t=1639590910; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vVXJS17lt1JxvufbXE3HFQwMAhT5tI2metcYQJBms1g=; b=EVqYArolJYI7sXkkpXdNkhs92FQkv+pY2/PmAVtbPvcMaMwEDKvZ4ZzlynalxOqnFlDQE8 q1047lM+SDGXuOKEb9TxOTjqkleWCPw8IskbsnxvSRmQZ3cOL4SOrW7eHIU5RtVmFAKggC FaUybZ3Lrtj95mi5Lq3UzIc2UI4+v+nbw7WphGVKg4nsI8zacdsbn8NINNUvGDI8OG1ilW h7PSbTWLq9gKiL2BbIMc6x/Oej3XbcMKcrVE8sJ38eBgdVakyJUmI30F3G+in/nXPamuQw aB3sDRuQTfPT4Ll0/eVV0leBeZ7KJqg0nO5fHSAWbho+iqZaGdzpvQM7YLa06Q== Received: from hermann (dynamic-2a01-0c22-a812-e800-10cb-84b6-cf83-eaeb.c22.pool.telefonica.de [IPv6:2a01:c22:a812:e800:10cb:84b6:cf83:eaeb]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by hub2.goneo.de (Postfix) with ESMTPSA id 85F0110A330C; Wed, 15 Dec 2021 18:55:10 +0100 (CET) Date: Wed, 15 Dec 2021 18:55:09 +0100 From: FreeBSD User To: Andriy Gapon Cc: Alan Somers , FreeBSD CURRENT Subject: Re: CURRENT: ZFS freezes system beyond reboot Message-ID: <20211215185509.310fc873@hermann> In-Reply-To: References: <20211212102032.08af9689@jelly.fritz.box> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-UID: a2fd9e X-Rspamd-UID: 613b50 X-Rspamd-Queue-Id: 4JDjZc2ySPz3Drs X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=walstatt-de.de header.s=DKIM001 header.b=EVqYArol; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd@walstatt-de.de has no SPF policy when checking 85.220.129.31) smtp.mailfrom=freebsd@walstatt-de.de X-Spamd-Result: default: False [-2.86 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[walstatt-de.de:s=DKIM001]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[walstatt-de.de]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[walstatt-de.de:+]; NEURAL_HAM_SHORT(-0.96)[-0.964]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:25394, ipnet:85.220.128.0/17, country:DE]; RCVD_TLS_ALL(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[85.220.129.31:from] X-ThisMailContainsUnwantedMimeParts: N On Mon, 13 Dec 2021 09:30:50 +0200 Andriy Gapon wrote: > On 12/12/2021 18:45, Alan Somers wrote: > > You need to look at what's causing those errors. What kind of disks > > are you using, with what HBA? It's not surprising that any access to > > ZFS hangs; that's what it's designed to do when a pool is suspended. > > However, a pool does not have to be suspended on errors. > failmode property provides a couple of alternatives: > wait Blocks all I/O access until the device connectivity is > recovered and the errors are cleared. This is the > default behavior. > > continue Returns EIO to any new write I/O requests but allows > reads to any of the remaining healthy devices. Any > write requests that have yet to be committed to disk > would be blocked. > > panic Prints out a message to the console and generates a > system crash dump. > > But neither does any magic. > The errors will still be there. > Hello. The error's cause was not obvous. I used a SSD, partioned into two halfes, one for ZIL, the other for L2ARC. When showing "zpool status", the RAIDZ's HDDs (Hitachi/Seagate 4 TB NAS HDD) where "online", ZIL was "online" and L2ARC device/vdev showd - nothing. I had to power off/power on the box. For several hours nothing moved on, the box was frozen, any invocation of any ZFS volume related tool/command hanged the terminal/console. Several datasets showed errors at <0x0>, nothing serious. After deleting the ZIL and L2ARC extra SSD from the RAIDZ pool, verything went to normal again. It is spooky, if not to say "buggy", if ZFS is capable of freezing the whole box even if the essential operating system stuff is isolated on a dedicated UFS filesystem. Kind regards, O. Hartmann