From nobody Fri Jun 17 22:55:50 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B92CB850070 for ; Fri, 17 Jun 2022 22:55:51 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LPvXR1Gm8z3k4t; Fri, 17 Jun 2022 22:55:51 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Content-Transfer-Encoding:Content-Type:Message-ID:References: In-Reply-To:Subject:Cc:To:From:Date:MIME-Version:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=nvr5lt9k32EqqrBsWnUmayCwz3yadV7Ttv8lbEIuw/U=; b=fBp/ZbkfMgwtHo6d9mwkcQzxNU Ea7/ogymEz3cUtKIdkxN9kCaXcVzCDTqxgNjPyYFT98H22iNRVugOIN/ZsZtdaBLuWQOAdErFMOY6 2rxZmOdGLBd8vWhiX9Ok6TP/h3f6tM4OCRLaXmis+47QOg9kv3Hp4sfBpJ/iPdD6/LDwXOdjXkzYI Ex0vRAqNqXRoP/LgNVLt+G/2jhZp1YSBU8PJylzRHaDbitdVwDA3jJv4/fYQ9sR3d2G5sDXnScHLt 6L2NpSFdc4N01G7Ycbn1WRzzJKjGE7EbZKI4uYYsPMBDvHW8wkCAXUEPxAGpBXIxwPpd44rp23IqV ySOiW0yw==; Received-SPF: pass (thebighonker.lerctr.org: domain of lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) client-ip=2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4; envelope-from=ler@lerctr.org; helo=webmail.lerctr.org; Received: from thebighonker.lerctr.org ([2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]:13437 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.95 (FreeBSD)) (envelope-from ) id 1o2KsY-0004Fj-NX; Fri, 17 Jun 2022 17:55:50 -0500 Received: from 2600:1700:210:b18f:a50f:a95f:95c7:2c5e by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Fri, 17 Jun 2022 17:55:50 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Date: Fri, 17 Jun 2022 17:55:50 -0500 From: Larry Rosenman To: Michael Gmelin Cc: Alexander Motin , Freebsd current Subject: Re: SAS/SATA controllers: 8 port that support 8TB Drives In-Reply-To: <32B35839-84F9-4BDC-B8B5-AF576E21041C@freebsd.org> References: <32B35839-84F9-4BDC-B8B5-AF576E21041C@freebsd.org> Message-ID: X-Sender: ler@lerctr.org Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4LPvXR1Gm8z3k4t X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=lerctr.org header.s=ler2019 header.b="fBp/Zbkf"; dmarc=pass (policy=none) header.from=lerctr.org; spf=pass (mx1.freebsd.org: domain of ler@lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) smtp.mailfrom=ler@lerctr.org X-Spamd-Result: default: False [-2.63 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[lerctr.org:s=ler2019]; FREEFALL_USER(0.00)[ler]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.37)[0.367]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[lerctr.org:+]; DMARC_POLICY_ALLOW(-0.50)[lerctr.org,none]; MLMMJ_DEST(0.00)[freebsd-current]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:55103, ipnet:2602:fcdb::/36, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 06/17/2022 5:48 pm, Michael Gmelin wrote: >> On 18. Jun 2022, at 00:31, Alexander Motin wrote: >> >>  >> >>> On 17.06.2022 18:24, Alexander Motin wrote: >>>> On 17.06.2022 18:16, Larry Rosenman wrote: >>>> On 06/17/2022 5:08 pm, Alexander Motin wrote: >>>>> On 17.06.2022 11:59, Larry Rosenman wrote: >>>>>> I'm looking to upgrade the controllers in my TrueNAS box to >>>>>> something that will >>>>>> support 8TB drives because apparently my LSI 2108 controllers do >>>>>> not support 8TB drives. >>>>>> >>>>>> What's the communities recommendation? >>>>>> needs to support SFF connectors for a total of 4 SFF connectors, >>>>>> as I have 16 slots. >>>>> >>>>> We at iX are still using LSI/Broadcom HBAs, just moved from long >>>>> discontinued mps(4) to newer mpr(4). And I don't believe the >>>>> problem >>>>> is directly related to capacity. According to my observations it >>>>> may >>>>> be Seagate HDDs of/above certain (8TB) generation. We do not use >>>>> Seagate HDDs in our products, so about that instability I only >>>>> heard >>>>> from forums and TrueNAS community user reports. >>>> >>>> This is a mfi(4) set of controllers, and a ST80000Nm0045 8TB (CMR) >>>> drive. >>>> >>>> Is this a bad combo? >>>> >>>> mfi0: 9973 (708793330s/0x0002/WARN) - PD 00(e0xfc/s3) is not >>>> supported >>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>>> (probe0:mfi0:0:0:0): Retrying command, 3 more tries remain >>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>>> (probe0:mfi0:0:0:0): Retrying command, 2 more tries remain >>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>>> (probe0:mfi0:0:0:0): Retrying command, 1 more tries remain >>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>>> (probe0:mfi0:0:0:0): Retrying command, 0 more tries remain >>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>>> (probe0:mfi0:0:0:0): Error 5, Retries exhausted >>>> >>>> mfi0 Physical Drives: >>>> 0 ( 932G) UNCONFIGURED GOOD >>> serial=ZA1AC912> SATA E1:S3 >>> mfi(4) are RAIDs, not HBAs. We do not recommend RAIDs with TrueNAS >>> due to problems with hot-plug, disk identification, etc. and so have >>> limited experience with them. But I know some of LSI RAIDs can be >>> reflashed into equivalent HBAs, so if they share the hardware, I can >>> speculate that they may share some issues. >> >> I've just noticed "932G" instead of "8000G". It is obviously a bigger >> problem than what we heard for HBAs. It looks like a kind of problems >> that should not happen to HBAs, since they should not care about disk >> capacity. >> > > What does `smartctl -a ` report (especially sector sizes)? > > -m > > >> -- >> Alexander Motin >> It's not even making a mfid* node (it is a 4Kn disk) -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106