From nobody Fri Jun 17 22:29:32 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3CA068427C9 for ; Fri, 17 Jun 2022 22:29:41 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-qv1-xf29.google.com (mail-qv1-xf29.google.com [IPv6:2607:f8b0:4864:20::f29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LPtyD1lfYz3NH3 for ; Fri, 17 Jun 2022 22:29:40 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-qv1-xf29.google.com with SMTP id t16so3384617qvh.1 for ; Fri, 17 Jun 2022 15:29:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:message-id:date:mime-version:user-agent:subject :content-language:from:to:cc:references:in-reply-to :content-transfer-encoding; bh=hj5PrRFHEL+z9fbJcec5aPX3QBV1Lorme9MUnI0xGy0=; b=SQGS2GK6E2KLQinc6BTUYkofHb4ffWr0brHiIf+ds75nyEQ4R4hy+MPEePXnKeBNcF evXgA44AW5ky32ucs6+M8MwMSY+CT0hcGAUBe5MMb6ybM0+v5h6jT2i9VyhQnkNPE+8s PFx8fwUGn/G19nhA8juQPmuGm2zWU2v+Y2baCIVDJwU4t1GR00qhtSjvFY3ZRTcwIQA1 f5Dbt4IEmgelqcH9Ypgq8V+4eoILRlQyhtHSyUwMYQnC5x8vrJug6cq1/kcKYa9NPN7G PcNUPzNjfek1MlPJM03nMVrZcKbLHjmEoEiE93lCKPemCE/vYYfy39C1p+YQ8pZNZr4C 3KiA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:message-id:date:mime-version:user-agent :subject:content-language:from:to:cc:references:in-reply-to :content-transfer-encoding; bh=hj5PrRFHEL+z9fbJcec5aPX3QBV1Lorme9MUnI0xGy0=; b=V29lsuoHGgxV9fwtHPdyMRrP54ATR4bTycxt8eQukAaHgK7rCLqhDbJwk5Nr28s2NV sR5OIBN4EK1vhytY/7sYsJ91uRUZ32IEb6m2+4E0/uOsD7yw8RDd/Tc/bsEdmdF+1FvO OzWwlwD3I+xA+y41upqT1w+h+PsHx+5PYFBedWgrfoI05GMi+NrWuFiXyA8RiDFYdViI UWBoymuXfsb3hxBhR0XtL8maq9hBTO9xPxzN+m8kYYJMwSbbkdSweGqOEGYxzHC+J2Sw wsqpaCnsFRllJazlZVreZ3FswwuhORQLXxewYpZb/ZXY+8kWkQeQVF9HLx1j772sIiQ9 EN0g== X-Gm-Message-State: AJIora8tKCuMAf0W5YiNRdBRmUGATaY2V6hYwxv/h0936zcxhgJaGv6U zqCeCCu7SNYnfSqLO7B/VpX90ic6O90= X-Google-Smtp-Source: AGRyM1tT7yeN7GmYMHwIv+1eF2AfCinUzkxZASzD/chH18m9TM8OlPxPFWu2r7RiOetDz8P1e2lN+w== X-Received: by 2002:a0c:d606:0:b0:46e:7d91:15e2 with SMTP id c6-20020a0cd606000000b0046e7d9115e2mr7406945qvj.45.1655504973979; Fri, 17 Jun 2022 15:29:33 -0700 (PDT) Received: from [10.231.1.66] (075-130-069-034.biz.spectrum.com. [75.130.69.34]) by smtp.gmail.com with ESMTPSA id cj11-20020a05622a258b00b002f93ece0df3sm5175223qtb.71.2022.06.17.15.29.33 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 17 Jun 2022 15:29:33 -0700 (PDT) Message-ID: Date: Fri, 17 Jun 2022 18:29:32 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Thunderbird/91.9.0 Subject: Re: SAS/SATA controllers: 8 port that support 8TB Drives Content-Language: en-US From: Alexander Motin To: Larry Rosenman Cc: Freebsd current References: <96f9a47659ac052b8d806bb9b7ab2b51@lerctr.org> <1a795a4e-2b1e-2cba-484b-52811546e277@FreeBSD.org> <97624e2a4e0887ede029e71c47bb6060@lerctr.org> <9ad99f2c-3d63-ccab-f730-e355f0297d72@FreeBSD.org> In-Reply-To: <9ad99f2c-3d63-ccab-f730-e355f0297d72@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4LPtyD1lfYz3NH3 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=SQGS2GK6; dmarc=none; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::f29 as permitted sender) smtp.mailfrom=mavbsd@gmail.com X-Spamd-Result: default: False [-2.46 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.26)[-0.265]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[FreeBSD.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f29:from]; MLMMJ_DEST(0.00)[freebsd-current]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 17.06.2022 18:24, Alexander Motin wrote: > On 17.06.2022 18:16, Larry Rosenman wrote: >> On 06/17/2022 5:08 pm, Alexander Motin wrote: >>> On 17.06.2022 11:59, Larry Rosenman wrote: >>>> I'm looking to upgrade the controllers in my TrueNAS box to >>>> something that will >>>> support 8TB drives because apparently my LSI 2108 controllers do not >>>> support 8TB drives. >>>> >>>> What's the communities recommendation? >>>> needs to support SFF connectors for a total of 4 SFF connectors, as >>>> I have 16 slots. >>> >>> We at iX are still using LSI/Broadcom HBAs, just moved from long >>> discontinued mps(4) to newer mpr(4).  And I don't believe the problem >>> is directly related to capacity.  According to my observations it may >>> be Seagate HDDs of/above certain (8TB) generation.  We do not use >>> Seagate HDDs in our products, so about that instability I only heard >>> from forums and TrueNAS community user reports. >> >> This is a mfi(4) set of controllers, and a ST80000Nm0045 8TB (CMR) drive. >> >> Is this a bad combo? >> >> mfi0: 9973 (708793330s/0x0002/WARN) - PD 00(e0xfc/s3) is not supported >> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >> (probe0:mfi0:0:0:0): Retrying command, 3 more tries remain >> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >> (probe0:mfi0:0:0:0): Retrying command, 2 more tries remain >> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >> (probe0:mfi0:0:0:0): Retrying command, 1 more tries remain >> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >> (probe0:mfi0:0:0:0): Retrying command, 0 more tries remain >> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >> (probe0:mfi0:0:0:0): Error 5, Retries exhausted >> >> mfi0 Physical Drives: >>   0 (  932G) UNCONFIGURED GOOD >> SATA E1:S3 > > mfi(4) are RAIDs, not HBAs.  We do not recommend RAIDs with TrueNAS due > to problems with hot-plug, disk identification, etc. and so have limited > experience with them.  But I know some of LSI RAIDs can be reflashed > into equivalent HBAs, so if they share the hardware, I can speculate > that they may share some issues. I've just noticed "932G" instead of "8000G". It is obviously a bigger problem than what we heard for HBAs. It looks like a kind of problems that should not happen to HBAs, since they should not care about disk capacity. -- Alexander Motin