From nobody Sun May 30 13:48:29 2021 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 22847C7DA91 for ; Sun, 30 May 2021 13:48:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FtKWd07NWz4mxR for ; Sun, 30 May 2021 13:48:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E171D1DF31 for ; Sun, 30 May 2021 13:48:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 14UDmSgV013308 for ; Sun, 30 May 2021 13:48:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 14UDmSJ9013307 for bugs@FreeBSD.org; Sun, 30 May 2021 13:48:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 256264] Devices behind PEX 8664 PCIe Switch not detected since 11.0-RELEASE Date: Sun, 30 May 2021 13:48:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: chris@acsi.ca X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256264 Bug ID: 256264 Summary: Devices behind PEX 8664 PCIe Switch not detected since 11.0-RELEASE Product: Base System Version: 13.0-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: chris@acsi.ca Hello, SUMMARY: I have not been able to upgrade past FreeBSD 10.3 as since versions 11.0 -> 13.0 devices behind my fileserver's PCIe Switch are not detected. The switch itself is detected, which is a PEX 8664 PCIe Switch, link below.=20 -- I'm using a Dell M610x blade server, which has a PEX/Broadcom 8664 Switch = in it to provide 2 PCIe slots, which I use to run SAS controllers to a drive array. This arrangement has worked perfectly since the early days of 7/8.0, and I= 've pretty much ran each version of FreeBSD since then, until 11.0 came out. This is when I could no longer see/detect devices plugged into the PCIe sl= ots. Things were busy, FreeBSD 10.2 worked well, so it was just left this way for years. Now I do need to upgrade software-wise to 13.0, so I've invested some time tracking down what is happening, with the hopes that a knowledgeable person= can fix this up.=20 - I have confirmed with 10.3-RELEASE and a 11.0-RELEASE mini-iso boot that= the problem starts in 11.0, and I can confirm it's still an issue in 12.0 and 1= 3.0. I also boot into a 10.2-RELEASE because I happen to have that handy.=20 Everything works/detects fine in 10.3 or lower.=20 - These are GENERIC kernels, fresh from the iso/img I boot from, nothing custom.=20 - I currently have a 10.2 (or 10.3) boot and a 13.0 boot ready to swap back and forth to try and isolate / probe info. I'll attach a few lspci dumps af= ter this message.=20 - The card in question is a LSI 2008 Chipset, mps0 - But it's nothing do do with that card/brand/config. I have also installed an Intel X540 Network ca= rd in the PCIe slots and find the same issue - There's nothing behind the PEC = 8664 in FreeBSD 13.0, and no problems in 10.2. I have also confirmed that 13.0 b= oots up and detects the mps0 without issue when I use a different system without= the PEX 8664 - At some point in my research I came across a similar issue where the developer mentioned that for some reason they were not scanning behind the switch. It was a different chipset and issue, and I don't have that thread handy at the moment, I will post if I come across it again.=20 Ref: https://www.broadcom.com/products/pcie-switches-bridges/pcie-switches/pex86= 64 I'm rusty, but fairly knowledgeable and useful if you need me to compile something, install patches, etc. I could give SSH access, but sending me a patch to test may be quicker.=20 lspci dumps in the next message. Thanks. --=20 You are receiving this mail because: You are the assignee for the bug.=