Re: OT: Strange interaction between NIC, SSD and motherboard
Date: Sun, 31 Jul 2022 00:43:35 UTC
On Sat, Jul 30, 2022 at 7:55 PM David Christensen
<dpchrist@holgerdanske.com> wrote:
>
> On 7/29/22 17:10, Aryeh Friedman wrote:
>
> >>> I have a MSI Motherboard (DMI info output below) and have two
> >>> identical SSD's (one [sata0] with FreeBSD installed and Windows
> >>> on the other [sata1]and then I bought a D-Link DGE-560T NIC
> >>> (wired 10/100/1000) and soon I connected the NIC the machine
> >>> could not see the FreeBSD drive at all (the BIOS that is) even
> >>> after swapping cables and SATA connectors. As soon as I took
> >>> the NIC out everything returned completely to normal.
>
> >>> ada0: <SATA SSD SBFM61.3> ACS-4 ATA SATA 3.x device
>
> >>> Base Board Information
> >>> Manufacturer: Micro-Star International Co., Ltd
> >>> Product Name: B450 TOMAHAWK (MS-7C02)
>
>
> On Sat, Jul 30, 2022 at 5:18 PM Ralf Mardorf wrote:
>
> >> maybe the power supply is too weak to power the NIC and the two
> >> SSDs or even the NIC and the FreeBSD SSD, without the Windows SSD.
> >> The FreeBSD SSD might consume more mA or is somehow more prone to
> >> unstable power or connected to another power cable harness, than
> >> the Windows SSD. If so, it could explain that swapping SATA cables
> >> and SATA ports doesn't change anything. It's not my best guess,
> >> it's the only guess ;). Just a shot in the dark!
>
>
> On 7/30/22 14:38, Aryeh Friedman wrote:
>
> > Almost certainly not the case since one of the tests I did was to
> > completely disconnect (including power cables) the windows SSD and it
> > still didn't see the FreeBSD one regardless of which cable and SATA
> > connector I used
>
>
> STFW motherboard
>
> https://www.msi.com/Motherboard/B450-TOMAHAWK
Found nothing even remotely about this problem online
>
>
> STFW NIC
>
> https://us.dlink.com/en/products/dge-560t-gigabit-desktop-pci-express-adapter
I got it specifically because the back of the box said it was
compatible with FreeBSD 7/8+ as to my version:
FreeBSD neomarx 13.1-STABLE FreeBSD 13.1-STABLE #3
stable/13-n250682-58f49b7da7d: Fri May 6 00:51:39 EDT 2022
root@neomarx:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
And maybe dmesg will help:
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.1-STABLE #3 stable/13-n250682-58f49b7da7d: Fri May 6
00:51:39 EDT 2022
root@neomarx:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git
llvmorg-13.0.0-0-gd7b669b3a303)
VT(vga): resolution 640x480
CPU: AMD Ryzen 5 2600 Six-Core Processor (3400.18-MHz K8-class CPU)
Origin="AuthenticAMD" Id=0x800f82 Family=0x17 Model=0x8 Stepping=2
Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
Structured Extended
Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr,IBPB>
SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
TSC: P-state invariant, performance statistics
real memory = 25769803776 (24576 MB)
avail memory = 24905269248 (23751 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs
FreeBSD/SMP: 1 package(s) x 2 cache groups x 3 core(s) x 2 hardware threads
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 24-55
Launching APs: 10 6 1 11 7 3 2 8 9 5 4
random: entropy device external interface
kbd1 at kbdmux0
nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX
platforms 510.60.02 Wed Mar 16 11:03:12 UTC 2022
vtvga0: <VT VGA driver>
smbios0: <System Management BIOS> at iomem 0xf05d0-0xf05ee
smbios0: Version: 2.8, BCD Revision: 2.8
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
acpi0: <ALASKA A M I >
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 350
Event timer "HPET2" frequency 14318180 Hz quality 350
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 1.3 on pci0
pci1: <ACPI PCI bus> on pcib1
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xf73a0000-0xf73a7fff
irq 32 at device 0.0 on pci1
xhci0: 32 bytes context size, 64-bit DMA
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
ahci0: <AHCI SATA controller> mem 0xf7380000-0xf739ffff irq 33 at
device 0.1 on pci1
ahci0: AHCI v1.31 with 8 6Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
pcib2: <ACPI PCI-PCI bridge> irq 34 at device 0.2 on pci1
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 32 at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 33 at device 1.0 on pci2
pci4: <ACPI PCI bus> on pcib4
re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port
0xf000-0xf0ff mem 0xf7204000-0xf7204fff,0xf7200000-0xf7203fff irq 33
at device 0.0 on pci4
re0: Using 1 MSI-X message
re0: turning off MSI enable bit.
re0: Chip rev. 0x54000000
re0: MAC rev. 0x00100000
miibus0: <MII bus> on re0
rgephy0: <RTL8251/8153 1000BASE-T media interface> PHY 1 on miibus0
rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX,
100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX,
1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master,
auto, auto-flow
re0: Using defaults for TSO: 65518/35/2048
re0: Ethernet address: 00:d8:61:78:d4:9c
re0: netmap queues/slots: TX 1/256, RX 1/256
pcib5: <ACPI PCI-PCI bridge> irq 32 at device 4.0 on pci2
pci5: <ACPI PCI bus> on pcib5
vgapci0: <VGA-compatible display> port 0xe000-0xe07f mem
0xf6000000-0xf6ffffff,0xe0000000-0xefffffff,0xf0000000-0xf1ffffff irq
32 at device 0.0 on pci5
nvidia0: <NVIDIA GeForce GT 1030> on vgapci0
vgapci0: child nvidia0 requested pci_enable_io
vgapci0: child nvidia0 requested pci_enable_io
vgapci0: Boot video device
hdac0: <NVIDIA (0x0fb8) HDA Controller> mem 0xf7080000-0xf7083fff irq
33 at device 0.1 on pci5
pcib6: <ACPI PCI-PCI bridge> at device 7.1 on pci0
pci6: <ACPI PCI bus> on pcib6
pci6: <unknown> at device 0.0 (no driver attached)
pci6: <encrypt/decrypt> at device 0.2 (no driver attached)
xhci1: <XHCI (generic) USB 3.0 controller> mem 0xf7500000-0xf75fffff
irq 37 at device 0.3 on pci6
xhci1: 64 bytes context size, 64-bit DMA
usbus1 on xhci1
usbus1: 5.0Gbps Super Speed USB v3.0
pcib7: <ACPI PCI-PCI bridge> at device 8.1 on pci0
pci7: <ACPI PCI bus> on pcib7
pci7: <unknown> at device 0.0 (no driver attached)
ahci1: <AMD KERNCZ AHCI SATA controller> mem 0xf7808000-0xf7808fff irq
42 at device 0.2 on pci7
ahci1: AHCI v1.31 with 1 6Gbps ports, Port Multiplier supported with FBS
ahcich8: <AHCI channel> at channel 0 on ahci1
hdac1: <AMD X370 HDA Controller> mem 0xf7800000-0xf7807fff irq 43 at
device 0.3 on pci7
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbdc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 14.
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
Timecounter "TSC-low" frequency 1699999108 Hz quality 1000
Timecounters tick every 1.000 msec
hdacc0: <NVIDIA (0x0081) HDA CODEC> at cad 0 on hdac0
hdaa0: <NVIDIA (0x0081) Audio Function Group> at nid 1 on hdacc0
pcm0: <NVIDIA (0x0081) (HDMI/DP 8ch)> at nid 4 on hdaa0
pcm1: <NVIDIA (0x0081) (HDMI/DP 8ch)> at nid 5 on hdaa0
hdacc1: <Realtek ALC892 HDA CODEC> at cad 0 on hdac1
hdaa1: <Realtek ALC892 Audio Function Group> at nid 1 on hdacc1
pcm2: <Realtek ALC892 (Rear Analog 7.1/2.0)> at nid 20,22,21,23 and
24,26 on hdaa1
pcm3: <Realtek ALC892 (Front Analog)> at nid 27 and 25 on hdaa1
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <SATA SSD SBFM61.3> ACS-4 ATA SATA 3.x device
ada0: Serial Number 20070110240883
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 976762MB (2000409264 512 byte sectors)
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <SATA SSD SBFM61.3> ACS-4 ATA SATA 3.x device
ada1: Serial Number 19070910240135
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 976762MB (2000409264 512 byte sectors)
Trying to mount root from ufs:/dev/ada1a [rw]...
ugen1.1: <AMD XHCI root HUB> at usbus1
ugen0.1: <AMD XHCI root HUB> at usbus0
uhub0 on usbus1
uhub1 on usbus0
uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
uhub1: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
intsmb0: <AMD FCH SMBus Controller> at device 20.0 on pci0
smbus0: <System Management Bus> on intsmb0
acpi_wmi0: <ACPI-WMI mapping> on acpi0
acpi_wmi0: cannot find EC device
acpi_wmi0: Embedded MOF found
ACPI: \134AOD.WQBA: 1 arguments were passed to a non-method ACPI
object (Buffer) (20201113/nsarguments-361)
driver bug: Unable to set devclass (class: ppc devname: (unknown))
acpi_wmi1: <ACPI-WMI mapping> on acpi0
acpi_wmi1: cannot find EC device
acpi_wmi2: <ACPI-WMI mapping> on acpi0
acpi_wmi2: cannot find EC device
acpi_wmi2: Embedded MOF found
ACPI: \134_SB.WMIC.WQBA: 1 arguments were passed to a non-method ACPI
object (Buffer) (20201113/nsarguments-361)
lo0: link state changed to UP
re0: link state changed to DOWN
uhub0: 8 ports with 8 removable, self powered
uhub1: 22 ports with 22 removable, self powered
ugen0.2: <vendor 0x0409 product 0x005a> at usbus0
uhub2 on uhub1
uhub2: <vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00, addr
1> on usbus0
uhub2: 4 ports with 4 removable, self powered
ugen0.3: <Logitech USB Keyboard> at usbus0
ukbd0 on uhub2
ukbd0: <USB Keyboard> on usbus0
kbd2 at ukbd0
re0: link state changed to UP
ugen0.4: <Logitech USB Optical Mouse> at usbus0
uhid0 on uhub2
uhid0: <USB Keyboard> on usbus0
ums0 on uhub2
ums0: <Logitech USB Optical Mouse, class 0/0, rev 2.00/72.00, addr 3> on usbus0
ums0: 3 buttons and [XYZ] coordinates ID=0
>
>
> STFW SSD
>
> "SBFM61.3" appears to be firmware for various brands. What is the make
> and model of the SSD's? Please provide URL.
It is the store brand of MicroCenter:
https://www.microcenter.com/product/508183/inland-professional-1tb-ssd-3d-nand-sata-30-6-gbps-25-inch-7mm-internal-solid-state-drive
as you can see from the dmesg output above they only differ in serial
number. I was unable to find info about who the OEM is.
>
>
> What version and edition of Windows do you have?
10 with updates through about 2 weeks ago
>
>
> What version and release of FreeBSD do you have?
See above
>
>
> Have you tested the power supply with a hardware power supply tester?
Don't have access to one but I specifically overpowered the power
supply under the assumption I would be adding stuff to the machine
over time.
>
>
> Have you disconnected and re-seated the power cables connected to the
> motherboard?
yes
>
>
> Have you run memtest86+?
Passed with flying colors
>
>
> Are you confident in your SATA cables?
Yes I even tried two brand new ones
>
>
> If you disconnect everything from the motherboard except for the power
> supply, CPU/ heatsink/ fan, memory modules, Windows SSD, keyboard,
> mouse, and monitor, and connect the Windows SSD to each motherboard SATA
> port in turn, does CMOS Setup see the SSD for every port? Does Windows
> boot for every port? What are the results if you repeat these steps
> using the FreeBSD SSD?
Those are all the connectors I have on the machine (no on-board video
so I have to leave the card in)
There are 2 16 connector PCI-E slots that the NIC can plug into tried
both of them with the same results as above.
Yes Windows boots from all ports and FreeBSD is seen from none of
them. FreeBSD (my default boot device) will boot from all of them
if the NIC is taken out. If the NIC is not present it also will dual
boot windows as normal on all ports.
>
>
> If you connect the Windows SSD to the first SATA port and connect the
> NIC to each motherboard PCIe slot in turn, does CMOS setup see the NIC
> for every slot? Does Windows boot for every slot? Does the NIC work
> for every slot? What are the results if you repeat these steps using
> the FreeBSD SSD?
The CMOS sees all devices in all ports *EXCEPT* the FreeBSD SSD when
the NIC is installed. All devices are also 100% functional with the
NIC in except of course not seeing FreeBSD at all.
--
Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org