Re: Intermittent failure of routing/gateway with ix(4) (x86_64)
Date: Sun, 24 Aug 2025 01:24:18 UTC
On 8/23/2025 21:15, R Tyler Croy wrote: > Howdy! I am hoping y'all could help me add more debugging to a FreeBSD 14.x based router/gateway. The device has two ix(4) NICs for the WAN/LAN. Periodically the device stops routing traffic entirely, but the machine is still online and interactive. > > What is particularly interesting is when I console into the machine I can still send traffic out from the device over the WAN interface, but anything that relies on the gateway seems to fail. I.e. routing to any host on the LAN interface (ix1) no longer works. > > `service routing restart` does nothing, `service netif restart` also does nothing. Downing the ix1 interface and bringing it back up does nothing. > > A reboot however does puts it back into working order. > > > On one instance the console had a lot of arpresolve "cannot allocate llinfo" errors, chasing that rabbit led nowhere. > > Because this freezing behavior is intermittent but _does_ seem to correlate with higher network utilization, I'm wondering if there are debugging logs I can enable, or a way to inspect driver specific counters that could be overflowing, etc? > > I'm open to any recommendations that prevent me from setting up a cron every minute to validate connectivity or reboot the box! :) > > > Cheers What physical hardware is on that driver? I have a box here with two ix interfaces in it that is my edge router and beat the SNOT out of it without problems. This is what the boot messages are for them in my machine here: ix0: <Intel(R) X520 82599ES (SFI/SFP+)> port 0x3020-0x303f mem 0x80a20000-0x80a3 ffff,0x80a44000-0x80a47fff at device 0.0 on pci5 ix0: Using 2048 TX descriptors and 2048 RX descriptors ix0: Using 4 RX queues 4 TX queues ix0: Using MSI-X interrupts with 5 vectors ix0: allocated for 4 queues ix0: allocated for 4 rx queues ix0: Ethernet address: 00:e0:b4:68:f8:94 ix0: PCI Express Bus: Speed 5.0GT/s Width x4 ix0: eTrack 0x800003de ix0: netmap queues/slots: TX 4/2048, RX 4/2048 ix1: <Intel(R) X520 82599ES (SFI/SFP+)> port 0x3000-0x301f mem 0x80a00000-0x80a1 ffff,0x80a40000-0x80a43fff at device 0.1 on pci5 ix1: Using 2048 TX descriptors and 2048 RX descriptors ix1: Using 4 RX queues 4 TX queues ix1: Using MSI-X interrupts with 5 vectors ix1: allocated for 4 queues ix1: allocated for 4 rx queues ix1: Ethernet address: 00:e0:b4:68:f8:95 ix1: PCI Express Bus: Speed 5.0GT/s Width x4 ix1: eTrack 0x800003de ix1: netmap queues/slots: TX 4/2048, RX 4/2048 Kernel info: $ uname -v FreeBSD 14.3-STABLE #0 stable/14-n271456-70068b3030f9-dirty: Mon May 12 18:53:58 EDT 2025 karl@NewFS.denninger.net:/work/OBJ/Crochet-work-AMD14/usr/src.14-STABLE/amd64.amd64/sys/GENERIC -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/