[Bug 265857] qlnxe: no IPV6 pings between nodes on the same switch until an IPv4 address is set

From: <bugzilla-noreply_at_freebsd.org>
Date: Mon, 15 Aug 2022 12:55:29 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=265857

            Bug ID: 265857
           Summary: qlnxe: no IPV6 pings between nodes on the same switch
                    until an IPv4 address is set
           Product: Base System
           Version: 13.1-RELEASE
          Hardware: Any
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: bugs@FreeBSD.org
          Reporter: benoitc@enki-multimedia.eu

I have setup 3 nodes on a fresh Freebsd 13.1-RELEASE-p1. They have the same
gateway and IPS are in same /64. All 3 nodes are on the same switch (mikrotik)
and same vlan untagged.

I can ping them from an external machine through the router/gateway but the
nodes can't ping each others using a public IPv6 /64. Pings using local-link
work. `ndp -a` only return local ping-links, the gateway address and address of
the current node. 

Pings start to work when the interface is put in promiscuous mode or an IPV4
address is set.

The card is an HPE Eth 10/25Gb 2p 621SFP28 Adptr:
https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=a00035643en_us

See this thread on th emailing-list for the details:
https://lists.freebsd.org/archives/freebsd-net/2022-August/002294.html


Initial configuration was pretty straightforward:

```
hostname="node1.domain.tld"
keymap="fr.macbook.kbd"
ifconfig_ql0=""
ifconfig_ql0_ipv6="inet6 <PREFIX>::11/64"
ipv6_defaultrouter="<PREFIX>::1"
sshd_enable="YES"
ntpd_enable="YES"
# Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable
dumpdev="AUTO"
zfs_enable="YES"
```
Others machines are `<PREFIX>::12`, `<PREFIX>::13`. The prefix is the same for
all To be sure, I  replaced the content by <PREFIX> using sed:

node 1:

```
 $ ifconfig ql0
ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
ether b4:7a:f1:7a:9c:10
inet6 <PREFIX>::11 prefixlen 64
inet6 fe80::b67a:f1ff:fe7a:9c10%ql0 prefixlen 64 scopeid 0x1
media: Ethernet autoselect (25GBase-SR <full-duplex>)
status: active
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
```

node 2:

```
 $ ifconfig ql0
ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
ether b4:7a:f1:7a:99:52
inet6 <PREFIX>::12 prefixlen 64
inet6 fe80::b67a:f1ff:fe7a:9952%ql0 prefixlen 64 scopeid 0x1
media: Ethernet autoselect (25GBase-SR <full-duplex>)
status: active
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
```

node 3
```
ifconfig ql0
ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
ether b4:7a:f1:18:ff:d8
inet6 <PREFIX>::13 prefixlen 64
inet6 fe80::b67a:f1ff:fe18:ffd8%ql0 prefixlen 64 scopeid 0x1
media: Ethernet autoselect (25GBase-SR <full-duplex>)
status: active
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
```

-- 
You are receiving this mail because:
You are the assignee for the bug.