Re: FreeBSD 12.2 traffic not occurs onVXLAN

From: alfadev via freebsd-net <freebsd-net_at_FreeBSD.org>
Date: Tue, 24 Aug 2021 08:12:41 UTC
Thanks for interest
FreeBSD ifconfig:

igb0: flags=8822<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4e527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
	ether e4:3a:6e:44:7b:33
	inet 192.168.41.102 netmask 0xffffff00 broadcast 192.168.41.255
	media: Ethernet autoselect (100baseTX <full-duplex>)
	status: active
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x7
	inet 127.0.0.1 netmask 0xff000000
	groups: lo
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

vxlan409: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=80020<JUMBO_MTU,LINKSTATE>
	ether 58:9c:fc:10:d1:3f
	inet 192.168.159.1 netmask 0xffffff00 broadcast 192.168.159.255
	groups: vxlan
	vxlan vni 409 local 192.168.99.1:4789 remote 192.168.99.99:4789
	media: Ethernet autoselect (autoselect <full-duplex>)
	status: active
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

wg0: flags=80c1<UP,RUNNING,NOARP,MULTICAST> metric 0 mtu 1420
	options=80000<LINKSTATE>
	inet 192.168.99.1 netmask 0xffffff00
	groups: wg
	nd6 options=109<PERFORMNUD,IFDISABLED,NO_DAD>

Linux ifconfig:
br-lan    Link encap:Ethernet  HWaddr E4:3A:6E:41:DC:E9
          inet6 addr: fe80::e63a:6eff:fe41:dce9/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1396 errors:0 dropped:0 overruns:0 frame:0
          TX packets:475 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:64316 (62.8 KiB)  TX bytes:160570 (156.8 KiB)

eth0      Link encap:Ethernet  HWaddr E4:3A:6E:41:DC:E8
          inet addr:192.168.20.232  Bcast:192.168.20.255  Mask:255.255.255.0
          inet6 addr: fe80::e63a:6eff:fe41:dce8/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:13884 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6588 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:2036433 (1.9 MiB)  TX bytes:1405173 (1.3 MiB)
          Memory:f7d00000-f7d1ffff

eth1      Link encap:Ethernet  HWaddr E4:3A:6E:41:DC:E9
          inet addr:169.254.169.169  Bcast:169.254.169.171  Mask:255.255.255.252
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:4152 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1761 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:258460 (252.4 KiB)  TX bytes:587430 (573.6 KiB)
          Memory:f7c00000-f7c1ffff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:50 errors:0 dropped:0 overruns:0 frame:0
          TX packets:50 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:4095 (3.9 KiB)  TX bytes:4095 (3.9 KiB)

vxlan409  Link encap:Ethernet  HWaddr 4E:00:90:B0:A8:DF
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1857 errors:15 dropped:0 overruns:0 carrier:15
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:216270 (211.2 KiB)

wg0       Link encap:UNSPEC  HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
          inet addr:192.168.99.99  P-t-P:192.168.99.99  Mask:255.255.255.255
          UP POINTOPOINT RUNNING NOARP  MTU:1420  Metric:1
          RX packets:155 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1882 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:5776 (5.6 KiB)  TX bytes:373616 (364.8 KiB)

Here is tcpdump results:
############################################
root@test13:~ # tcpdump -p port 4789
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on igb0, link-type EN10MB (Ethernet), capture size 262144 bytes

root@test13:~ # tcpdump -i wg0
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on wg0, link-type NULL (BSD loopback), capture size 262144 bytes
10:47:13.277336 IP 192.168.99.99.54996 > 192.168.99.1.vxlan: VXLAN, flags [I] (0x08), vni 409
ARP, Request who-has 192.168.159.1 tell 192.168.159.100, length 46
10:47:13.633393 IP 192.168.99.99.39365 > 192.168.99.1.vxlan: VXLAN, flags [I] (0x08), vni 409
IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from e4:3a:6e:41:dc:e9 (oui Unknown), length 300
10:47:14.301605 IP 192.168.99.99.54996 > 192.168.99.1.vxlan: VXLAN, flags [I] (0x08), vni 409
ARP, Request who-has 192.168.159.1 tell 192.168.159.100, length 46

root@linux:~# tcpdump -i wg0
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on wg0, link-type RAW (Raw IP), capture size 262144 bytes
07:46:39.424139 IP 192.168.99.99.54996 > 192.168.99.1.4789: VXLAN, flags [I] (0x08), vni 409
ARP, Request who-has 192.168.159.1 tell 192.168.159.100, length 46
07:46:39.680210 IP 192.168.99.99.39365 > 192.168.99.1.4789: VXLAN, flags [I] (0x08), vni 409
IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from e4:3a:6e:41:dc:e9 (oui Unknown), length 300
07:46:40.448129 IP 192.168.99.99.54996 > 192.168.99.1.4789: VXLAN, flags [I] (0x08), vni 409
ARP, Request who-has 192.168.159.1 tell 192.168.159.100, length 46
07:46:41.472093 IP 192.168.99.99.54996 > 192.168.99.1.4789: VXLAN, flags [I] (0x08), vni 409

##################################################

Vxlan traffic only occurs on wg0 it is ok:

But when i plug my pc on eth1 (eth1 and vxlan409 in bridge)
only ARP request occurs.
this problem occurs only freebsd 12.2 and 13.0 STABLE
works with Freebsd 11.2

alfa@ubuntu:~# ping 192.168.159.1

root@linux:~# tcpdump -i eth1
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth1, link-type EN10MB (Ethernet), capture size 262144 bytes
07:52:19.296110 ARP, Request who-has 192.168.159.1 tell 192.168.159.100, length 46
07:52:20.320148 ARP, Request who-has 192.168.159.1 tell 192.168.159.100, length 46
07:52:21.344077 ARP, Request who-has 192.168.159.1 tell 192.168.159.100, length 46
07:52:21.760224 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from e4:3a:6e:41:dc:e9 (oui Unknown), length 300



Sent with ProtonMail Secure Email.

‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐

On Monday, August 23rd, 2021 at 6:28 PM, Navdeep Parhar <nparhar@gmail.com> wrote:

> On Sun, Aug 22, 2021 at 8:30 AM alfadev via freebsd-hackers
>
> freebsd-hackers@freebsd.org wrote:
>
> > Hi, I successfully configured VXLAN tunnel between amd64 FreeBSD 11.2 to x64 Linux
> >
> > But in FreeBSD 12.2 with below same configuration not works.
> >
> > So What is tHe problem with FreeBSD 12.2 is it bug or any other thing?
> >
> > Any help would be aooreciated..
> >
> > My fully working tested configuration is:
> >
> > FreeBSD 11.2 side:
> >
> > physical interface: igb0
> >
> > ifconfig vxlan4095 create vxlanid 4095 vxlanlocal 192.168.99.1 vxlanremote 192.168.99.99 inet 192.168.157.1/24
>
> Can you please provide the ifconfig output for both the vxlan and the
>
> physical interface? Have you tried running tcpdump -p on the physical
>
> interface to see if there is any VXLAN traffic on the link?
>
> Regards,
>
> Navdeep
>
> > Linux side:
> >
> > physical interfaces: eth0,eth1
> >
> > ip link add name vxlan4095 type vxlan id 4095 remote 192.168.99.1 local 192.168.99.99
> >
> > ip link add name vbr0 type bridge
> >
> > ip link set eth1 master vbr0
> >
> > ip link set vxlan4095 master vbr0
> >
> > ip link set vbr0 up
> >
> > there is a client connected on eth1 and have IP : 192.168.157.100
> >
> > http https , icmp .. traffic passes through between client and tunnel
> >
> > eveything works well.