LACP+VLAN with 10G NIC not working

Carles Guadall CGuadall at nexica.com
Thu Oct 31 16:56:00 UTC 2013


I configured a lacp (lagg0) with two 10G-Intel NICs. Latter I created 2 VLAN over lagg0.

When trying to ping from host vlan to any other hosts doesn't work. 
I ran tcpdump on each interface, ix[0|1], lagg0 and vlan[52|908].

- On each physical interface I see packets coming from network. I can see mainly broadcasts, correctly tagged, etc.
- On lagg0 interface I also see packets coming from network. When running tcpdump on vlanXX I only can see ARP requests from localhost.

It's seems packets doesn't "flow" from/to vnic and lagg.

Inbound 
( network ) --> [ix0] --> [lagg0] ---X---> [vlan52]
( network ) --> [ix0] --> [lagg0] ---X---> [vlan52]

Outbound 

( network ) <-- [ix0] <-- [lagg0] <---X--- [vlan52]
( network ) <-- [ix0] <-- [lagg0] <---X--- [vlan52]

Any idea what's wrong??

System info

# uname -a
FreeBSD XXX-hostname-XXX 9.1-STABLE FreeBSD 9.1-STABLE #0 r+16f6355: Tue Aug 27 00:38:40 PDT 2013     root at build.ixsystems.com:/tank/home/jkh/src/freenas/os-base/amd64/tank/home/jkh/src/freenas/FreeBSD/src/sys/FREENAS.amd64  amd64

# sysctl kern.osreldate
kern.osreldate: 901505

# dmesg |grep -i intel
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.7 - STABLE/9> port 0xbc00-0xbc1f mem 0xf9f80000-0xf9ffffff,0xf9f7c000-0xf9f7ffff irq 16 at device 0.0 on pci1
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.7 - STABLE/9> port 0xb880-0xb89f mem 0xf9e80000-0xf9efffff,0xf9e7c000-0xf9e7ffff irq 17 at device 0.1 on pci1

# pciconf -lv | grep -B3 network
ix0 at pci0:1:0:0: class=0x020000 card=0x061115d9 chip=0x10fb8086 rev=0x01 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82599EB 10-Gigabit SFI/SFP+ Network Connection'
    class      = network
--
ix1 at pci0:1:0:1: class=0x020000 card=0x061115d9 chip=0x10fb8086 rev=0x01 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82599EB 10-Gigabit SFI/SFP+ Network Connection'
    class      = network



# ifconfig
ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO>
        ether 00:25:90:c3:da:82
        inet6 fe80::225:90ff:fec3:da82%ix0 prefixlen 64 scopeid 0x1
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (autoselect <full-duplex>)
        status: active
ix1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO>
        ether 00:25:90:c3:da:82
        inet6 fe80::225:90ff:fec3:da83%ix1 prefixlen 64 scopeid 0x2
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (autoselect <full-duplex>)
        status: active

lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO>
        ether 00:25:90:c3:da:82
        inet 192.168.100.100 netmask 0xffffff00 broadcast 192.168.100.255
        inet6 fe80::225:90ff:fec3:da82%lagg0 prefixlen 64 scopeid 0x9
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        laggproto lacp lagghash l2,l3,l4
        laggport: ix1 flags=18<COLLECTING,DISTRIBUTING>
        laggport: ix0 flags=18<COLLECTING,DISTRIBUTING>
vlan52: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=303<RXCSUM,TXCSUM,TSO4,TSO6>
        ether 00:25:90:c3:da:82
        inet 10.52.0.9 netmask 0xffffff00 broadcast 10.52.0.255
        inet6 fe80::225:90ff:fec3:da82%vlan52 prefixlen 64 scopeid 0xa
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 52 parent interface: lagg0
vlan908: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=303<RXCSUM,TXCSUM,TSO4,TSO6>
        ether 00:25:90:c3:da:82
        inet 10.21.0.9 netmask 0xffffff00 broadcast 10.21.0.255
        inet6 fe80::225:90ff:fec3:da82%vlan908 prefixlen 64 scopeid 0xb
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 908 parent interface: lagg0

Thank you

Carles Guadall


More information about the freebsd-net mailing list