FreeBSD 10.2 - LAGG interfaces "possible flapping" during shutdown

Tue Oct 6 21:58:17 UTC 2015

Hi,
Just in case it has an effect on things I have also included the switch side of the configuration below:
# version 5.20, Release 1513P89# sysname HP_V1910-24G-PoE#vlan 1 arp detection enable#vlan 101 description MGMT VLAN - 192.168.1.0/24 arp detection enable#vlan 102 description VLAN 102 - 192.168.2.0/24 arp detection enable#vlan 103 description VLAN 103 - 192.168.3.0/24 arp detection enable#interface Vlan-interface1 ip address 192.168.0.3 255.255.255.0 #interface Vlan-interface101 ip address 192.168.1.3 255.255.255.0 #interface Vlan-interface102 ip address 192.168.2.3 255.255.255.0 #interface Vlan-interface103 ip address 192.168.3.3 255.255.255.0 #interface Bridge-Aggregation2 port link-type hybrid port hybrid vlan 101 to 103 tagged port hybrid vlan 1 untagged link-aggregation mode dynamic arp detection trust#interface GigabitEthernet1/0/5 port link-type hybrid port hybrid vlan 101 to 103 tagged port hybrid vlan 1 untagged stp edged-port enable port link-aggregation group 2#interface GigabitEthernet1/0/6 port link-type hybrid port hybrid vlan 101 to 103 tagged port hybrid vlan 1 untagged stp edged-port enable port link-aggregation group 2#interface GigabitEthernet1/0/7 port link-type hybrid port hybrid vlan 101 to 103 tagged port hybrid vlan 1 untagged stp edged-port enable port link-aggregation group 2#interface GigabitEthernet1/0/8 port link-type hybrid port hybrid vlan 101 to 103 tagged port hybrid vlan 1 untagged stp edged-port enable port link-aggregation group 2#
The view of the LAGG from the system side:root at Pine:~ #  ifconfig lagg1
lagg1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
	ether a0:36:9f:64:6d:d5
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: active
	laggproto lacp lagghash l2,l3,l4
	laggport: igb1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
	laggport: igb4 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
	laggport: igb7 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
	laggport: igb8 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
The one thing that I just noticed is that I have VLAN 1 untagged on the Bridge Aggregate 2 but I can't see how that would cause this affect. My assumption is that the LAGG interface is being shutdown but the four ethernet ports are not; therefore the kernel notices traffic on all four ports and complains. With this same server I also have another LAGG setup that is going to a Cisco SG200-26 switch (which carries VLAN 104 and VLAN 105) with the same issue. All 8 interfaces show up during the shutdown after the Uptime message with the Interface stopped DISTRIBUTING, possible flapping issue.
My main concern at this point is how can I do a complete system reboot from remote without it hanging with no access to the power button or console.
Regards,
Dean

From: dean_forester at hotmail.com
To: freebsd-questions at freebsd.org
Subject: FreeBSD 10.2 - LAGG interfaces "possible flapping" during shutdown
Date: Tue, 6 Oct 2015 12:28:01 -0400

Hi

I am having an issue with a new FreeBSD 10.2-RELEASE system when using LAGGs. Everything works fine until I try to do a reboot of the system. With this issue the system does a shutdown but reports an error with the interfaces that belong to the LAGG (which also have VLANs define) and then halts, it will not reboot; a power cycle is required.

root at Pine:~ # uname -a
FreeBSD Pine.local 10.2-RELEASE FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015     root at releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64

/etc/rc.conf:
if_vlan_load="YES"
# HP V1910-24G Switch Trunk
ifconfig_igb1="up mtu 1500"
ifconfig_igb4="up mtu 1500"
ifconfig_igb7="up mtu 1500"
ifconfig_igb8="up mtu 1500"
# Setup new Virtual Interfaces
cloned_interfaces="lagg1 vlan101 vlan102 vlan103"
# LAGG Configuration
ifconfig_lagg1="laggproto lacp laggport igb1 laggport igb4 laggport igb7 laggport igb8"
# Setup VLANs
ifconfig_vlan101="inet 192.168.1.208/24 vlan 101 vlandev lagg1"
ifconfig_vlan102="inet 192.168.2.208/24 vlan 102 vlandev lagg1"
ifconfig_vlan103="inet 192.168.3.208/24 vlan 103 vlandev lagg1"
# Setup extra IPs for Layer 3 Load Balancing
ifconfig_vlan101_aliases="inet 192.168.1.209/32"
ifconfig_vlan102_aliases="inet 192.168.2.209/32"
ifconfig_vlan103_aliases="inet 192.168.3.209/32"

Errors on shutdown -r now

Uptime: 3d20h44m15sigb8: Interface stopped DISTRIBUTING,
possible flappingigb1: Interface stopped DISTRIBUTING,
possible flapping

igb7: Interface stopped DISTRIBUTING,
possible flapping

igb4: Interface stopped DISTRIBUTING,
possible flapping

Has anyone else run into this behavior with LAGGs and VLANs? Any help would greatly be appreciated.

Regards,

Dean Forester
dean_forester at hotmail.com