LAGG bug or misconfiguration???
Dean E. Weimer
dweimer at dweimer.net
Thu Mar 15 19:47:52 UTC 2012
On 15.03.2012 14:06, Snoop wrote:
> Hi there,
> a while after setting up my new server (with 8 jails in it) I've
> decided
> (after postponing several times) to properly check the functionality
> of
> the lagg and the result was very disappointing.
>
> The test I've done is very simple.
> I've started copying a file from one site to another of my VPN
> network
> (from the server I've been testing the net to another node somewhere
> else) and in the meantime I've been physically disconnecting the main
> network cable to check the responsiveness of the lagg configuration.
> Then I've plugged the cable back to check if the traffic would switch
> back to the main NIC as it should.
>
> The result was basically this (lagg0 members: bge0 primary, bge1
> secondary)
>
> - when bge0 unplugged the traffic switched almost instantaneously to
> bge1
> - when bge0 plugged back in, the network stopped working completely
> with
> the two NICs polling synchronously until I manually unplug bge1. Then
> within 2-4 seconds traffic goes back on bge0 (I've been waiting for a
> little more than a minute maximum to avoid all the active connections
> on
> the server to timeout).
>
> Now, I've repeated the same test about 10-15 times randomly waiting
> for
> different times between the unplug-replug procedure. The result was
> always the same.
>
> So, below are the ipconfig outputs
> - before to start the test
> - when bge0 gets unplugged
> - when bge0 gets plugged back in
>
> I couldn't see anything odd.
>
> ___________________________________________________________________________________
> lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0
> mtu
> 1500
>
>
> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
> ether 00:14:ee:00:8a:c0
> inet xxx.xx.xx.224 netmask 0xffffff00 broadcast xxx.xx.xx.255
> inet xxx.xx.xx.227 netmask 0xffffffff broadcast xxx.xx.xx.227
> inet xxx.xx.xx.225 netmask 0xffffffff broadcast xxx.xx.xx.225
> inet 172.16.3.2 netmask 0xffffffff broadcast 172.16.3.2
> inet 172.16.3.3 netmask 0xffffffff broadcast 172.16.3.3
> inet 172.16.3.4 netmask 0xffffffff broadcast 172.16.3.4
> inet 172.16.3.5 netmask 0xffffffff broadcast 172.16.3.5
> inet 172.16.3.6 netmask 0xffffffff broadcast 172.16.3.6
> inet xxx.xx.xx.226 netmask 0xffffffff broadcast xxx.xx.xx.226
> media: Ethernet autoselect
> status: active
> laggproto failover
> laggport: bge1 flags=0<>
> laggport: bge0 flags=5<MASTER,ACTIVE>
>
> ___________________________________________________________________________________
> lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0
> mtu
> 1500
>
>
> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
> ether 00:14:ee:00:8a:c0
> inet xxx.xx.xx.224 netmask 0xffffff00 broadcast xxx.xx.xx.255
> inet xxx.xx.xx.227 netmask 0xffffffff broadcast xxx.xx.xx.227
> inet xxx.xx.xx.225 netmask 0xffffffff broadcast xxx.xx.xx.225
> inet 172.16.3.2 netmask 0xffffffff broadcast 172.16.3.2
> inet 172.16.3.3 netmask 0xffffffff broadcast 172.16.3.3
> inet 172.16.3.4 netmask 0xffffffff broadcast 172.16.3.4
> inet 172.16.3.5 netmask 0xffffffff broadcast 172.16.3.5
> inet 172.16.3.6 netmask 0xffffffff broadcast 172.16.3.6
> inet xxx.xx.xx.226 netmask 0xffffffff broadcast xxx.xx.xx.226
> media: Ethernet autoselect
> status: active
> laggproto failover
> laggport: bge1 flags=4<ACTIVE>
> laggport: bge0 flags=1<MASTER>
>
> ___________________________________________________________________________________
>
> lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0
> mtu
> 1500
>
>
> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
> ether 00:14:ee:00:8a:c0
> inet xxx.xx.xx.224 netmask 0xffffff00 broadcast xxx.xx.xx.255
> inet xxx.xx.xx.227 netmask 0xffffffff broadcast xxx.xx.xx.227
> inet xxx.xx.xx.225 netmask 0xffffffff broadcast xxx.xx.xx.225
> inet 172.16.3.2 netmask 0xffffffff broadcast 172.16.3.2
> inet 172.16.3.3 netmask 0xffffffff broadcast 172.16.3.3
> inet 172.16.3.4 netmask 0xffffffff broadcast 172.16.3.4
> inet 172.16.3.5 netmask 0xffffffff broadcast 172.16.3.5
> inet 172.16.3.6 netmask 0xffffffff broadcast 172.16.3.6
> inet xxx.xx.xx.226 netmask 0xffffffff broadcast xxx.xx.xx.226
> media: Ethernet autoselect
> status: active
> laggproto failover
> laggport: bge1 flags=0<>
> laggport: bge0 flags=5<MASTER,ACTIVE>
>
> __________________________________________________________________________________
> Also nothing unusual on dmesg:
>
> .......
> bge0: link state changed to DOWN
> bge0: link state changed to UP
> bge1: link state changed to DOWN
> bge1: link state changed to UP
> bge0: link state changed to DOWN
> bge0: link state changed to UP
> bge1: link state changed to DOWN
> bge1: link state changed to UP
> bge0: link state changed to DOWN
> bge0: link state changed to UP
> bge1: link state changed to DOWN
> bge1: link state changed to UP
> .......
>
> The following is the related configuration in rc.conf:
>
> .......
> ifconfig_bge0="up"
> ifconfig_bge1="up"
> cloned_interfaces="lagg0"
> ifconfig_lagg0="laggproto failover laggport bge0 laggport bge1
> xxx.xx.xx.224/24"
> ifconfig_lagg0_alias_0="inet xxx.xx.xx.225/32"
> ifconfig_lagg0_alias_1="inet xxx.xx.xx.226/32"
> ifconfig_lagg0_alias_2="inet xxx.xx.xx.227/32"
> ifconfig_lagg0_alias_3="inet 172.16.3.2/27"
> ifconfig_lagg0_alias_4="inet 172.16.3.3/27"
> ifconfig_lagg0_alias_5="inet 172.16.3.4/27"
> ifconfig_lagg0_alias_6="inet 172.16.3.5/27"
> ifconfig_lagg0_alias_7="inet 172.16.3.6/27"
> .......
>
> The system is an IBM xSeries 336 type 8837
> kern.version: FreeBSD 8.2-RELEASE-p3 #0: Tue Sep 27 18:45:57 UTC 2011
>
> Just for the record, I've done the test from the host
> (xxx.xx.xx.224/24)
> not from any of the jail in place.
> Any idea or similar issue around? Am I missing something?
> Thanks.
>
>
>
> --
> Caselle da 1GB, trasmetti allegati fino a 3GB e in piu' IMAP, POP3 e
> SMTP autenticato? GRATIS solo con Email.it http://www.email.it/f
>
> Sponsor:
> Offerta speciale: a partire da soli Euro 18.90 puoi stampare le tue
> Foto su vera Tela Pittorica e creare Quadri fino a 80x50 cm!
> Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=11453&d=15-3
> _______________________________________________
> freebsd-questions at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-questions
> To unsubscribe, send any mail to
> "freebsd-questions-unsubscribe at freebsd.org"
Is this system connected to a switch with management capability? If so
how is the switch configured for the ports?
--
Thanks,
Dean E. Weimer
dweimer at dweimer.net
http://www.dweimer.net/
More information about the freebsd-questions
mailing list