VSF testing for 2930

Contents
Switches ........................................................................................................................................ 1
SW versions ................................................................................................................................... 1
Basic procedure ............................................................................................................................. 2
Configuration................................................................................................................................. 3
VSF show command ....................................................................................................................... 3
Show VSF detail ......................................................................................................................... 3
show vsf topology ...................................................................................................................... 4
show vsf link .............................................................................................................................. 4
show vsf member 1.................................................................................................................... 4
show vsf member 2.................................................................................................................... 5
Add another link to VSF ................................................................................................................. 5
Add new link to chain .................................................................................................................... 6
show vsf link detail..................................................................................................................... 6
Remove links ................................................................................................................................. 6
Split Brain and Multi Access Detection (MAD) ................................................................................ 7
Configure Vlan-Mad ....................................................................................................................... 8
Show VLAN-MAD status ............................................................................................................. 8
Disconnect the VSF links ............................................................................................................ 9
show vsf vlan-mad ..................................................................................................................... 9
Reconnected VSF links ............................................................................................................... 9

Switches
A pair of JL261A 2930F 24 POE+ 4 SFP switches were used for testing

SW versions
Aruba-VSF-2930F(config)# sh version
Image stamp:
/ws/swbuildm/rel_tacoma_qaoff/code/build/lvm(swbuildm_rel_tacoma_qaoff_rel_taco
ma)
Dec 15 2016 10:06:00
WC.16.03.0003
73
Boot Image: Secondary

Boot ROM Version: WC.16.01.0003

Active Boot ROM: Primary

Aruba-VSF-2930F(config)#

Test topology
Sample topology for 2 node VSF core switch.

Server #1

LACP

SFP+ DAC (ProVision) SFP+ DAC (ProVision)

VSF Links

SFP+ DAC (ProVision) (2)

25 26 27 28 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 2930F
JL253A

UID
Console Ports 25 26 27 28 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 2930F
Spd
LED JL253A
Mode

Usr UID
Console Ports
Spd
10/100/1000 BASE-T Ports (1-24) Speed Mode: Off = 10 or 100Mbps Slow Flash = 1Gbps LED
10Gbe SFP+ Ports On = 10Gbps Reset Clear Mode

Usr

10Gbe SFP+ Ports 10/100/1000 BASE-T Ports (1-24) Speed Mode: Off = 10 or 100Mbps Slow Flash = 1Gbps On = 10Gbps Reset Clear

Aruba 2930F 24G 4SFP+ Switch #1 Aruba 2930F 24G 4SFP+ Switch #2

Vlan-MAD
link
1000Base-T

1000Base-T 1000Base-T

LACP

25 26 27 28 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 2540
JL354A

UID
Console Ports
Spd
LED
Usr Mode

10GbE SFP+ Ports 10/100/1000 BASE-T Ports (1-24) Speed Mode: Off = 10 or 100Mbps Slow Flash = 1Gbps On = 10Gbps Reset Clear

Aruba 2540 24G 4SFP+ Switch

Figure 1: Test Topology

Basic procedure
With 2 Aruba 2930 (JL261A) switches, both with a factory-default configuration, you can configure
VSF in 2 steps.

Step 1:
Add ports to the VSF link on 1st switch - Enable VSF and assign a domain
(config)# vsf member 1 link 1 1/24
(config)# vsf enable domain 1
(config)# vsf port 1g # (Optional but no 10G interfaces on JL261A)
Step 2:
Verify 2nd switch has a factory-default configuration and connect 2nd switch to the VSF port on 1st
switch
2nd switch will automatically enable VSF and add the connected port to the VSF link
The second switch will reboot and come up as a standby node. It took a few minutes for the
configuration to sync. I was unable to configure and save config until the stack synchronised
Aruba-VSF-2930F(config)# wr m
Redundant Standby Management Module syncing is in progress. Configuration
changes are temporarily disabled

Configuration
vsf
enable domain 100
member 1
type "JL261A" mac-address b05ada-963e00
priority 128
link 1 1/24
link 1 name "I-Link1_1"
link 2 name "I-Link1_2"
exit
member 2
type "JL261A" mac-address b05ada-964340
priority 128
link 1 2/24
link 1 name "I-Link2_1"
link 2 name "I-Link2_2"
exit
port-speed 1g
exit

VSF show command

As I added only one link and port to the VSF domain the topology is “chain”

Show VSF detail

Aruba-VSF-2930F(config)# show vsf detail
VSF Domain ID : 100
MAC Address : b05ada-963e03
VSF Topology : Chain
VSF Status : Active
Uptime : 0d 1h 32m
VSF MAD : None
VSF Port Speed : 1G
Software Version : WC.16.03.0003

Name : Aruba-VSF-2930F
Contact :
Location :

Member ID :1
MAC Address : b05ada-963e00
Type : JL261A
Model : Aruba JL261A 2930F-24G-PoE+-4SFP Switch
Priority : 128
Status : Commander
ROM Version : WC.16.01.0003
Serial Number : CN65HL20CR
Uptime : 0d 1h 32m
CPU Utilization : 0%
Memory - Total : 350,323,200 bytes
Free : 236,992,876 bytes
VSF Links -
#1 : Active, Peer member 2
#2 : Inactive

Member ID :2
MAC Address : b05ada-964340
Type : JL261A
Model : Aruba JL261A 2930F-24G-PoE+-4SFP Switch
Priority : 128
Status : Standby
ROM Version : WC.16.01.0003
Serial Number : CN65HL2001
Uptime : 0d 0h 39m
CPU Utilization : 0%
Memory - Total : 350,323,200 bytes
Free : 250,498,252 bytes
VSF Links -
#1 : Active, Peer member 1
#2 : Inactive

show vsf topology

VSF member's interconnection with links:
Stby Cmdr
+---+ +---+
| 2 |1==1| 1 |
+---+ +---+
show vsf link
VSF Member 1

Link Peer Peer

Link Link-Name State Member Link
---- ---------- -------- ------ ----
1 I-Link1_1 Up 2 1
2 I-Link1_2 Down 0 0

VSF Member 2

Link Peer Peer

Link Link-Name State Member Link
---- ---------- -------- ------ ----
1 I-Link2_1 Up 1 1
2 I-Link2_2 Down 0 0

show vsf member 1

Member ID :1
MAC Address : b05ada-963e00
Type : JL261A
Model : Aruba JL261A 2930F-24G-PoE+-4SFP Switch
Priority : 128
Status : Commander
ROM Version : WC.16.01.0003
Serial Number : CN65HL20CR
Uptime : 0d 1h 42m
CPU Utilization : 2%
Memory - Total : 350,323,200 bytes
Free : 236,992,780 bytes
VSF Links -
#1 : Active, Peer member 2
#2 : Inactive

show vsf member 2

Member ID :2
MAC Address : b05ada-964340
Type : JL261A
Model : Aruba JL261A 2930F-24G-PoE+-4SFP Switch
Priority : 128
Status : Standby
ROM Version : WC.16.01.0003
Serial Number : CN65HL2001
Uptime : 0d 0h 49m
CPU Utilization : 0%
Memory - Total : 350,323,200 bytes
Free : 250,498,252 bytes
VSF Links -
#1 : Active, Peer member 1
#2 : Inactive
Aruba-VSF-2930F(config)#

Add another link to VSF

Aruba-VSF-2930F(config)# vsf member 1 link 2 1/23
All configuration on this port has been removed and port is placed in VSF mode.

I now have to add this to member 2

Aruba-VSF-2930F(config)# vsf member 2 link 2 2/23
All configuration on this port has been removed and port is placed in VSF mode.

That did not work

vsf
enable domain 100
member 1
type "JL261A" mac-address b05ada-963e00
priority 128
link 1 1/24
link 1 name "I-Link1_1"
link 2 1/23
link 2 name "I-Link1_2"
exit
member 2
type "JL261A" mac-address b05ada-964340
priority 128
link 1 2/24
link 1 name "I-Link2_1"
link 2 2/23
link 2 name "I-Link2_2"
exit
port-speed 1g
exit

show vsf link detail

VSF Member: 1 Link: 1

Port State
-------- ------------
1/24 Up: Connected to port 2/24

VSF Member: 1 Link: 2

Port State
-------- ------------
1/23 Error: No response from peer
VSF Member: 2 Link: 1

Port State
-------- ------------
2/24 Up: Connected to port 1/24

VSF Member: 2 Link: 2

Port State
-------- ------------
2/23 Error: Port connected to self

Add new link to chain

Aruba-VSF-2930F(config)#

vsf
enable domain 100
member 1
type "JL261A" mac-address b05ada-963e00
priority 128
link 1 1/23-1/24
link 1 name "I-Link1_1"
exit
member 2
type "JL261A" mac-address b05ada-964340
priority 128
link 1 2/23-2/24
link 1 name "I-Link2_1"
exit
port-speed 1g
exit

show vsf link detail

VSF Member: 1 Link: 1

Port State
-------- ------------
1/23 Up: Connected to port 2/23
1/24 Up: Connected to port 2/24

VSF Member: 2 Link: 1

Port State
-------- ------------
2/23 Up: Connected to port 1/23
2/24 Up: Connected to port 1/24

Aruba-VSF-2930F(config)#

Remove links
When all the links are disconnected I lost console access as I was plugged into the standby.

Attaching console to commander I was able to look at VSF topology

Aruba-VSF-2930F# sh vsf

VSF Domain ID : 100

MAC Address : b05ada-963e03
VSF Topology : No Stack Formed
VSF Status : Fragment Active
Uptime : 0d 5h 55m
VSF MAD : None
VSF Port Speed : 1G
Software Version : WC.16.03.0003

Mbr
ID MAC Address Model Pri Status
--- ------------- -------------------------------------- --- ---------------
*1 b05ada-963e00 Aruba JL261A 2930F-24G-PoE+-4SFP Sw... 128 Commander
2 b05ada-964340 Aruba JL261A 2930F-24G-PoE+-4SFP Sw... 128 Missing

Reconnect Links

I reconnected the link and deliberately reversed the previous connection 1/23 – 2/24

1/24 – 2/23. After a brief delay the standby switch rebooted to re-join fabric. VSF fabric was
restored and the link connection updated to reflect the new patching.
Aruba-VSF-2930F# sh vsf

VSF Domain ID : 100

MAC Address : b05ada-963e03
VSF Topology : Chain
VSF Status : Active
Uptime : 0d 6h 2m
VSF MAD : None
VSF Port Speed : 1G
Software Version : WC.16.03.0003

Mbr
ID MAC Address Model Pri Status
--- ------------- -------------------------------------- --- ---------------
*1 b05ada-963e00 Aruba JL261A 2930F-24G-PoE+-4SFP Sw... 128 Commander
2 b05ada-964340 Aruba JL261A 2930F-24G-PoE+-4SFP Sw... 128 Standby

Aruba-VSF-2930F# sh vsf link detail

VSF Member: 1 Link: 1

Port State
-------- ------------
1/23 Up: Connected to port 2/24
1/24 Up: Connected to port 2/23

VSF Member: 2 Link: 1

Port State
-------- ------------
2/23 Up: Connected to port 1/24
2/24 Up: Connected to port 1/23

Aruba-VSF-2930F#

Split Brain and Multi Access Detection (MAD)

The VSF system is operating with a single MAC Address, since it is operating as a single logical switch.
This means that all VSF members are using the same MAC and IP address. When all the VSF links are
down, there will be 2 Commanders, since these switches only see failed stacking links. They cannot
see the difference between a failed stacking link, and the fact that the former member is down. If a
Standby doesn’t see the Commander, it will promote itself to the Commander role; and since the
original Commander can’t see the Standby, it just assumes the Standby has failed.
This situation can result if very confusing results for the rest of the network. For example:
• When STP would be operating, both Commanders would have their own STP process and
logic, but they would be seen by the peer devices with the same bridge ID.
• The same applies to LACP: while each Commander operates its own link-aggregations, they
will be seen by the peer devices using the same LACP system ID.
• In the case of routing protocols, such as OSPF, each Commander would have its own LSDB
and would be announcing its own OSPF Router LSA, with the SAME router ID.

For this reason we should configure a MAD method. The 2930 supports LLDP-MAD and Vlan-MAD.
LLDP-MAD requires an upstream switch to be configured as LACP peer with SNMPv2 read access.
This document will cover a simple 2 node Vlan MAD deployment that may be used for a SMB core
Configure Vlan-Mad
Vlan-Mad is the preferred method of Multi Access Detection on the 2930F switches. MAD is more
critical when VSF is deployed in the distribution or core of the network.

The Vlan-Mad configuration only accepts 1 port per switch so for 3 and 4 node VSF stacks you will
need an external switch or hub to provide connectivity for all members. For a 2 switch stack you can
directly interconnect the switch ports.

vlan 666 untag 1/1,2/1

vlan 666 name Vlan-MAD
vsf vlan-mad 666

Show config
vsf
enable domain 100
member 1
type "JL261A" mac-address b05ada-963e00
priority 128
link 1 1/23-1/24
link 1 name "I-Link1_1"
exit
member 2
type "JL261A" mac-address b05ada-964340
priority 128
link 1 2/23-2/24
link 1 name "I-Link2_1"
link 2 name "I-Link2_2"
exit
vlan-mad 666
port-speed 1g
exit
vlan 666
name "Vlan-MAD"
untagged 1/1,2/1
no ip address
exit
Show VLAN-MAD status
Aruba-VSF-2930F(config)# sho vsf vlan-mad

Multi-Active Detection VLAN status :

VLAN ID : 666
VLAN NAME : VLAN666
VLAN MAD Connectivity Status : Full
 Port Status Member State
----- ------- ---------------
1/1 Up Commander
2/1 Up Standby

Disconnect the VSF links

Aruba-VSF-2930F(config)# vsf vlan-mad 666
I 01/01/90 08:37:36 04992 vsf: ST1-CMDR: VSF port 1/24 is in error state
I 01/01/90 08:37:37 04992 vsf: ST1-CMDR: VSF port 1/24 is down
I 01/01/90 08:37:37 04992 vsf: ST2-STBY: VSF port 2/23 is in error state
I 01/01/90 08:37:38 04992 vsf: ST2-STBY: VSF port 2/23 is down

Aruba-VSF-2930F(config)#
I 01/01/90 08:37:47 04992 vsf: ST1-CMDR: VSF port 1/23 is in error state
I 01/01/90 08:37:47 04992 vsf: ST1-CMDR: VSF link 1 is down
W 01/01/90 08:37:47 03258 stacking: ST1-CMDR: Standby switch with Member ID 2
removed due to loss of communication
I 01/01/90 08:37:47 03272 stacking: ST1-CMDR: Stack fragment active
I 01/01/90 08:37:47 03271 stacking: ST1-CMDR: Topology is a Standalone
I 01/01/90 08:37:47 00077 ports: ST1-CMDR: port 2/1 is now off-line
W 01/01/90 08:37:47 05266 vlanMad: ST1-CMDR: VSF MAD VLAN connectivity status
changed from Full to Partial.
I 01/01/90 08:37:47 04992 vsf: ST1-CMDR: VSF port 1/23 is down
I 01/01/90 08:37:50 00077 ports: ST1-CMDR: port 1/1 is now off-line
I 01/01/90 08:37:50 00002 vlan: ST1-CMDR: Vlan-MAD virtual LAN disabled
W 01/01/90 08:37:50 05266 vlanMad: ST1-CMDR: VSF MAD VLAN connectivity status
changed from Partial to None.

show vsf vlan-mad

Multi-Active Detection VLAN status :

VLAN ID : 666
VLAN NAME : Vlan-MAD
VLAN MAD Connectivity Status : None

Port Status Member State

----- ------- ---------------
1/1 Down Commander
2/1 Down Missing

Reconnected VSF links

I 01/01/90 08:44:30 04988 vsf: ST1-CMDR: VSF link 1 port 1/23 up: Peer validated
I 01/01/90 08:44:30 04987 vsf: ST1-CMDR: VSF link 1 up: Peer has mac
b05ada-964340
I 01/01/90 08:44:35 04992 vsf: ST1-CMDR: VSF link 1 is up
I 01/01/90 08:44:35 03279 stacking: ST1-CMDR: Member 2 (b05ada-964340) chosen as
standby. Reason: Only available standby
I 01/01/90 08:44:35 03125 mgr: ST1-CMDR: Startup configuration changed by SNMP.
New seq. number 22
I 01/01/90 08:44:41 04988 vsf: ST1-CMDR: VSF link 1 port 1/24 up: Peer validated
I 01/01/90 08:44:57 04992 vsf: ST1-CMDR: VSF port 1/24 is in error state
I 01/01/90 08:44:57 04992 vsf: ST1-CMDR: VSF port 1/23 is in error state
I 01/01/90 08:44:57 04992 vsf: ST1-CMDR: VSF link 1 is down
I 01/01/90 08:44:57 04992 vsf: ST1-CMDR: VSF port 1/23 is down
I 01/01/90 08:44:58 04992 vsf: ST1-CMDR: VSF port 1/24 is down

At this point the standby switch will reboot and re-join the VSF stack

i 01/01/90 08:45:47 04988 vsf: st1-cmdr: vsf link 1 port 1/23 up: peer validated
i 01/01/90 08:45:47 04987 vsf: st1-cmdr: vsf link 1 up: peer has mac
b05ada-964340
i 01/01/90 08:45:48 04988 vsf: st1-cmdr: vsf link 1 port 1/24 up: peer validated
i 01/01/90 08:45:53 04992 vsf: st1-cmdr: vsf link 1 is up
i 01/01/90 08:45:53 03279 stacking: st1-cmdr: member 2 (b05ada-964340) chosen as
 standby. reason: only available standby
i 01/01/90 08:45:53 03125 mgr: st1-cmdr: startup configuration changed by snmp.
new seq. number 23
w 01/01/90 08:45:53 03270 stacking: st1-cmdr: topology is a chain
i 01/01/90 08:45:53 03803 chassis: st1-cmdr: system self test completed on
2/1-28
i 01/01/90 08:45:55 02555 chassis: st1-cmdr: co-processor ready
w 01/01/90 08:45:55 03270 stacking: st1-cmdr: topology is a chain
i 01/01/90 08:45:55 00256 ports: st1-cmdr: port 2/23 is reserved for vsf use
i 01/01/90 08:45:55 00256 ports: st1-cmdr: port 2/24 is reserved for vsf use
i 01/01/90 08:45:56 00539 stacking: st1-cmdr: initial sync to standby starting
i 01/01/90 08:45:58 00076 ports: st1-cmdr: port 2/1 is now on-line
w 01/01/90 08:45:58 05266 vlanmad: st1-cmdr: vsf mad vlan connectivity status
changed from none to partial.
i 01/01/90 08:45:58 00001 vlan: st1-cmdr: vlan-mad virtual lan enabled
i 01/01/90 08:45:58 00076 ports: st1-cmdr: port 1/1 is now on-line
w 01/01/90 08:45:58 05266 vlanmad: st1-cmdr: vsf mad vlan connectivity status
changed from partial to full.
i 01/01/90 08:46:03 00540 stacking: st1-cmdr: redundant standby management
module syncing is in progress. configuration changes are temporarily
blocked
i 01/01/90 08:46:04 00061 system: st2-stby: ------------------------------------
-----
i 01/01/90 08:46:04 00063 system: st2-stby: member 2 went down: 01/01/90
08:44:55
m 01/01/90 08:46:04 00064 system: st2-stby: reboot of member id 2, lost merge
i 01/01/90 08:46:55 03260 stacking: st2-stby: member booted
i 01/01/90 08:46:55 03272 stacking: st1-cmdr: stack active
i 01/01/90 08:46:55 00540 stacking: st1-cmdr: redundant standby management
module syncing is complete. configuration changes are allowed