NetApp - Replacing CN1610 to 3132Q-V in NetApp Cluster
Cisco® Nexus 3132Q-V switches are recommended when CN1610 switches reach
port density.
CN1610 is 10Gb switch with 16 ports. Ports 1-12 for connecting to NetApp
controllers and 13-16 for ISL to other CN1610 switch.
Cisco® Nexus 3132Q-V supports both 10GbE and 40GbE. Default configuration
script supports
6 QSFP ports 1-6 configured in 4x10GbE ports
24 QSFP ports 7-30 configured 40GbE
2 QSFP ports 31-32 per switch for Inter-switch Link (ISL)
Naming conventions:
CN1610-1 - 1st cluster switch
CN1610-2 - 2nd cluster switch
C3132QV-1 - 1st new cluster switch
C3132QV-2 - 2nd new cluster switch
Steps:
1.) Disable automatic revert of a Cluster LIFs
2.) Migrate Cluster LIFs from CN1610-2
3.) Disable network ports connected to CN1610-2
4.) Disconnect cluster network cable from CN1610-2
5.) Disconnect the ISL between CN1610-2 and CN1610-1
6.) Temporary ISL between CN1610-1 and C3132QV-1 using breakout
cable 40GbE to 4*10GbE
7.) Connect new cluster network cable to C3132QV-1
8.) Enable cluster network ports
9.) Revert migrated LIFs to C3132QV-1
10.) Migrate LIFs from CN1610-1 to C3132QV-1
11.) Disable network ports connected to CN1610-1
12.) Disconnect cluster network cable from CN1610-1
15.) Connect new cluster network to C3132QV-2
16.) Enable cluster network ports
13.) Disconnect ISL between CN1610-1 and C3132QV-1
14.) Connect ISL between C3132QV-1 and C3132QV-2
17.) Revert migrated LIFs to C3132QV-2
18.) Enable automatic revert of cluster LIFs
Steps with commands ---
>network device-discovery show
>network port show -role cluster
>network interface show -role cluster
>system cluster-switch show
verify correct version of RCF is installed.
>network interface migrate -vserver cluster -lif n1-clus2 -source-node n1 -destination-node n1 -destination-port e0a
>network interface migrate -vserver cluster -lif n1-clus3 -source-node n1 -destination-node n1 -destination-port e0d
>network interface migrate -vserver cluster -lif n2-clus2 -source-node n2 -destination-node n2 -destination-port e0a
>network interface migrate -vserver cluster -lif n1-clus3 -source-node n2 -destination-node n2 -destination-port e0d
> network interface show -role cluster
>system node autosupport invoke -node * -type all -message MAINT=2h
>network port modify -node n1 -port e0b -up-admin false
>network port modify -node n1 -port e0c -up-admin false
>network port modify -node n2 -port e0b -up-admin false
>network port modify -node n2 -port e0c -up-admin false
>cluster ping-cluster -node n1
shutdown down the ISL port on switch CN1610-1
#configure
#interface 0/13-0/16
#shutdown
#exit
#exit
On switch 3132QV-1 configure temporary ISL for CN1610-1
#configure
#interface port-channel 2
#switchport mode trunk
#spanning-tree port type network
# mtu 9216
#interface breakout module 1 port 24 map 10g-4x
#interface e1/24/1-4
#switchport mode trunk
#mtu 9216
#channel-group 2 mode active
#exit
#exit
On CN1610-1 to make ISL dynamic
#configure
#interface 3/1
#no port-channel static
#exit
#interface 0/13-0/16,3/1
#no shutdown
#exit
#show port-channel 3/1
# show port-channel summary
> set -priv diag
*> network port modify -node n1 -port e0b -up-admin true
*> network port modify -node n1 -port e0c -up-admin true
*> network port modify -node n2 -port e0b -up-admin true
*> network port modify -node n2 -port e0c -up-admin true
*> network interface revert -vserver cluster -lif n1_clus2
*> network interface revert -vserver cluster -lif n1_clus3
*> network interface revert -vserver cluster -lif n2_clus2
*> network interface revert -vserver cluster -lif n2_clus3
*>network interface show -role cluster
*>network port show -role cluster
*>cluster ping-cluster -node n1
>network interface migrate -vserver cluster -lif n1-clus1 -source-node n1 -destination-node n1 -destination-port e0b
>network interface migrate -vserver cluster -lif n1-clus4 -source-node n1 -destination-node n1 -destination-port e0c
>network interface migrate -vserver cluster -lif n2-clus1 -source-node n2 -destination-node n2 -destination-port e0b
>network interface migrate -vserver cluster -lif n1-clus4 -source-node n2 -destination-node n2 -destination-port e0c
> network interface show -role cluster
>network port modify -node n1 -port e0a -up-admin false
>network port modify -node n1 -port e0d -up-admin false
>network port modify -node n2 -port e0a -up-admin false
>network port modify -node n2 -port e0d -up-admin false
>cluster ping-cluster -node n1
On switch 3132QV-2
#configure
#interface Ethernet 1/24
#shutdown
#exit
#interface Ethernet 1/31-32
#shutdown
#exit
#configure
#no interface breakout modue 1 prot 24 map 10g-4x
#no interface port-channel 2
#interface e1/24
#destription 40GbE Node Port
#spanning-tree port type edge
#spanning -tree bpugruad enable
#mtu 9216
#exit
#exit
Bring up the ISL port 32 on 3132QV-2
#configure
#interface Ethernet 1/31-32
#no shutdown
#exit
#show port-channel summary
#exit
on 3132QV-1
# show port-channel summary
> set -priv diag
*> network port modify -node n1 -port e0a -up-admin true
*> network port modify -node n1 -port e0d -up-admin true
*> network port modify -node n2 -port e0a -up-admin true
*> network port modify -node n2 -port e0d -up-admin true
*> network interface revert -vserver cluster -lif n1_clus1
*> network interface revert -vserver cluster -lif n1_clus4
*> network interface revert -vserver cluster -lif n2_clus1
*> network interface revert -vserver cluster -lif n2_clus4
*>network interface show -role cluster
*>network port show -role cluster
*>cluster ping-cluster -node n1
>network device-discovery show
>network port show -role cluster
>network interface show -role cluster
>system cluster-switch show
Bye...