NetApp - Replacing CN1610 to 3132Q-V in NetApp Cluster

Cisco® Nexus 3132Q-V switches are recommended when CN1610 switches reach port density.

CN1610 is 10Gb switch with 16 ports. Ports 1-12 for connecting to NetApp controllers and 13-16 for ISL to other CN1610 switch.

Cisco® Nexus 3132Q-V supports both 10GbE and 40GbE. Default configuration script supports

 6 QSFP ports 1-6 configured in 4x10GbE ports

 24 QSFP ports 7-30 configured 40GbE

 2 QSFP ports 31-32 per switch for Inter-switch Link (ISL)

Naming conventions:

CN1610-1 - 1st cluster switch

CN1610-2 - 2nd cluster switch

C3132QV-1 - 1st new cluster  switch

C3132QV-2 - 2nd new cluster  switch

Steps:

1.)  Disable automatic revert of a Cluster LIFs

2.)  Migrate Cluster LIFs from CN1610-2

3.)  Disable network ports connected to CN1610-2

4.)  Disconnect cluster network cable from CN1610-2

5.)  Disconnect the ISL between CN1610-2 and CN1610-1

6.)  Temporary ISL between CN1610-1 and C3132QV-1 using breakout cable 40GbE to 4*10GbE

7.)  Connect new cluster network cable to C3132QV-1

8.)  Enable cluster network ports

9.)  Revert migrated LIFs to C3132QV-1

10.) Migrate LIFs from CN1610-1 to C3132QV-1

11.) Disable network ports connected to CN1610-1

12.) Disconnect cluster network cable from CN1610-1

15.) Connect new cluster network to C3132QV-2

16.) Enable cluster network ports

13.) Disconnect ISL between  CN1610-1 and C3132QV-1

14.) Connect ISL between C3132QV-1 and C3132QV-2

17.) Revert migrated LIFs to C3132QV-2

18.) Enable automatic revert of cluster LIFs

Steps with commands ---

>network device-discovery show
>network port show -role cluster
>network interface show -role cluster
>system cluster-switch show
         
verify correct version of RCF is installed.
>network interface migrate -vserver cluster -lif n1-clus2 -source-node n1  -destination-node n1 -destination-port e0a
>network interface migrate -vserver cluster -lif n1-clus3 -source-node n1  -destination-node n1 -destination-port e0d
>network interface migrate -vserver cluster -lif n2-clus2 -source-node n2  -destination-node n2 -destination-port e0a
>network interface migrate -vserver cluster -lif n1-clus3 -source-node n2  -destination-node n2 -destination-port e0d

> network interface show -role cluster
>system node autosupport invoke -node * -type all -message MAINT=2h

>network port modify -node n1 -port e0b -up-admin false
>network port modify -node n1 -port e0c -up-admin false
>network port modify -node n2 -port e0b -up-admin false
>network port modify -node n2 -port e0c -up-admin false

>cluster ping-cluster -node n1

shutdown down the ISL port on switch CN1610-1
#configure
#interface 0/13-0/16
#shutdown
#exit
#exit

On switch 3132QV-1 configure temporary ISL for CN1610-1
#configure
#interface port-channel 2
#switchport mode trunk
#spanning-tree port type network
# mtu 9216
#interface breakout module 1 port 24 map 10g-4x
#interface e1/24/1-4
#switchport mode trunk
#mtu 9216
#channel-group 2 mode active
#exit
#exit

On CN1610-1 to make ISL dynamic
#configure
#interface 3/1
#no port-channel static
#exit
#interface 0/13-0/16,3/1
#no shutdown
#exit
#show port-channel 3/1
# show port-channel summary

> set -priv diag
*> network port modify -node n1 -port e0b -up-admin true
*> network port modify -node n1 -port e0c -up-admin true
*> network port modify -node n2 -port e0b -up-admin true
*> network port modify -node n2 -port e0c -up-admin true


*> network interface revert -vserver cluster -lif n1_clus2
*> network interface revert -vserver cluster -lif n1_clus3
*> network interface revert -vserver cluster -lif n2_clus2
*> network interface revert -vserver cluster -lif n2_clus3

*>network interface show -role cluster
*>network port show -role cluster
*>cluster ping-cluster -node n1



>network interface migrate -vserver cluster -lif n1-clus1 -source-node n1  -destination-node n1 -destination-port e0b
>network interface migrate -vserver cluster -lif n1-clus4 -source-node n1  -destination-node n1 -destination-port e0c
>network interface migrate -vserver cluster -lif n2-clus1 -source-node n2  -destination-node n2 -destination-port e0b
>network interface migrate -vserver cluster -lif n1-clus4 -source-node n2  -destination-node n2 -destination-port e0c

> network interface show -role cluster

>network port modify -node n1 -port e0a -up-admin false
>network port modify -node n1 -port e0d -up-admin false
>network port modify -node n2 -port e0a -up-admin false
>network port modify -node n2 -port e0d -up-admin false

>cluster ping-cluster -node n1


On switch 3132QV-2
#configure
#interface Ethernet 1/24
#shutdown
#exit
#interface Ethernet 1/31-32
#shutdown
#exit
#configure
#no interface breakout modue 1 prot 24 map 10g-4x
#no interface port-channel 2
#interface e1/24
#destription 40GbE Node Port
#spanning-tree port type edge
#spanning -tree bpugruad enable
#mtu 9216
#exit
#exit

Bring up the ISL port 32 on 3132QV-2

#configure
#interface Ethernet 1/31-32
#no shutdown
#exit
#show port-channel summary
#exit

on 3132QV-1

# show port-channel summary

> set -priv diag
*> network port modify -node n1 -port e0a -up-admin true
*> network port modify -node n1 -port e0d -up-admin true
*> network port modify -node n2 -port e0a -up-admin true
*> network port modify -node n2 -port e0d -up-admin true


*> network interface revert -vserver cluster -lif n1_clus1
*> network interface revert -vserver cluster -lif n1_clus4
*> network interface revert -vserver cluster -lif n2_clus1
*> network interface revert -vserver cluster -lif n2_clus4

*>network interface show -role cluster
*>network port show -role cluster
*>cluster ping-cluster -node n1
>network device-discovery show
>network port show -role cluster
>network interface show -role cluster
>system cluster-switch show

Bye...