Deployment Scenario 5: Moving SPX Links Between Modules in a PE Ring

Follow this procedure to upgrade an existing 1-Gbps SPX link between PEs to a 10-Gbps link. Use the same procedure to downgrade the 10-Gbps SPX link to 1 Gbps.

In Reference Topology, the PE ring is in the active state, and the PE ID configuration is generated in the running configuration. The SPX link between PE 18 and PE 19 is a 1-Gbps link.

ICX7750-48F Router# show spx
T=14d8h21m54.3: alone: standalone, D: dynamic cfg, S: static
ID   Type          Role    Mac Address    Pri State   Comment                   
1  S ICX7750-48XGF active  cc4e.24d0.3500 128 local   Ready
2  S ICX7750-48XGC standby 609c.9f1f.df00 128 remote  Ready
3  S ICX7750-48XGF member  cc4e.246e.d580   5 remote  Ready
17 S ICX7450-48GF  spx-pe  cc4e.246d.1178 N/A remote  Ready
18 S ICX7450-48P   spx-pe  cc4e.246d.22b8 N/A remote  Ready
19 S ICX7250-48P   spx-pe  cc4e.24b4.32e8 N/A remote  Ready
20 S ICX7450-24P   spx-pe  cc4e.248b.11e0 N/A remote  Ready
21 S ICX7250-24P   spx-pe  cc4e.24b4.7f20 N/A remote  Ready
22 S ICX7250-48    spx-pe  cc4e.24b4.4350 N/A remote  Ready

    active                    standby                                          
     +---+        +---+        +---+                                           
 -3/1| 1 |3/4--3/1| 3 |3/4--3/1| 2 |3/4-                                       
 |   +---+        +---+        +---+   |                                       
 |                                     |                                       
 |-------------------------------------|                                       
            +----+        +----+          +----+        +----+                 
  1/1/5==2/1| 17 |3/1--3/1| 18 |1/13--1/13| 19 |2/3--2/3| 20 |1/1-             
            +----+        +----+          +----+        +----+   |             
                                                                 |             
                                          +----+        +----+   |             
                               2/1/9--1/43| 22 |2/2--2/2| 21 |1/1-             
                                          +----+        +----+                 
                                                                               
ICX7750-48F Router# show spx ring all

  ------------------------------------------------------------------------------------
  Ring Id |FSM State |CB port  Lag  |Remote CB port  Lag  |Log Block Link
  ------------------------------------------------------------------------------------
  1        ACTIVE     1/1/5    3079  2/1/9           3075   PE20x--xPE21

ICX7750-48F Router# show running-config | include pe-id
  pe-id 1/1/5 17 18 19 20 21 22 2/1/9
ICX7750-48F Router# show interfaces brief ethernet 18/1/13 ethernet 19/1/13

Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
18/1/13    Up      Forward Full 1G    None  No  1    0   cc4e.246d.22c4                 
19/1/13    Up      Forward Full 1G    None  No  1    0   cc4e.24b4.32f4

Break the PE ring between PE 18 and PE 19. An SPX port with a live link cannot be disabled, so you must first physically disconnect the cable, in this example, between ports 18/1/13 and 19/1/13. After the cable is disconnected, ports 18/1/13 and 19/1/13 go down, and the PE ring state changes to BREAK.
```
SYSLOG: <14> Nov 10 10:47:47 System: Interface ethernet 19/1/13, state down 

SYSLOG: <13> Nov 10 10:47:48 SPX Ring Instance 1 state change to BREAK (CB2/1/9 - CB1/1/5). Logical block: Ring is broken - No Logical Block 

SYSLOG: <14> Nov 10 10:47:49 System: Interface ethernet 18/1/13, state down
```

The show spx ring all command confirms that the PE ring is in the break state. The show spx command shows two PE chains.

ICX7750-48F Router# show spx ring all

  ------------------------------------------------------------------------------------
  Ring Id |FSM State |CB port  Lag  |Remote CB port  Lag  |Log Block Link
  ------------------------------------------------------------------------------------
  1        BREAK      2/1/9    3075  1/1/5           3079   Ring is broken - No Logical Block
ICX7750-48F Router# show spx
T=15d5h19m42.7: alone: standalone, D: dynamic cfg, S: static
ID   Type          Role    Mac Address    Pri State   Comment                   
1  S ICX7750-48XGF active  cc4e.24d0.3500 128 local   Ready
2  S ICX7750-48XGC standby 609c.9f1f.df00 128 remote  Ready
3  S ICX7750-48XGF member  cc4e.246e.d580   5 remote  Ready
17 S ICX7450-48GF  spx-pe  cc4e.246d.1178 N/A remote  Ready
18 S ICX7450-48P   spx-pe  cc4e.246d.22b8 N/A remote  Ready
19 S ICX7250-48P   spx-pe  cc4e.24b4.32e8 N/A remote  Ready
20 S ICX7450-24P   spx-pe  cc4e.248b.11e0 N/A remote  Ready
21 S ICX7250-24P   spx-pe  cc4e.24b4.7f20 N/A remote  Ready
22 S ICX7250-48    spx-pe  cc4e.24b4.4350 N/A remote  Ready

    active                    standby                                          
     +---+        +---+        +---+                                           
 -3/1| 1 |3/4--3/1| 3 |3/4--3/1| 2 |3/4-                                       
 |   +---+        +---+        +---+   |                                       
 |                                     |                                       
 |-------------------------------------|                                       
            +----+        +----+                                               
  1/1/5==2/1| 17 |3/1--3/1| 18 |1/13-                                          
            +----+        +----+                                               
                                                                               
             +----+        +----+        +----+        +----+                  
  2/1/9--1/43| 22 |2/2--2/2| 21 |1/1--1/1| 20 |2/3--2/3| 19 |1/13-             
             +----+        +----+        +----+        +----+

Unconfigure SPX ports 18/1/13 and 19/1/13.

ICX7750-48F Router# configure terminal 
ICX7750-48F Router(config)# spx unit 18
ICX7750-48F Router(config-spx-unit-18)# no spx-port 18/1/13
spx-port 18/1/13 is removed
ICX7750-48F Router(config-spx-unit-18)#
SYSLOG: <14> Nov 10 10:48:57 PORT: 18/1/13 disabled by un-authenticated user from console session.

ICX7750-48F Router(config-spx-unit-18)# spx unit 19        
ICX7750-48F Router(config-spx-unit-19)# no spx-port 19/1/13
spx-port 19/1/13 is removed
ICX7750-48F Router(config-spx-unit-19)#
SYSLOG: <14> Nov 10 10:49:05 PORT: 19/1/13 disabled by un-authenticated user from console session.

ICX7750-48F Router(config-spx-unit-19)#

Unconfiguring the SPX ports automatically disables them.

ICX7750-48F Router(config-spx-unit-19)# show interfaces brief ethernet 18/1/13 ethernet 19/1/13

Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
18/1/13    Disable None    None None  None  No  1    0   cc4e.246d.22c4                 
19/1/13    Disable None    None None  None  No  1    0   cc4e.24b4.32f4

Ports 18/1/13 and 19/1/13 no longer appear in the show spx command output.

ICX7750-48F Router(config-spx-unit-19)# show spx
T=15d5h21m39.8: alone: standalone, D: dynamic cfg, S: static
ID   Type          Role    Mac Address    Pri State   Comment                   
1  S ICX7750-48XGF active  cc4e.24d0.3500 128 local   Ready
2  S ICX7750-48XGC standby 609c.9f1f.df00 128 remote  Ready
3  S ICX7750-48XGF member  cc4e.246e.d580   5 remote  Ready
17 S ICX7450-48GF  spx-pe  cc4e.246d.1178 N/A remote  Ready
18 S ICX7450-48P   spx-pe  cc4e.246d.22b8 N/A remote  Ready
19 S ICX7250-48P   spx-pe  cc4e.24b4.32e8 N/A remote  Ready
20 S ICX7450-24P   spx-pe  cc4e.248b.11e0 N/A remote  Ready
21 S ICX7250-24P   spx-pe  cc4e.24b4.7f20 N/A remote  Ready
22 S ICX7250-48    spx-pe  cc4e.24b4.4350 N/A remote  Ready

    active                    standby                                          
     +---+        +---+        +---+                                           
 -3/1| 1 |3/4--3/1| 3 |3/4--3/1| 2 |3/4-                                       
 |   +---+        +---+        +---+   |                                       
 |                                     |                                       
 |-------------------------------------|                                       
            +----+        +----+                                               
  1/1/5==2/1| 17 |3/1--3/1| 18 |                                               
            +----+        +----+                                               
                                                                               
             +----+        +----+        +----+        +----+                  
  2/1/9--1/43| 22 |2/2--2/2| 21 |1/1--1/1| 20 |2/3--2/3| 19 |                  
             +----+        +----+        +----+        +----+

At this stage, the PE ID configuration is still retained in the running configuration. The last step is to remove the PE ID configuration from the running configuration. To do so, revise the PE ID configuration for port 1/1/5, as shown. The alternative configuration PE ID 2/1/9 22 21 20 19 also works.

A syslog message confirms that the PE ring has been removed. The show spx ring all command also shows that the PE ring has been removed. The PE ID configuration now shows two PE chains.

SYSLOG: <13> Nov 10 10:51:09 SPX Ring Instance 1 is unconfigured (CB2/1/9 - CB1/1/5) 
ICX7750-48F Router# show spx ring all

 ICX7750-48F Router(config)# show interfaces brief ethernet 18/2/3 ethernet 19/2/1

Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
18/2/3     Up      Forward Full 10G   None  No  1    0   cc4e.246d.22eb                 
19/2/1     Up      Blocked Full 10G   None  No  1    0   cc4e.24b4.3319  

  pe-id 2/1/9 22 21 20 19

Bring up the ports on PE 18 and PE 19, in this case, ports 18/2/3 and 19/2/1. Enable the ports first if they are already disabled.

Configure ports 18/2/3 and 19/2/1 as SPX ports.

A syslog message confirms that the PE ring has been deployed. You can also use the PE-ring-related show commands to verify the status of the PE ring as described in Verification Commands: SPX PE Ring.

SYSLOG: <13> Nov 10 10:57:38 SPX Ring Instance 1 state change to IN-PROGRESS (CB1/1/5 - CB2/1/9). Logical block: PE18x--xPE19 

SYSLOG: <13> Nov 10 10:57:38 SPX Ring Instance 1 state change to ACTIVE (CB1/1/5 - CB2/1/9). Logical block: PE18x--xPE19
ICX7750-48F Router(config-spx-unit-19)#
SYSLOG: <13> Nov 10 10:57:38 SPX Ring Instance 1 state change to IN-PROGRESS (CB1/1/5 - CB2/1/9). Logical block: PE18x--xPE19 

SYSLOG: <13> Nov 10 10:57:38 SPX Ring Instance 1 state change to ACTIVE (CB1/1/5 - CB2/1/9). Logical block: PE18x--xPE19

Once the PE ring is formed, the relevant PE ID configuration is automatically generated in the running configuration. The new PE ID configuration merges the two PE ID chains into one PE ID ring configuration.
```
ICX7750-48F Router# show running-config | include pe-id
  pe-id 1/1/5 17 18 19 20 21 22 2/1/9
```

The show spx command displays the new 10-Gbps SPX link.

ICX7750-48F Router# show spx
T=15d5h32m33.0: alone: standalone, D: dynamic cfg, S: static
ID   Type          Role    Mac Address    Pri State   Comment                   
1  S ICX7750-48XGF active  cc4e.24d0.3500 128 local   Ready
2  S ICX7750-48XGC standby 609c.9f1f.df00 128 remote  Ready
3  S ICX7750-48XGF member  cc4e.246e.d580   5 remote  Ready
17 S ICX7450-48GF  spx-pe  cc4e.246d.1178 N/A remote  Ready
18 S ICX7450-48P   spx-pe  cc4e.246d.22b8 N/A remote  Ready
19 S ICX7250-48P   spx-pe  cc4e.24b4.32e8 N/A remote  Ready
20 S ICX7450-24P   spx-pe  cc4e.248b.11e0 N/A remote  Ready
21 S ICX7250-24P   spx-pe  cc4e.24b4.7f20 N/A remote  Ready
22 S ICX7250-48    spx-pe  cc4e.24b4.4350 N/A remote  Ready

    active                    standby                                          
     +---+        +---+        +---+                                           
 -3/1| 1 |3/4--3/1| 3 |3/4--3/1| 2 |3/4-                                       
 |   +---+        +---+        +---+   |                                       
 |                                     |                                       
 |-------------------------------------|                                       
            +----+        +----+        +----+        +----+        +----+     
  1/1/5==2/1| 17 |3/1--3/1| 18 |2/3--2/1| 19 |2/3--2/3| 20 |1/1--1/1| 21 |2/2- 
            +----+        +----+        +----+        +----+        +----+   | 
                                                                             | 
                                                                    +----+   | 
                                                         2/1/9--1/43| 22 |2/2- 
                                                                    +----+

Enter the write memory command to save the configuration.

ICX7750-48F Router# write memory 
Send "write mem" to 6 PEs: 17-22

Automatic copy to member units:  2  3
SYSLOG: <14> Nov 10 11:02:26 Security: startup-config was changed by operator from console 
Flash Memory Write (8192 bytes per dot) 
...
Copy Done.

RUCKUS ICX Switch Port Extender Deployment Guide 53-1004186-03

Deployment Scenario 5: Moving SPX Links Between Modules in a PE Ring