Deployment Scenario 3: Adding a New PE Unit to an Existing PE Ring

  1. Consider the following PE ring with five PEs.
    ICX7750-48F Router# show spx
    T=22d5h50m43.9: alone: standalone, D: dynamic cfg, S: static
    ID   Type          Role    Mac Address    Pri State   Comment                   
    1  S ICX7750-48XGF active  cc4e.24d0.3500 128 local   Ready
    2  S ICX7750-48XGC standby 609c.9f1f.df00 128 remote  Ready
    3  S ICX7750-48XGF member  cc4e.246e.d580   5 remote  Ready
    17 S ICX7450-48GF  spx-pe  cc4e.246d.1178 N/A remote  Ready
    18 S ICX7450-48P   spx-pe  cc4e.246d.22b8 N/A remote  Ready
    19 S ICX7250-48P   spx-pe  cc4e.24b4.32e8 N/A remote  Ready
    20 S ICX7450-24P   spx-pe  cc4e.248b.11e0 N/A remote  Ready
    21 S ICX7250-24P   spx-pe  cc4e.24b4.7f20 N/A remote  Ready
    
        active                    standby                                          
         +---+        +---+        +---+                                           
     -3/1| 1 |3/4--3/1| 3 |3/4--3/1| 2 |3/4-                                       
     |   +---+        +---+        +---+   |                                       
     |                                     |                                       
     |-------------------------------------|                                       
                +----+        +----+        +----+        +----+        +----+     
      1/1/5==2/1| 17 |3/1--3/1| 18 |2/3--2/1| 19 |2/3--2/3| 20 |1/1--1/1| 21 |2/3- 
                +----+        +----+        +----+        +----+        +----+   | 
                                                                                 | 
                                                                                 | 
                                                                           1/1/23- 
  2. Break the PE ring at the point where it needs to be split. An SPX port with a live link cannot be disabled, so you must physically disconnect the cable from that port first. In this example, the PE ring is split between PE 21 and the CB active controller. After the cable is removed from the live link, ports 1/1/23 and 21/2/3 go down, and the PE ring state changes to BREAK.
    ICX7750-48F Router#
    SYSLOG: <14> Nov 17 11:22:21 System: Interface ethernet 1/1/23, state down 
    
    SYSLOG: <14> Nov 17 11:22:21 System: Interface ethernet 21/2/3, state down 
    
    SYSLOG: <13> Nov 17 11:22:22 SPX Ring Instance 1 state change to BREAK (CB1/1/5 - CB1/1/23). Logical block: Ring is broken - No Logical Block
    
  3. The show spx ring all command indicates that the PE ring is in the break state, and the show spx command displays the broken PE ring.
    ICX7750-48F Router# show spx      
    T=22d5h54m16.0: alone: standalone, D: dynamic cfg, S: static
    ID   Type          Role    Mac Address    Pri State   Comment                   
    1  S ICX7750-48XGF active  cc4e.24d0.3500 128 local   Ready
    2  S ICX7750-48XGC standby 609c.9f1f.df00 128 remote  Ready
    3  S ICX7750-48XGF member  cc4e.246e.d580   5 remote  Ready
    17 S ICX7450-48GF  spx-pe  cc4e.246d.1178 N/A remote  Ready
    18 S ICX7450-48P   spx-pe  cc4e.246d.22b8 N/A remote  Ready
    19 S ICX7250-48P   spx-pe  cc4e.24b4.32e8 N/A remote  Ready
    20 S ICX7450-24P   spx-pe  cc4e.248b.11e0 N/A remote  Ready
    21 S ICX7250-24P   spx-pe  cc4e.24b4.7f20 N/A remote  Ready
    
        active                    standby                                          
         +---+        +---+        +---+                                           
     -3/1| 1 |3/4--3/1| 3 |3/4--3/1| 2 |3/4-                                       
     |   +---+        +---+        +---+   |                                       
     |                                     |                                       
     |-------------------------------------|                                       
                +----+        +----+        +----+        +----+        +----+     
      1/1/5==2/1| 17 |3/1--3/1| 18 |2/3--2/1| 19 |2/3--2/3| 20 |1/1--1/1| 21 |2/3- 
                +----+        +----+        +----+        +----+        +----+     
                                                                                   
    ICX7750-48F Router# show spx ring all
    
      ------------------------------------------------------------------------------------
      Ring Id |FSM State |CB port  Lag  |Remote CB port  Lag  |Log Block Link
      ------------------------------------------------------------------------------------
      1        BREAK      1/1/5    3079  1/1/23          3072   Ring is broken - No Logical Block
    
  4. Unconfigure SPX ports 1/1/23 and 21/2/3.
    ICX7750-48F Router# configure terminal
    ICX7750-48F Router(config)# spx cb-configure 
    ICX7750-48F Router(config-spx-cb)# no spx-port 1/1/23
    
    SYSLOG: <13> Nov 17 11:24:29 SPX Ring Instance 1 is unconfigured (CB1/1/5 - CB1/1/23) 
    ICX7750-48F Router(config-spx-cb)#
    SYSLOG: <14> Nov 17 11:24:29 PORT: 1/1/23 disabled by un-authenticated user from console session.
    
    ICX7750-48F Router(config-spx-cb)# spx unit 21
    ICX7750-48F Router(config-spx-unit-21)# no spx-port 21/2/3 
    spx-port 21/2/3 is removed
    ICX7750-48F Router(config-spx-unit-21)#
    SYSLOG: <14> Nov 17 11:24:58 PORT: 21/2/3 disabled by un-authenticated user from console session.
    
    ICX7750-48F Router(config-spx-unit-21)# show spx 
    T=22d5h56m34.4: alone: standalone, D: dynamic cfg, S: static
    ID   Type          Role    Mac Address    Pri State   Comment                   
    1  S ICX7750-48XGF active  cc4e.24d0.3500 128 local   Ready
    2  S ICX7750-48XGC standby 609c.9f1f.df00 128 remote  Ready
    3  S ICX7750-48XGF member  cc4e.246e.d580   5 remote  Ready
    17 S ICX7450-48GF  spx-pe  cc4e.246d.1178 N/A remote  Ready
    18 S ICX7450-48P   spx-pe  cc4e.246d.22b8 N/A remote  Ready
    19 S ICX7250-48P   spx-pe  cc4e.24b4.32e8 N/A remote  Ready
    20 S ICX7450-24P   spx-pe  cc4e.248b.11e0 N/A remote  Ready
    21 S ICX7250-24P   spx-pe  cc4e.24b4.7f20 N/A remote  Ready
    
        active                    standby                                          
         +---+        +---+        +---+                                           
     -3/1| 1 |3/4--3/1| 3 |3/4--3/1| 2 |3/4-                                       
     |   +---+        +---+        +---+   |                                       
     |                                     |                                       
     |-------------------------------------|                                       
                +----+        +----+        +----+        +----+        +----+     
      1/1/5==2/1| 17 |3/1--3/1| 18 |2/3--2/1| 19 |2/3--2/3| 20 |1/1--1/1| 21 |     
                +----+        +----+        +----+        +----+        +----+ 
    
  5. Bring up the new unit as a PE.
    ICX7250-48 Router> enable
    No password has been assigned yet...
    ICX7250-48 Router# configure terminal
    ICX7250-48 Router(config)# spx pe-enable 
    Enter provisional PE mode. CLI is limited to spx unit 1.
    After finishing all configuration, please "write memory" and reload this unit to be a PE.
    [Provisional-PE]ICX7250-48 Router(config)# show running-config 
    Current configuration:
    !
    ver 08.0.50B14T213
    !
    spx pe-enable
    spx unit 1
      module 1 icx7250-48-port-management-module
      module 2 icx7250-sfp-plus-8port-80g-module
      spx-port 1/2/1					|___These are default spx-ports. Change them
      spx-port 1/2/3					|   if required. One spx-port connecting to CB
    !							           and another connecting to PE21.
    end
    [Provisional-PE]ICX7250-48 Router(config)# spx unit 1
    [Provisional-PE]ICX7250-48 Router(config-spx-unit-1)# no spx-port1/2/3
    spx-port 1/2/3 is removed
    [Provisional-PE]ICX7250-48 Router(config-spx-unit-1)# spx-port 1/2/2
    [Provisional-PE]ICX7250-48 Router(config-spx-unit-1)# show running-config 
    Current configuration:
    !
    ver 08.0.50B14T213
    !
    spx pe-enable
    spx unit 1
      module 1 icx7250-48-port-management-module
      module 2 icx7250-sfp-plus-8port-80g-module
      spx-port 1/2/1
      spx-port 1/2/2
    !
    end
    
  6. Make the physical connection between the new PE and the CB, and bring up the ports.
    [Provisional-PE]ICX7250-48 Router(config-spx-unit-1)# show interfaces brief ethernet 1/2/1 ethernet 1/2/2 
    Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
    1/2/1      Disable None    None None  None  No  1    0   cc4e.24b4.4381                 
    1/2/2      Up      Forward Full 10G   None  No  1    0   cc4e.24b4.4382                 
    [Provisional-PE]ICX7250-48 Router(config-spx-unit-1)#
    [Provisional-PE]ICX7250-48 Router(config-spx-unit-1)# int e 1/2/1
    [Provisional-PE]ICX7250-48 Router(config-if-spx-e10000-1/2/1)# enable
     [Provisional-PE]ICX7250-48 Router(config-if-spx-e10000-1/2/1)# show interfaces brief ethernet 1/2/1 ethernet 1/2/2
    
    Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
    1/2/1      Up      Forward Full 10G   None  No  1    0   cc4e.24b4.4381                 
    1/2/2      Up      Forward Full 10G   None  No  1    0   cc4e.24b4.4382                 
    [Provisional-PE]ICX7250-48 Router(config-if-spx-e10000-1/2/1)#
    
  7. Verify that the SPX ports on the CB and PE 21 are up, and configure the ports.
    ICX7750-48F Router(config)# show interfaces brief ethernet 1/1/23 ethernet 21/2/2
    
    Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
    1/1/23     Up      Forward Full 10G   3072  No  1    0   cc4e.24d0.350c                 
    21/2/2     Up      Forward Full 10G   None  No  1    0   cc4e.24b4.7f3a                 
    
    ICX7750-48F Router(config)# spx cb-configure            
    ICX7750-48F Router(config-spx-cb)# spx-port 1/1/13
    ICX7750-48F Router(config-spx-cb)# spx unit 21
    ICX7750-48F Router(config-spx-unit-21)# spx-port 21/2/2
    
  8. Save the configuration, and reload the PE.
    [Provisional-PE]ICX7250-48 Router(config-if-spx-e10000-1/2/1)# end
    [Provisional-PE]ICX7250-48 Router# write memory 
    Flash Memory Write (133 bytes)
    [Provisional-PE]ICX7250-48 Router#
    Write PE startup file done.
    
    [Provisional-PE]ICX7250-48 Router# reload
    Are you sure? (enter 'y' or 'n'): y
    
  9. After the new PE reboots, the SPX system adds the PE as part of the new six-PE ring.
    ICX7750-48F Router# show spx
    T=22d6h28m19.2: alone: standalone, D: dynamic cfg, S: static
    ID   Type          Role    Mac Address    Pri State   Comment                   
    1  S ICX7750-48XGF active  cc4e.24d0.3500 128 local   Ready
    2  S ICX7750-48XGC standby 609c.9f1f.df00 128 remote  Ready
    3  S ICX7750-48XGF member  cc4e.246e.d580   5 remote  Ready
    17 S ICX7450-48GF  spx-pe  cc4e.246d.1178 N/A remote  Ready
    18 S ICX7450-48P   spx-pe  cc4e.246d.22b8 N/A remote  Ready
    19 S ICX7250-48P   spx-pe  cc4e.24b4.32e8 N/A remote  Ready
    20 S ICX7450-24P   spx-pe  cc4e.248b.11e0 N/A remote  Ready
    21 S ICX7250-24P   spx-pe  cc4e.24b4.7f20 N/A remote  Ready
    22 D ICX7250-48    spx-pe  cc4e.24b4.4350 N/A remote  Ready
    
        active                    standby                                          
         +---+        +---+        +---+                                           
     -3/1| 1 |3/4--3/1| 3 |3/4--3/1| 2 |3/4-                                       
     |   +---+        +---+        +---+   |                                       
     |                                     |                                       
     |-------------------------------------|                                       
                +----+        +----+        +----+        +----+        +----+     
      1/1/5==2/1| 17 |3/1--3/1| 18 |2/3--2/1| 19 |2/3--2/3| 20 |1/1--1/1| 21 |2/2- 
                +----+        +----+        +----+        +----+        +----+   | 
                                                                                 | 
                                                                        +----+   | 
                                                             1/1/23--2/1| 22 |2/2- 
                                                                        +----+