Removing a PE ring and its configuration
Note: For information on physical ring formation, refer to
Best practice for PE ring configuration.
Note: The PE ring can be broken into one or two chains while it is active using the
no multi-spx-port or
no multi-spx-lag command, or the ring can be physically disconnected first. The
no multi-spx-port and
no multi-spx-lag change SPX ports and SPX LAGs to data ports and put them in an administrative disabled
state. You can configure the
no disable or
enable command in interface configuration mode to enable them.
To remove a ring and its configuration, either issue the
no multi-spx-port or
no multi-spx-lag command, or physically disconnect the ring by removing all SPX links either between
the CB and a cascade PE unit, or between two PE units in the ring. You may also want
to remove the two SPX links on each of the edge PEs that are unused after the connection
is broken to allow the ports to be used as data ports.
The following procedure steps you through the physical removal of a PE ring using a typical example.
- Enter the
show spxcommand to display Campus Fabric topology.ICX 7750# show spx T=18m44.4: alone: standalone, D: dynamic cfg, S: static ID Type Role Mac Address Pri State Comment 1 S ICX7750-48XGF standby 609c.9f1f.9900 128 remote Ready 2 S ICX7750-48XGF active cc4e.246d.9b00 128 local Ready 20 S ICX7450-48GF spx-pe cc4e.246d.10b8 N/A remote Ready 24 S ICX7450-48G spx-pe cc4e.248e.2f90 N/A remote Ready 27 S ICX7450-48GF spx-pe cc4e.246c.f850 N/A remote Ready active standby +---+ +---+ | 2 |2/4--2/1| 1 |2/4 +---+ +---+ +----+ +----+ +----+ 1/1/1--2/1| 20 |2/3--2/3| 27 |2/1--2/3| 24 |2/1==1/1/3 +----+ +----+ +----+The Campus Fabric domain contains a two-unit CB stack and three connected PE units. The PE units are connected in a ring through CB SPX ports 1/1/1 and 1/1/3. Port 1/1/3 is part of a LAG connection. - Enter the
show spx ring allcommand to obtain details on PE rings in the domain. The output provides the Ring ID and the attached CB ports. Enter theshow spx ringcommand followed by the correct ring ID to obtain more detail on the ring to be removed.ICX 7750# show spx ring all ------------------------------------------------------------------------------------ Ring Id |FSM State |CB port Lag |Remote CB port Lag |Log Block Link ------------------------------------------------------------------------------------ 1 ACTIVE 1/1/1 3072 1/1/3 3079 PE20x--xPE27
The output confirms the presence of a single PE ring, Ring 1, and shows that it is active. It indicates that the logical block for this ring is between PE 20 and PE 27.ICX 7750# show spx ring 1 ========================= ------------------------------------------------------------------------------------- Ring Id |FSM State |CB port Lag |Remote CB port Lag |Log Block Link ------------------------------------------------------------------------------------- 1 ACTIVE 1/1/1 3072 1/1/3 3079 PE20x--xPE27 CB chains Information: -------------------------------------------------------------------------------------------------- CB Port Lag | Epoch |Ring Id FSM State|Remote CB port Lag | Chain -------------------------------------------------------------------------------------------------- 1/1/1 3072 13 YES 1 ACTIVE 1/1/3 3079 PE20x--xPE27--PE24 PE chain information connecting to CB port 1/1/1 [Lag 3072] ----------------------------------------------------------------------------- PE Id | Epoch | FSM state |Uplink port|Casc port|Log Block|Prev PE|Next PE ----------------------------------------------------------------------------- PE20 13 ACTIVE 20/2/1 20/2/3 YES -- x--x PE chain information connecting to remote CB port 1/1/3 [Lag 3079] ----------------------------------------------------------------------------- PE Id | Epoch | FSM state |Uplink port|Casc port|Log Block|Prev PE|Next PE ----------------------------------------------------------------------------- PE24 13 ACTIVE 24/2/1 24/2/3 NO -- PE27 PE27 13 ACTIVE 27/2/1 27/2/3 YES PE24 x--xThe output lists all PE units in the ring ("Chain'), identifies the upstream ("Uplink") and downstream ("Cascade") port for each PE unit in the ring, specifies the previous and next PE in the chain, provides the logical block point, and displays the state of each PE. - Enter the
show running-configcommand to check the details of the current configuration.ICX 7750# show running-config Current configuration: ! ver 08.0.50b559T203 ! stack unit 1 module 1 icx7750-48-xgf-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module priority 128 stack-port 1/2/1 1/2/4 stack unit 2 module 1 icx7750-48-xgf-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module module 3 icx7750-6q-6port-qsfp-240g-module priority 128 stack-port 2/2/4 spx unit 20 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-xgf-4port-40g-module module 4 icx7400-xgf-4port-40g-module spx-port 20/2/1 spx-port 20/2/3 spx unit 24 module 1 icx7450-48-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-lag 24/2/1 to 24/2/2 spx-port 24/2/3 spx unit 27 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-port 27/2/1 spx-port 27/2/3 stack enable stack rconsole-off stack mac 609c.9f1f.9900 ! ! ! spx cb-enable spx cb-configure | spx-port 1/1/1 | <--- Current CB SPX links to PEs. spx-lag 1/1/3 to 1/1/4 | pe-id 1/1/1 20 27 24 1/1/3 <--- Current pe-id configuration connects through CB SPX ports 1/1/1 and 1/1/3.
The output includes current CB SPX port and LAG connections to the PEs and pe-id configuration. - Break the PE ring in one of two possible ways, depending on desired outcome.
- Issue the
no multi-spx-lagorno multi-spx-portcommand. The SPX port and SPX LAG configurations are removed, and these ports are administratively disabled. - Physically break the PE ring by removing all SPX links between the CB and a PE or between two PE units in the ring. The configuration is unchanged. Both ends of the link are still SPX ports or SPX LAGs.
A SYSLOG message is generated to indicate the ring has been broken. You can also confirm the break with theshow spxandshow spx ringid commands.The following example shows breaking a ring by physically removing links. SPX port 20/2/3 and SPX port 27/2/3 configurations remain. If you use the other option of entering the commandno multi-spx-port 20/2/3 and 27/2/3, configuration for SPX port 20/2/3 and SPX port 27/2/3 is removed, and both ports are administratively disabled. (Whenever an SPX port or an SPX LAG is converted to a data port, it is administratively disabled. You can enable a port by configuring theenableorno disablein interface configuration mode.)ICX 7750# show spx T=22m11.7: alone: standalone, D: dynamic cfg, S: static ID Type Role Mac Address Pri State Comment 1 S ICX7750-48XGF standby 609c.9f1f.9900 128 remote Ready 2 S ICX7750-48XGF active cc4e.246d.9b00 128 local Ready 20 S ICX7450-48GF spx-pe cc4e.246d.10b8 N/A remote Ready 24 S ICX7450-48G spx-pe cc4e.248e.2f90 N/A remote Ready 27 S ICX7450-48GF spx-pe cc4e.246c.f850 N/A remote Ready active standby +---+ +---+ | 2 |2/4--2/1| 1 |2/4 +---+ +---+ +----+ 1/1/1--2/1| 20 |2/3- <--20/2/3 port down +----+ +----+ +----+ 1/1/3==2/1| 24 |2/3--2/1| 27 |2/3- <--27/2/3 port down +----+ +----+In this case, the SPX port 20/2/3 is disconnected from SPX port 27/2/3 as shown in theshow spxtopology.ICX 7750# show spx ring 1 ------------------------------------------------------------------------------------- Ring Id |FSM State |CB port Lag |Remote CB port Lag |Log Block Link ------------------------------------------------------------------------------------- 1 BREAK 1/1/1 3072 1/1/3 3079 Ring is broken - No Logical Block CB chains Information: -------------------------------------------------------------------------------------------------- CB Port Lag | Epoch |Ring Id FSM State|Remote CB port Lag | Chain -------------------------------------------------------------------------------------------------- 1/1/1 3072 14 YES 1 BREAK 1/1/3 3079 PE20 PE chain information connecting to CB port 1/1/1 [Lag 3072] ----------------------------------------------------------------------------- PE Id | Epoch | FSM state |Uplink port|Casc port|Log Block|Prev PE|Next PE ----------------------------------------------------------------------------- PE20 14 BREAK 20/2/1 20/2/3 YES -- -- -------------------------------------------------------------------------------------------------- CB Port Lag | Epoch |Ring Id FSM State|Remote CB port Lag | Chain -------------------------------------------------------------------------------------------------- 1/1/3 3079 14 YES 1 BREAK 1/1/1 3072 PE24--PE27 PE chain information connecting to CB port 1/1/3 [Lag 3079] ----------------------------------------------------------------------------- PE Id | Epoch | FSM state |Uplink port|Casc port|Log Block|Prev PE|Next PE ----------------------------------------------------------------------------- PE24 14 BREAK 24/2/1 24/2/3 NO -- PE27 PE27 14 BREAK 27/2/1 27/2/3 YES PE24 --ICX 7750# show running-config Current configuration: ! ver 08.0.50b559T203 ! stack unit 1 module 1 icx7750-48-xgf-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module priority 128 stack-port 1/2/1 1/2/4 stack unit 2 module 1 icx7750-48-xgf-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module module 3 icx7750-6q-6port-qsfp-240g-module priority 128 stack-port 2/2/4 spx unit 20 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-xgf-4port-40g-module module 4 icx7400-xgf-4port-40g-module spx-port 20/2/1 spx-port 20/2/3 spx unit 24 module 1 icx7450-48-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-lag 24/2/1 to 24/2/2 spx-port 24/2/3 spx unit 27 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-port 27/2/1 spx-port 27/2/3 stack enable stack rconsole-off stack mac 609c.9f1f.9900 ! ! ! spx cb-enable spx cb-configure spx-port 1/1/1 spx-lag 1/1/3 to 1/1/4 pe-id 1/1/1 20 27 24 1/1/3 <--- No change in configuration
- Issue the
- (Optional) To make the ports available as data ports, remove the unused SPX ports
or LAGs from the edge PEs in the resulting chain or chains. There will be two unused
SPX links if you disconnect the ring between two PE units as in this example.
Note: If you are planning to re-form the PE ring later, you do not need to remove the unused SPX links.
- (Optional) To make the underlying ports available as data ports, remove the SPX ports
or SPX LAGs that formed the ring with the
no spx-portor theno spx-lagcommand.ICX 7750# configure terminal ICX 7750(config)# spx unit 20 ICX 7750(config-spx-unit-20)# no spx-port 20/2/3 spx-port 20/2/3 is removed ICX 7750(config-spx-unit-20)# spx unit 27 ICX 7750(config-spx-unit-27)# no spx-port 27/2/3 spx-port 27/2/3 is removed ICX 7750(config-spx-unit-27)# end ICX 7750# show spx T=25m14.6: alone: standalone, D: dynamic cfg, S: static ID Type Role Mac Address Pri State Comment 1 S ICX7750-48XGF standby 609c.9f1f.9900 128 remote Ready 2 S ICX7750-48XGF active cc4e.246d.9b00 128 local Ready 20 S ICX7450-48GF spx-pe cc4e.246d.10b8 N/A remote Ready 24 S ICX7450-48G spx-pe cc4e.248e.2f90 N/A remote Ready 27 S ICX7450-48GF spx-pe cc4e.246c.f850 N/A remote Ready active standby +---+ +---+ | 2 |2/4--2/1| 1 |2/4 +---+ +---+ +----+ 1/1/1--2/1| 20 | +----+ +----+ +----+ 1/1/3==2/1| 24 |2/3--2/1| 27 | +----+ +----+ - (Optional) To match the physical configuration, remove the ring from
pe-idconfiguration and configure PE chains instead. If needed, first enter theshow spx ring allandshow spx ring chaincommands for more information.ICX 7750# show spx ring all ------------------------------------------------------------------------------------ Ring Id |FSM State |CB port Lag |Remote CB port Lag |Log Block Link ------------------------------------------------------------------------------------
The output confirms that no PE rings are present in the Campus Fabric topology.ICX 7750# show spx ring chain ---------------------------------------------------------------------------------------------- SPX CB [CASC PORT] CHAINS CB Port Lag | Epoch |Ring Id FSM State|Remote CB port Lag | Chain ---------------------------------------------------------------------------------------------- 1/1/1 3072 17 NO 0 INIT INVALID 0 PE20 1/1/3 3079 17 NO 0 INIT INVALID 0 PE24--PE27sThe output indicates a single cascade PE attached to CB port 1/1/1, and a chain of two PEs, PE 24 and PE 27, attached to CB port 1/1/3.ICX 7750# configure terminal ICX 7750(config)# spx cb-configure ICX 7750(config-spx-cb)# pe-id 1/1/1 20 SYSLOG: SPX SPX Ring Instance 1 is unconfigured (CB1/1/3 - CB1/1/1) ICX 7750(config-spx-cb)# end ICX 7750#
- Enter the
write memorycommand to save the configuration.ICX 7750# write memory Send "write mem" to 3 PEs: 20,24,27 Automatic copy to member units: 1 SPX# SYSLOG: <14> Apr 2 15:29:17 SPX Security: startup-config was changed by operator from console Flash Memory Write (8192 bytes per dot) .... Copy Done.
The configuration is saved on the three PE units and on the CB active controller. - Confirm removal of the PE ring by entering the
show spx,show spx ring all, andshow running-configcommands.ICX 7750# show spx T=28m42.0: alone: standalone, D: dynamic cfg, S: static ID Type Role Mac Address Pri State Comment 1 S ICX7750-48XGF standby 609c.9f1f.9900 128 remote Ready 2 S ICX7750-48XGF active cc4e.246d.9b00 128 local Ready 20 S ICX7450-48GF spx-pe cc4e.246d.10b8 N/A remote Ready 24 S ICX7450-48G spx-pe cc4e.248e.2f90 N/A remote Ready 27 S ICX7450-48GF spx-pe cc4e.246c.f850 N/A remote Ready active standby +---+ +---+ | 2 |2/4--2/1| 1 |2/4 +---+ +---+ +----+ 1/1/1--2/1| 20 | +----+ +----+ +----+ 1/1/3==2/1| 24 |2/3--2/1| 27 | +----+ +----+The topology shows a single PE (PE 20) and a PE chain formed by PE 24 and PE 27.ICX 7750# show spx ring all ------------------------------------------------------------------------------------ Ring Id |FSM State |CB port Lag |Remote CB port Lag |Log Block Link ------------------------------------------------------------------------------------
SPX# show running-config Current configuration: ! ver 08.0.50b559T203 ! stack unit 1 module 1 icx7750-48-xgf-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module priority 128 stack-port 1/2/1 1/2/4 stack unit 2 module 1 icx7750-48-xgf-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module module 3 icx7750-6q-6port-qsfp-240g-module priority 128 stack-port 2/2/4 spx unit 20 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-xgf-4port-40g-module module 4 icx7400-xgf-4port-40g-module spx-port 20/2/1 spx unit 24 module 1 icx7450-48-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-lag 24/2/1 to 24/2/2 spx-port 24/2/3 spx unit 27 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-port 27/2/1 stack enable stack rconsole-off stack mac 609c.9f1f.9900 ! ! ! spx cb-enable spx cb-configure spx-port 1/1/1 spx-lag 1/1/3 to 1/1/4 pe-id 1/1/1 20 <--- pe-id is split. pe-id 1/1/3 24 27 <--- pe-id is split. !
The current configuration now matches the saved (as well as the physical) configuration and shows the PE ID configuration is broken out, with PE 20 connected at CB SPX port 1/1/1 and PEs 24 and 27 connected to the CB through an SPX LAG (ports 1/1/3 and 1/1/4).
Example of removing a PE ring with the no multi-spx-lag command
The following example removes the SPX LAG between PE 17 and PE 18 using the
no multi-spx-lag command.
ICX7750-26Q Router# show spx
T=22h48m38.8: alone: standalone, D: dynamic cfg, S: static
ID Type Role Mac Address Pri State Comment
1 S ICX7750-26QXG active cc4e.2439.2a80 128 local Ready
2 S ICX7750-26QXG standby cc4e.2439.3700 0 remote Ready
3 S ICX7750-48XGC member cc4e.2439.1680 0 remote Ready
17 S ICX7150-C12P spx-pe 609c.9fbc.bf26 N/A remote Ready
18 S ICX7150-48ZP spx-pe 609c.9fee.4320 N/A remote Ready
23 D ICX7450-48GF spx-pe cc4e.246c.f850 N/A remote Ready
24 D ICX7450-48P spx-pe 609c.9fc2.3090 N/A remote Ready
25 D ICX7250-24 spx-pe cc4e.24df.0ade N/A remote Ready
standby active
+---+ +---+ +---+
3/1| 2 |2/1==2/1| 1 |3/1==3/1| 3 |2/1
+---+ +---+ +---+
+----+ +----+
3/1/17==1/1| 18 |2/1==3/1| 17 |1/7==3/1/41
+----+ +----+
+----+ +----+ +----+
2/3/6--4/1| 23 |3/1--4/1| 24 |2/1--2/3| 25 |1/1--3/1/15
+----+ +----+ +----+
Standby u2 - protocols ready, can failover
ICX7750-26Q Router# write memory
Send "write mem" to 5 PEs: 17-18,23-25
Automatic copy to member units: 2 3
ICX7750-26Q Router#
Flash Memory Write (8192 bytes per dot)
.
Write startup-config done.
Copy Done.
Removing spx-lag between PE 17 and PE 18 using no multi-spx-lag command
ICX7750-26Q Router#
ICX7750-26Q Router# configure terminal
ICX7750-26Q Router(config)# spx cb-configure
ICX7750-26Q Router(config-spx-cb)# no multi-spx-lag 18/2/1 18/2/3 and 17/3/1 17/3/2
Bring down ports: 17/3/1 to 17/3/2 18/2/1 18/2/3
Wait for 20 sec before removing spx-lags. These ports will be disabled in configuration.
ICX7750-26Q Router(config-spx-cb)# end
ICX7750-26Q Router# show spx
T=22h50m28.3: alone: standalone, D: dynamic cfg, S: static
ID Type Role Mac Address Pri State Comment
1 S ICX7750-26QXG active cc4e.2439.2a80 128 local Ready
2 S ICX7750-26QXG standby cc4e.2439.3700 0 remote Ready
3 S ICX7750-48XGC member cc4e.2439.1680 0 remote Ready
17 S ICX7150-C12P spx-pe 609c.9fbc.bf26 N/A remote Ready
18 S ICX7150-48ZP spx-pe 609c.9fee.4320 N/A remote Ready
23 S ICX7450-48GF spx-pe cc4e.246c.f850 N/A remote Ready
24 S ICX7450-48P spx-pe 609c.9fc2.3090 N/A remote Ready
25 S ICX7250-24 spx-pe cc4e.24df.0ade N/A remote Ready
standby active
+---+ +---+ +---+
3/1| 2 |2/1==2/1| 1 |3/1==3/1| 3 |2/1
+---+ +---+ +---+
+----+
3/1/41==1/7| 17 |3/1=
+----+
+----+
3/1/17==1/1| 18 |2/1=
+----+
+----+ +----+ +----+
2/3/6--4/1| 23 |3/1--4/1| 24 |2/1--2/3| 25 |1/1--3/1/15
+----+ +----+ +----+
ICX7750-26Q Router# spx-lag 17/3/1 to 17/3/2 is removed
spx-lag 18/2/1 18/2/3 is removed
ICX7750-26Q Router#
ICX7750-26Q Router# show spx
T=22h50m41.6: alone: standalone, D: dynamic cfg, S: static
ID Type Role Mac Address Pri State Comment
1 S ICX7750-26QXG active cc4e.2439.2a80 128 local Ready
2 S ICX7750-26QXG standby cc4e.2439.3700 0 remote Ready
3 S ICX7750-48XGC member cc4e.2439.1680 0 remote Ready
17 S ICX7150-C12P spx-pe 609c.9fbc.bf26 N/A remote Ready
18 S ICX7150-48ZP spx-pe 609c.9fee.4320 N/A remote Ready
23 S ICX7450-48GF spx-pe cc4e.246c.f850 N/A remote Ready
24 S ICX7450-48P spx-pe 609c.9fc2.3090 N/A remote Ready
25 S ICX7250-24 spx-pe cc4e.24df.0ade N/A remote Ready
standby active
+---+ +---+ +---+
3/1| 2 |2/1==2/1| 1 |3/1==3/1| 3 |2/1
+---+ +---+ +---+
+----+
3/1/41==1/7| 17 |
+----+
+----+
3/1/17==1/1| 18 |
+----+
+----+ +----+ +----+
2/3/6--4/1| 23 |3/1--4/1| 24 |2/1--2/3| 25 |1/1--3/1/15
+----+ +----+ +----+
Standby u2 - protocols ready, can failover
ICX7750-26Q Router#
Example of removing a PE ring with the no multi-spx-port command
The following example removes the SPX ports between PE 24 and PE 25 using the
no multi-spx-port command.
ICX7750-26Q Router# write memory
Send "write mem" to 5 PEs: 17-18,23-25
Automatic copy to member units: 2 3
ICX7750-26Q Router#
Flash Memory Write (8192 bytes per dot)
.
Write startup-config done.
Copy Done.
ICX7750-26Q Router(config)# spx cb-configure
ICX7750-26Q Router(config-spx-cb)# no multi-spx-port 24/2/1 and 25/2/3
Bring down 24/2/1 and 25/2/3
Wait for 20 sec before removing spx-ports. These ports will be disabled in configuration.
ICX7750-26Q Router(config-spx-cb)# end
ICX7750-26Q Router# show spx
T=22h55m20.8: alone: standalone, D: dynamic cfg, S: static
ID Type Role Mac Address Pri State Comment
1 S ICX7750-26QXG active cc4e.2439.2a80 128 local Ready
2 S ICX7750-26QXG standby cc4e.2439.3700 0 remote Ready
3 S ICX7750-48XGC member cc4e.2439.1680 0 remote Ready
17 S ICX7150-C12P spx-pe 609c.9fbc.bf26 N/A remote Ready
18 S ICX7150-48ZP spx-pe 609c.9fee.4320 N/A remote Ready
23 S ICX7450-48GF spx-pe cc4e.246c.f850 N/A remote Ready
24 S ICX7450-48P spx-pe 609c.9fc2.3090 N/A remote Ready
25 S ICX7250-24 spx-pe cc4e.24df.0ade N/A remote Ready
standby active
+---+ +---+ +---+
3/1| 2 |2/1==2/1| 1 |3/1==3/1| 3 |2/1
+---+ +---+ +---+
+----+
3/1/41==1/7| 17 |
+----+
+----+
3/1/17==1/1| 18 |
+----+
+----+ +----+
2/3/6--4/1| 23 |3/1--4/1| 24 |2/1-
+----+ +----+
+----+
3/1/15--1/1| 25 |2/3-
+----+
Standby u2 - protocols ready, can failover
ICX7750-26Q Router# spx-port 24/2/1 is removed
spx-port 25/2/3 is removed