Manually Enabling and Configuring PE Units

The following procedure requires an ICX 7150, ICX 7250, or ICX 7450 unit with a router image that has stacking disabled (no stack enable configuration) and that is properly connected to an enabled control bridge (CB).
The following steps are involved in configuring PE units.
  • Enable the PE unit.
  • Configure SPX ports, if necessary, to change the ports for setting up LLDP communications with the CB.
  • Configure SPX LAGs as needed.
  • Save and load the configuration.
Note: For information on PE ring formation, refer to Best practices for PE ring configuration.
Note: For information on automatic configuration of PE units, refer to Zero-touch configuration. For information on automated interactive configuration of PE units, refer to SPX interactive-setup.
  1. To enable an ICX 7150, ICX 7250, or ICX 7450 unit as a PE unit, enter the spx pe-enable command on the unit in global configuration mode.
    ICX7450-48F Router# configure terminal
    ICX7450-48F Router(config)# spx pe-enable
    Enter provisional PE mode. CLI is limited to spx unit 1.
    After finishing all configuration, please "write memory" and reload this unit to be a PE.
    
    The unit switches immediately from regular mode to Provisional-PE mode. The global configuration prompt changes to include the prefix [Provisional-PE].
  2. Confirm that the PE is enabled by entering the show running-config command.
    [Provisional-PE]ICX7450-48P Router# show running-config 
    Current configuration:
    !
    ver 08.0.80B7T213
    !
    spx pe-enable
    spx unit 1
      module 1 icx7450-48p-poe-management-module
      module 2 icx7400-xgc-4port-40g-module
      module 3 icx7400-qsfp-1port-40g-module
      module 4 icx7400-qsfp-1port-40g-module
      spx-port 1/2/1
    
      spx-port 1/2/3
    !
    End
    
    The unit is shown as enabled and its SPX configuration is shown as spx unit 1 (the local designation for the new PE unit). In the previous example, the system has provisionally configured ports 1/2/1 and 1/2/3 as SPX ports.
    Note: An ICX 7450 provisionally configured as a PE contains system-generated SPX ports 1/2/1 and 1/2/3 for a 4 X 10-Gbps module. These ports can be reconfigured as shown in the following steps. Refer to SPX port and LAG configuration rules for more information on system-generated SPX ports.
  3. (Optional) Designate a suggested PE ID with the spx suggested-id command.
    [Provisional-PE]ICX7450-48P Router(config)# spx suggested-id 20
    Note: Allowable PE IDs are 17 through 56.
    Note: The spx suggested-id command is not available on the CB. It can be entered only in Provisional-PE or PE mode.
    Note: The suggested ID entered cannot be assigned if the CB receives other configuration information for the PE. The suggested ID is not assigned if it is already assigned to another unit or if it is present in another PE ID configuration.
  4. Enter SPX unit configuration mode.
    [Provisional-PE]ICX7450-48P Router(config)# spx unit 1
    
  5. Configure SPX ports if necessary.

    In the following example, one of the default SPX ports is removed, and another SPX port is created.

    [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# no spx-port 1/2/3
    spx-port 1/2/3 is removed
    [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# spx-port 1/2/4
    
  6. Configure SPX LAGs for the PE unit if needed.

    In the following example, the default SPX port 1/2/1 becomes part of a two-port LAG.

    [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# spx-lag 1/2/1 to 1/2/2
    
  7. Assign or change the PE name if needed.

    In the following example, the PE unit is named "finance".

    [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# pe-name finance
    
  8. If the CB has jumbo mode configured, you can configure jumbo mode on a provisional PE to avoid one extra reload after the PE reloads and joins the CB. (If either the CB or PE has jumbo mode configured and the other does not, the PE is reloaded after it joins the CB. When it boots up, it joins the CB again and has the same jumbo mode configuration as the CB.)

    The following example configures jumbo mode on a provisional PE.

    [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# jumbo
    
  9. Check your completed configuration with the show running-config command.

    The following example shows the new configuration, which has yet to be saved and loaded.

     [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# show running-config 
    Current configuration:
    !
    ver 08.0.80B7T213
    !
    spx pe-enable
    spx suggested-id 20
    spx unit 1
      pe-name finance
      module 1 icx7450-48p-poe-management-module
      module 2 icx7400-xgc-4port-40g-module
      module 3 icx7400-qsfp-1port-40g-module
      module 4 icx7400-qsfp-1port-40g-module
      spx-lag 1/2/1 to 1/2/2
      spx-port 1/2/4
    !
    jumbo
    !
    End
    
  10. Enter the write memory command to save the new configuration to the PE startup file.
    [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# exit
    [Provisional-PE]ICX7450-48P Router(config)#write memory
    Flash Memory Write (162 bytes)
    [Provisional-PE]ICX7450-48P Router(config)#
    Write PE startup file done.
    
  11. Enter the reload command to reboot the system with the new configuration.
    [Provisional-PE]ICX7450-48P Router# reload
    Are you sure? (enter 'y' or 'n'): y
    Unmounting the External USB
    We are in system resetDisabled core-1
    CPU Sampling disabled.
    The system is going down NOW!!!
    
    The unit moves from Provisional-PE mode to PE mode. Then, if a connected CB is enabled, it becomes an active PE. The CB takes control of the PE and may assign a different unit ID.

The transition from provisional to active PE unit under CB control is shown in the following example. As indicated in the example, the PE is assigned a new unit ID and a different SPX LAG, based on reserved configuration information stored on the CB. The proposed name for the PE is not assigned.

Ruckus Wireless Bootloader: 10.1.12b001T215 (Mar 28 2018 - 00:00:53)

Validate Shmoo parameters stored in flash ..... OK
Restoring Shmoo parameters from flash ..... 
Running simple memory test ..... OK
 ICX7450-48 Copper (POE), PVT1 
SYS CPLD VER: 0x10, Released Ver: 0

Enter 'b' to stop at boot monitor:  0 
bootdelay: ===
Booting image from Primary
.......................................................................................................................................................................................................................................................................................................................................## Booting kernel from FIT Image at 70000200 ...
   Using 'conf@2' configuration
   Trying 'kernel@1' kernel subimage
     Description:  Ruckus Linux SP/SI
     Type:         Kernel Image
     Compression:  lzma compressed
     Data Start:   0x700002d0
     Data Size:    2178385 Bytes =      Architecture: ARM
     OS:           Linux
     Load Address: 0x61008000
     Entry Point:  0x61008000
     Hash algo:    crc32
     Hash value:   fa26f214
   Verifying Hash Integrity ... crc32+ OK
## Loading init Ramdisk from FIT Image at 70000200 ...
   Using 'conf@2' configuration
   Trying 'ramdisk@1' ramdisk subimage
     Description:  Ramdisk -rootfs
     Type:         RAMDisk Image
     Compression:  lzma compressed
     Data Start:   0x70430060
     Data Size:    25319571 Bytes =      Architecture: ARM
     OS:           Linux
     Load Address: 0x00000000
     Entry Point:  0x00000000
     Hash algo:    crc32
     Hash value:   4acb6356
   Verifying Hash Integrity ... crc32+ OK
## Flattened Device Tree from FIT Image at 70000200
   Using 'conf@2' configuration
   Trying 'fdt@1' FDT blob subimage
     Description:  Flattened Device Tree blob
     Type:         Flat Device Tree
     Compression:  uncompressed
     Data Start:   0x70429790
     Data Size:    8922 Bytes =      Architecture: ARM
     Hash algo:    crc32
     Hash value:   10a00dea
   Verifying Hash Integrity ... crc32+ OK
   Loading FDT from 0x70429790 to 0x65008000
   Booting using the fdt blob at 0x65008000
   Uncompressing Kernel Image ... OK
   Using Device Tree in place at 65008000, end 6500d2d9

The kernel is started, factory defaults are applied, and the device is initialized as a PE.

Starting kernel ...

bcmiproc-gmac 18023000.ethernet: can't find MAC address
booting with 4.4 kernel
PLATFORM SP
SP's eUSB-Infra Called 
 Number of eUSB partitions 3 ...
PLATFORM SP
Config partition mounted.
eUSB flash drive is ready  No External USB Drive(s) Mounted . Enabling core#1
core#1 enabled
Kernel crashdump is disabled. 
Resources folder check done!
Mfg. Backup Infra is Factory Disabled
dma_mem_base: 0x96000000, dma_mem_len: 0x8000000, warm_mem_base: 0xdf500000, warm_mem_len: 0xb00000
Creating TUN device
Enabling time stamp.
Starting the FastIron.
USER=root
HOME=/
GCOV_PREFIX=/fast_iron
ethaddr=60:9c:9f:27:a4:df?
TERM=vt102
PATH=/sbin:/usr/sbin:/bin:/usr/bin
ip=10.20.70.41:10.70.6.26:10.20.70.1:255.255.255.128:SP:eth0:off
SHELL=/bin/sh
PWD=/
[sp-gpio]:sil_gpiochip_register: gpiochip registeration 
i2c-0   smbus           iproc-smb-1                             SMBus adapter   3
i2c-1   smbus           iproc-smb-1                             SMBus adapter   3
FIPS Disabled:PORT NOT DISABLED
platform type 73
OS>
Loaded Image SPR08080B7 from Pri Built on (UTC): Sat May 26 18:33:53 2018
Enabling Console Logging
                        Upgrade from pre 8.0.80 image. Dual mode to VLAN config upgrade needed
Hotplugger Daemon Initialized ..
set_board_level: gi_board_type = 101
System is booting up in PE mode: Jumbo frame is enabled. 
[   59.864651] linux-kernel-bde: map phys range 0x48000000-0x48040000 to 0xb0c33000-0xb0c73000
[   59.965154] linux-kernel-bde: map phys range 0x42000000-0x42040000 to 0xb0bf3000-0xb0c33000
[   60.065406] linux-kernel-bde: map phys range 0x42040000-0x42080000 to 0xb0bb3000-0xb0bf3000
[   60.318856] linux-kernel-bde: map phys range 0x88100000-0x90100000 to 0xa8bb3000-0xb0bb3000
DMA pool size: 134217728
                        SOC unit 0 attached to PCI device BCM56548_A0
BCM848xx: u=0 p=50: init. Chip Rev = 01 Version = 01.09.01 Date = 02/17/2000 (MDIO)
BCM848xx: u=0 p=51: init. Chip Rev = 01 Version = 01.09.01 Date = 02/17/2000 (MDIO)
Setting the CMIC registers for the link scan
SOC unit 1 attached to PCI device BCM56548_A0
BCM848xx: u=1 p=42: init. Chip Rev = 01 Version = 01.09.01 Date = 02/17/2000 (MDIO)
BCM848xx: u=1 p=43: init. Chip Rev = 01 Version = 01.09.01 Date = 02/17/2000 (MDIO)
Setting the CMIC registers for the link scan
ICX7450: no XML license is presented. SAU option: l3-prem.
Firmware version from File: 2.1.0
Pre Parsing Config Data ...

PE Unit:  No BCM L3 Initialization
sw_pp_device_map_init -> PE INIT
Warning: This operation would close all existing SSH connection.
PE Unit: Skipping  CPU next Hop creation 
PE Unit: Skipping create nextHop drop 
PE Unit: Not initing Ingress interfaces ...
Upgrade from pre 8.0.80 image. Dual mode to VLAN config upgrade flag is reset
PE Unit: Skipping create nextHop drop 
bootup in PE mode
bootup in PE mode, enable processing of tagged LLDP packets


Creating certificate, please wait...

SSL Client Certificate is successfully created
System initialization completed...console going online.
  Copyright (c) 2017 Ruckus Wireless, Inc. All rights reserved.
    UNIT 1: compiled on May 26 2018 at 11:28:37 labeled as SPR08080B7
      (29716384 bytes) from Primary SPR08080B7.bin
        SW: Version 08.0.80B7T213 
      Compressed Boot-Monitor Image size = 786944, Version:10.1.12T215 (spz10112b001)
       Compiled on Wed Mar 28 07:01:00 2018

  HW: Stackable ICX7450-48-HPOE
  Internal USB: Serial #: 9900515110300009
      Vendor: ATP Electronics, Total size = 1919 MB

Information on each port and module in the unit is displayed.

==========================================================================
UNIT 1: SL 1: ICX7450-48P POE 48-port Management Module
      Serial  #:CYR3347L01Z
      Software Package: ICX7450_L3_SOFT_PACKAGE   (LID: eatIIJMnFGb)
      Current License: l3-prem  
      P-ASIC  0: type B548, rev 01  Chip BCM56548_A0
==========================================================================
UNIT 1: SL 2: ICX7400-4X10GC 4-port 40G Module
      Serial  #:CYW3323K01W
==========================================================================
UNIT 1: SL 3: ICX7400-1X40GQ 1-port 40G Module
      Serial  #:CYX3347L08F
==========================================================================
UNIT 1: SL 4: ICX7400-1X40GQ 1-port 40G Module
      Serial  #:CYX3328L1NC
==========================================================================
 1000 MHz ARM processor ARMv7 88 MHz bus
 8192 KB boot flash memory
 2048 MB code flash memory
 2048 MB DRAM
STACKID 1  system uptime is 1 minute(s) 20 second(s) 
The system started at 23:56:11 GMT+00 Fri Jun 15 2018

The system : started=warm start   reloaded=by "reload"
Bootup role: Port Extender (PE) 

The following segment shows the new PE joining the CB. It is assigned SPX unit ID 17 because it matches the reserved configuration created previously on the CB. This overrides any suggested ID configured earlier on the provisional PE.

[PE]local-17@ICX7450-48P Router#
Power supply 1  detected.
Power supply 1  is up.

Power supply 2  detected.
Power supply 2  is up.
PoE: Stack unit 1 Power supply 2  with 748000 mwatts capacity is up
PoE Info: Adding new 54V capacity of 748000 mW, total capacity is 748000, total free capacity is 748000
PoE Info: PoE module 1 of Unit 1 on ports 1/1/1 to 1/1/48 detected. Initializing....
2000 log entries of PoE Event Trace Log Buffer is allocated on unit 1 for unit 1 
PoE Event Trace Logging enabled for unit 1

After the PE joins the CB, an rconsole session to the CB is automatically established from the PE unit. The prompt changes to reflect the remote connection. If a login is required, use the same login ID and password as for the CB active controller.

Connecting to control-bridge 1 console... (Press Ctrl Shift -  x to exit)
ICX7650-26Q Router>

For direct physical access to the PE console once it has been redirected to the active controller console of the CB, press CTRL-SHIFT-x. This returns the PE to local mode.

The following examples display the show running-config and show interface brief command output for PE 17. The examples show the configuration and local interfaces for PE 17. The commands are entered from the CB console, which has been redirected to the PE console.

[PE]rconsole-17@ ICX7450-48P Router# show running-config 
Current configuration:
!
ver 08.0.80B7T213
!
spx pe-enable
spx unit 17
  pe-name finance
  module 1 icx7450-48p-poe-management-module
  module 2 icx7400-xgc-4port-40g-module
  module 3 icx7400-qsfp-1port-40g-module
  module 4 icx7400-qsfp-1port-40g-module
  spx-lag 17/2/1 to 17/2/2
  spx-lag 17/3/1 17/4/1
!
jumbo
!
End

[PE]rconsole-17@ICX7450-48P Router# show interface brief


Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
17/1/1     Down    None    None None  None  no  N/A  0   609c.9f2a.d460         
17/1/2     Down    None    None None  None  no  N/A  0   609c.9f2a.d461         
17/1/3     Down    None    None None  None  no  N/A  0   609c.9f2a.d462         
17/1/4     Down    None    None None  None  no  N/A  0   609c.9f2a.d463         
17/1/5     Down    None    None None  None  no  N/A  0   609c.9f2a.d464         
17/1/6     Down    None    None None  None  no  N/A  0   609c.9f2a.d465         
17/1/7     Down    None    None None  None  no  N/A  0   609c.9f2a.d466         
17/1/8     Down    None    None None  None  no  N/A  0   609c.9f2a.d467         
17/1/9     Down    None    None None  None  no  N/A  0   609c.9f2a.d468         
17/1/10    Down    None    None None  None  no  N/A  0   609c.9f2a.d469         
17/1/11    Down    None    None None  None  no  N/A  0   609c.9f2a.d46a         
17/1/12    Down    None    None None  None  no  N/A  0   609c.9f2a.d46b         
17/1/13    Down    None    None None  None  no  N/A  0   609c.9f2a.d46c         
17/1/14    Down    None    None None  None  no  N/A  0   609c.9f2a.d46d         
17/1/15    Down    None    None None  None  no  N/A  0   609c.9f2a.d46e         
17/1/16    Down    None    None None  None  no  N/A  0   609c.9f2a.d46f         
17/1/17    Down    None    None None  None  no  N/A  0   609c.9f2a.d470         
17/1/18    Down    None    None None  None  no  N/A  0   609c.9f2a.d471         
17/1/19    Down    None    None None  None  no  N/A  0   609c.9f2a.d472         
17/1/20    Down    None    None None  None  no  N/A  0   609c.9f2a.d473         
17/1/21    Down    None    None None  None  no  N/A  0   609c.9f2a.d474         
17/1/22    Down    None    None None  None  no  N/A  0   609c.9f2a.d475         
17/1/23    Down    None    None None  None  no  N/A  0   609c.9f2a.d476         
17/1/24    Down    None    None None  None  no  N/A  0   609c.9f2a.d477         
17/1/25    Down    None    None None  None  no  N/A  0   609c.9f2a.d478         
17/1/26    Down    None    None None  None  no  N/A  0   609c.9f2a.d479         
17/1/27    Down    None    None None  None  no  N/A  0   609c.9f2a.d47a         
17/1/28    Down    None    None None  None  no  N/A  0   609c.9f2a.d47b         
17/1/29    Down    None    None None  None  no  N/A  0   609c.9f2a.d47c         
17/1/30    Down    None    None None  None  no  N/A  0   609c.9f2a.d47d         
17/1/31    Down    None    None None  None  no  N/A  0   609c.9f2a.d47e         
17/1/32    Down    None    None None  None  no  N/A  0   609c.9f2a.d47f         
17/1/33    Down    None    None None  None  no  N/A  0   609c.9f2a.d480         
17/1/34    Down    None    None None  None  no  N/A  0   609c.9f2a.d481         
17/1/35    Down    None    None None  None  no  N/A  0   609c.9f2a.d482         
17/1/36    Down    None    None None  None  no  N/A  0   609c.9f2a.d483         
17/1/37    Down    None    None None  None  no  N/A  0   609c.9f2a.d484         
17/1/38    Down    None    None None  None  no  N/A  0   609c.9f2a.d485         
17/1/39    Down    None    None None  None  no  N/A  0   609c.9f2a.d486         
17/1/40    Down    None    None None  None  no  N/A  0   609c.9f2a.d487         
17/1/41    Down    None    None None  None  no  N/A  0   609c.9f2a.d488         
17/1/42    Down    None    None None  None  no  N/A  0   609c.9f2a.d489         
17/1/43    Down    None    None None  None  no  N/A  0   609c.9f2a.d48a         
17/1/44    Down    None    None None  None  no  N/A  0   609c.9f2a.d48b         
17/1/45    Down    None    None None  None  no  N/A  0   609c.9f2a.d48c         
17/1/46    Down    None    None None  None  no  N/A  0   609c.9f2a.d48d         
17/1/47    Down    None    None None  None  no  N/A  0   609c.9f2a.d48e         
17/1/48    Down    None    None None  None  no  N/A  0   609c.9f2a.d48f         
17/2/1     Up      n/a     Full 10G   1     no  N/A  0   609c.9f2a.d491         
17/2/2     Up      n/a     Full 10G   1     no  N/A  0   609c.9f2a.d492         
17/2/3     Down    None    None None  None  no  N/A  0   609c.9f2a.d493         
17/2/4     Down    None    None None  None  no  N/A  0   609c.9f2a.d494         
17/3/1     Up      n/a     Full 40G   2     no  N/A  0   609c.9f2a.d495         
17/4/1     Up      n/a     Full 40G   2     no  N/A  0   609c.9f2a.d499         
lg1        Up      Forward Full 20G   1     No  1    0   609c.9f2a.d491         
lg2        Up      Forward Full 80G   2     No  1    0   609c.9f2a.d495         
mgmt1      Up      None    Full 1G    None  No  None 0   609c.9f2a.d460         
[PE]rconsole-17@ICX7450-48P Router#