Campus Fabric Detailed Manual Configuration Example
The following examples show the configuration steps performed from the CB and the
PE, detailing how the PE transitions between modes, and the output displayed when
the PE joins a CB.
CB Configuration
For 08.0.91 and later: All examples in this section need to be replaced with an example
based on an ICX 7650 stack.
The following example shows a CB and PE unit configuration. The first segment shows
the running configuration, including a stack of two ICX 7750 units.
ICX7750-26Q Router> en ! ICX7750-26Q Router# show running-config Current configuration: ! ver 08.0.80b1T203 ! stack unit 1 module 1 icx7750-20-qxg-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module module 3 icx7750-6q-6port-qsfp-240g-module stack-port 1/2/4 stack unit 2 module 1 icx7750-20-qxg-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module module 3 icx7750-6q-6port-qsfp-240g-module stack-port 2/2/4 stack enable stack mac cc4e.2438.7280 ! !
The following segment shows available options for SPX in configuration mode on the ICX 7750 core stack (the CB).
ICX7750-26Q Router# configure terminal ICX7750-26Q Router(config)# spx ? allow-pe-movement A PE keeps its ID when moves cb-configure 802.1br Control Bridge Configuration: spx-port, spx-lag cb-enable enable CB mode unit configure a pe unit
The following segment creates a reserved configuration for SPX unit 18 and then checks
the configuration with the
show running-config command. The reserved configuration for SPX unit 18 appears below the stack unit
configuration. No SPX ports are generated automatically for a reserved SPX configuration
created on the CB.
ICX7750-26Q Router(config)# spx unit 18 ICX7750-26Q Router(config-spx-unit-18)# pe-name bldg2-floor2-stk18 ICX7750-26Q Router(config-spx-unit-18)# module 1 icx7450-48f-sf-port-management-module ICX7750-26Q Router(config-spx-unit-18)# module 2 icx7400-xgf-4port-40g-module ICX7750-26Q Router(config-spx-unit-18)# module 4 icx7400-qsfp-1port-40g-module ICX7750-26Q Router(config-spx-unit-18)# show running-config Current configuration: ! ver 08.0.80b1T203 ! spx cb-enable stack unit 1 module 1 icx7750-20-qxg-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module module 3 icx7750-6q-6port-qsfp-240g-module stack-port 1/2/4 stack unit 2 module 1 icx7750-20-qxg-port-management-module module 2 icx7750-qsfp-6port-qsfp-240g-module module 3 icx7750-6q-6port-qsfp-240g-module stack-port 2/2/4 spx unit 18 pe-name bldg2-floor2-stk18 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 4 icx7400-qsfp-1port-40g-module stack enable stack mac cc4e.2438.7280 !
The following segment shows optional user configuration of an SPX port and an SPX
LAG, which is added to the reserved configuration for SPX unit 18. This configuration
will be pushed to a PE unit that is assigned this ID when it joins the CB, as long
as the new SPX ports do not make the PE unit inaccessible from the CB. In this case,
the configuration is accepted as shown in
show running-config output.
ICX7750-26Q Router(config-spx-unit-21)# spx-port 18/2/4 ICX7750-26Q Router(config-spx-unit-21)# spx-lag 18/1/10 to 18/1/11 ICX7750-26Q Router(config-spx-unit-21)# exit ICX7750-26Q Router(config)# show running-config Current configuration: ! ! spx unit 18 pe-name bldg2-floor2-stk18 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-lag 18/1/10 to 18/1/11 spx-port 18/2/4
The following segment configures the CB. SPX ports and SPX LAGs are created on the
CB. Optional PE group names are applied. The group names can be referenced to assign
PE IDs from the CB when desired, and they appear in SPX
show command output.
ICX7750-26Q Router(config)# spx cb-config ICX7750-26Q Router(config-spx-cb)# spx-port 1/1/5 pe-group bld1-fl2-stk5 ICX7750-26Q Router(config-spx-cb)# spx-port 1/1/6 ICX7750-26Q Router(config-spx-cb)# spx-lag 1/1/10 to 1/1/11 pe-group bld1-fl3-stk7 ICX7750-26Q Router(config-spx-cb)# spx-port 1/2/1 pe-group stk_HR ICX7750-26Q Router(config-spx-cb)# exit
The following segment reserves PE ID 18 for a PE that joins on SPX port 1/2/1. It also reserves PE ID 20 for a PE unit that joins on the SPX LAG configured in the previous segment. Notice that a port number is used in the first case, but the PE group name is used to represent the SPX LAG on which the PE ID of 20 is reserved. The PE group name, the individual SPX port number, or any port in an SPX LAG can be used to represent the same PE ID assignment.
ICX77750-26Q Router(config-spx-cb)# pe-id 1/2/1 18 ! ICX7750-26Q Router(config-spx-cb)# pe-id bld1-fl3-stk7 20 ! ICX7750-26Q Router(config-spx-cb)# show running-config Current configuration: <snip> spx unit 18 pe-name bldg2-floor2-stk18 module 1 icx7450-48f-sf-port-management-module module 2 icx7400-xgf-4port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-lag 18/1/10 to 18/1/11 spx-port 18/2/4 stack enable stack mac cc4e.2438.7280 ! spx cb-enable spx cb-config spx-port 1/1/5 pe-group bld1-fl2-stk5 spx-port 1/1/6 spx-lag 1/1/10 to 1/1/11 pe-group bld1-fl3-stk7 spx-port 1/2/1 pe-group stk_HR pe-id stk_HR 18 pe-id bld1-fl3-stk7 20
If a PE unit matching the reserved configuration for SPX unit 18 were to join a CB unit, the following information would be displayed.
ICX7750-26Q Router#T=2m27.1: create spx u18, PE-port=18/2/4, CB-port=1/2/1 mac=cc4e.2438.7500, has provisional config ICX7750-26Q Router# ICX7750-26Q Router#T=2m27.5: U1 hotswap spx u18
The
show spx command entered on the CB displays information similar to the following example.
ICX7750-26Q Router# show spx T=3m6.7: alone: standalone, D: dynamic cfg, S: static ID Type Role Mac Address Pri State Comment 1 S ICX7750-26QXG active cc4e.2438.7280 0 local Ready 2 S ICX7750-26QXG standby 748e.f8f9.6300 0 remote Ready 18 S ICX7450-48GF spx-pe cc4e.2438.7500 N/A remote Ready <-- Reserved configuration has been applied, and PE unit 18 is operational. active standby +---+ +---+ | 1 |2/4--2/1| 2 | +---+ +---+ 1/2/1 pe-group bldg1-name3 +----+ 1/2/1--2/4| 18 |1/10= +----+
PE Configuration
The following example converts an ICX 7450 standalone unit to a PE unit. If stacking is enabled, it must be disabled before the unit can be enabled as a PE.
ICX7450-48P Router# configure terminal ICX7450-48P Router(config)# spx ? pe-enable enable PE mode zero-touch-deny cannot be discovered ICX7450-48P Router(config)# spx pe-enable Enter provisional PE mode. CLI is limited to spx unit 1. After finishing all configuration, please "write memory" and reload this unit to be a PE. [Provisional-PE]ICX7450-48P Router(config)# show running-config Current configuration: ! ver 08.0.80B7T213 ! spx pe-enable spx unit 1 module 1 icx7450-48p-poe-management-module module 2 icx7400-xgc-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-port 1/2/1 |<-- system generates spx-port 1/2/1 and 1/2/3 if module 2 is 4x10G. spx-port 1/2/3 |<-- ! End
The following segment creates a suggested ID for the new PE unit, which has entered Provisional-PE mode as indicated in the prefix of the command line prompt. The PE ID can be overridden by other configuration information on the CB.
[Provisional-PE]ICX7450-48P Router(config)# spx suggested-id 20 [Provisional-PE]ICX7450-48P Router(config)# show running-config Current configuration: ! ver 08.0.80B7T213 ! spx pe-enable spx suggested-id 20 spx unit 1 module 1 icx7450-48p-poe-management-module module 2 icx7400-xgc-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-port 1/2/1 spx-port 1/2/3 ! End
The following segment shows optional SPX port and SPX LAG configuration and confirms the running configuration.
[Provisional-PE]ICX7450-48P Router(config)# spx unit 1 [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# spx-lag 1/2/1 to 1/2/2 spx-port 1/2/1 is replaced by spx-lag 1/2/1 to 1/2/2 [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# no spx-port 1/2/3 spx-port 1/2/3 is removed. [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# spx-port 1/2/4 spx-port 1/2/3 is replaced by spx-port 1/3/1 |<-- system generates spx-port 1/3/1 after 1/2/3 is removed. [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# show running-config Current configuration: ! ver 08.0.80B7T213 ! spx pe-enable spx suggested-id 20 spx unit 1 module 1 icx7450-48p-poe-management-module module 2 icx7400-xgc-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-lag 1/2/1 to 1/2/2 spx-port 1/2/4 spx-port 1/3/1 !
The following segment saves the configuration in the SPX boot file and confirms its contents.
[Provisional-PE]ICX7450-48P Router# write memory [Provisional-PE]ICX7450-48P Router(config-spx-unit-1)# show config Configuration in spx_pe.boot: ! ver 08.0.80B7T213 ! spx pe-enable spx suggested-id 20 spx unit 1 module 1 icx7450-48p-poe-management-module module 2 icx7400-xgc-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-lag 1/2/1 to 1/2/2 spx-port 1/2/4 spx-port 1/3/1 !
The following segment reloads the ICX 7450, which moves from Provisional-PE to PE mode after the reload.
[Provisional-PE]ICX7450-48P Router# reload
Are you sure? (enter 'y' or 'n'): y
Unmounting the External USB
We are in system resetDisabled core-1
CPU Sampling disabled.
The system is going down NOW!!!
!
Ruckus Wireless Bootloader: 10.1.12b001T215 (Mar 28 2018 - 00:00:53)
Validate Shmoo parameters stored in flash ..... OK
Restoring Shmoo parameters from flash .....
Running simple memory test ..... OK
ICX7450-48 Copper (POE), PVT1
SYS CPLD VER: 0x10, Released Ver: 0
Enter 'b' to stop at boot monitor: 0
bootdelay: ===
Booting image from Primary
.......................................................................................................................................................................................................................................................................................................................................## Booting kernel from FIT Image at 70000200 ...
Using 'conf@2' configuration
Trying 'kernel@1' kernel subimage
Description: Ruckus Linux SP/SI
Type: Kernel Image
Compression: lzma compressed
Data Start: 0x700002d0
Data Size: 2178385 Bytes = Architecture: ARM
OS: Linux
Load Address: 0x61008000
Entry Point: 0x61008000
Hash algo: crc32
Hash value: fa26f214
Verifying Hash Integrity ... crc32+ OK
## Loading init Ramdisk from FIT Image at 70000200 ...
Using 'conf@2' configuration
Trying 'ramdisk@1' ramdisk subimage
Description: Ramdisk -rootfs
Type: RAMDisk Image
Compression: lzma compressed
Data Start: 0x70430060
Data Size: 25319571 Bytes = Architecture: ARM
OS: Linux
Load Address: 0x00000000
Entry Point: 0x00000000
Hash algo: crc32
Hash value: 4acb6356
Verifying Hash Integrity ... crc32+ OK
## Flattened Device Tree from FIT Image at 70000200
Using 'conf@2' configuration
Trying 'fdt@1' FDT blob subimage
Description: Flattened Device Tree blob
Type: Flat Device Tree
Compression: uncompressed
Data Start: 0x70429790
Data Size: 8922 Bytes = Architecture: ARM
Hash algo: crc32
Hash value: 10a00dea
Verifying Hash Integrity ... crc32+ OK
Loading FDT from 0x70429790 to 0x65008000
Booting using the fdt blob at 0x65008000
Uncompressing Kernel Image ... OK
Using Device Tree in place at 65008000, end 6500d2d9
Starting kernel ...
bcmiproc-gmac 18023000.ethernet: can't find MAC address
booting with 4.4 kernel
PLATFORM SP
SP's eUSB-Infra Called
Number of eUSB partitions 3 ...
PLATFORM SP
Config partition mounted.
eUSB flash drive is ready No External USB Drive(s) Mounted . Enabling core#1
core#1 enabled
Kernel crashdump is disabled.
Resources folder check done!
Mfg. Backup Infra is Factory Disabled
dma_mem_base: 0x96000000, dma_mem_len: 0x8000000, warm_mem_base: 0xdf500000, warm_mem_len: 0xb00000
Creating TUN device
Enabling time stamp.
Starting the FastIron.
USER=root
HOME=/
GCOV_PREFIX=/fast_iron
ethaddr=60:9c:9f:27:a4:df?
TERM=vt102
PATH=/sbin:/usr/sbin:/bin:/usr/bin
ip=10.20.70.41:10.70.6.26:10.20.70.1:255.255.255.128:SP:eth0:off
SHELL=/bin/sh
PWD=/
[sp-gpio]:sil_gpiochip_register: gpiochip registeration
i2c-0 smbus iproc-smb-1 SMBus adapter 3
i2c-1 smbus iproc-smb-1 SMBus adapter 3
FIPS Disabled:PORT NOT DISABLED
platform type 73
OS>
Loaded Image SPR08080B7 from Pri Built on (UTC): Sat May 26 18:33:53 2018
Enabling Console Logging
Upgrade from pre 8.0.80 image. Dual mode to VLAN config upgrade needed
Hotplugger Daemon Initialized ..
set_board_level: gi_board_type = 101
System is booting up in PE mode: Jumbo frame is enabled.
[ 59.864651] linux-kernel-bde: map phys range 0x48000000-0x48040000 to 0xb0c33000-0xb0c73000
[ 59.965154] linux-kernel-bde: map phys range 0x42000000-0x42040000 to 0xb0bf3000-0xb0c33000
[ 60.065406] linux-kernel-bde: map phys range 0x42040000-0x42080000 to 0xb0bb3000-0xb0bf3000
[ 60.318856] linux-kernel-bde: map phys range 0x88100000-0x90100000 to 0xa8bb3000-0xb0bb3000
DMA pool size: 134217728
SOC unit 0 attached to PCI device BCM56548_A0
BCM848xx: u=0 p=50: init. Chip Rev = 01 Version = 01.09.01 Date = 02/17/2000 (MDIO)
BCM848xx: u=0 p=51: init. Chip Rev = 01 Version = 01.09.01 Date = 02/17/2000 (MDIO)
Setting the CMIC registers for the link scan
SOC unit 1 attached to PCI device BCM56548_A0
BCM848xx: u=1 p=42: init. Chip Rev = 01 Version = 01.09.01 Date = 02/17/2000 (MDIO)
BCM848xx: u=1 p=43: init. Chip Rev = 01 Version = 01.09.01 Date = 02/17/2000 (MDIO)
Setting the CMIC registers for the link scan
ICX7450: no XML license is presented. SAU option: l3-prem.
Firmware version from File: 2.1.0
Pre Parsing Config Data ...
PE Unit: No BCM L3 Initialization
sw_pp_device_map_init -> PE INIT
Warning: This operation would close all existing SSH connection.
PE Unit: Skipping CPU next Hop creation
PE Unit: Skipping create nextHop drop
PE Unit: Not initing Ingress interfaces ...
Upgrade from pre 8.0.80 image. Dual mode to VLAN config upgrade flag is reset
PE Unit: Skipping create nextHop drop
bootup in PE mode
bootup in PE mode, enable processing of tagged LLDP packets
Creating certificate, please wait...
SSL Client Certificate is successfully created
System initialization completed...console going online.
Copyright (c) 2017 Ruckus Wireless, Inc. All rights reserved.
UNIT 1: compiled on May 26 2018 at 11:28:37 labeled as SPR08080B7
(29716384 bytes) from Primary SPR08080B7.bin
SW: Version 08.0.80B7T213
Compressed Boot-Monitor Image size = 786944, Version:10.1.12T215 (spz10112b001)
Compiled on Wed Mar 28 07:01:00 2018
HW: Stackable ICX7450-48-HPOE
Internal USB: Serial #: 9900515110300009
Vendor: ATP Electronics, Total size = 1919 MB
==========================================================================
UNIT 1: SL 1: ICX7450-48P POE 48-port Management Module
Serial #:CYR3347L01Z
Software Package: ICX7450_L3_SOFT_PACKAGE (LID: eatIIJMnFGb)
Current License: l3-prem
P-ASIC 0: type B548, rev 01 Chip BCM56548_A0
==========================================================================
UNIT 1: SL 2: ICX7400-4X10GC 4-port 40G Module
Serial #:CYW3323K01W
==========================================================================
UNIT 1: SL 3: ICX7400-1X40GQ 1-port 40G Module
Serial #:CYX3347L08F
==========================================================================
UNIT 1: SL 4: ICX7400-1X40GQ 1-port 40G Module
Serial #:CYX3328L1NC
==========================================================================
1000 MHz ARM processor ARMv7 88 MHz bus
8192 KB boot flash memory
2048 MB code flash memory
2048 MB DRAM
STACKID 1 system uptime is 1 minute(s) 20 second(s)
The system started at 23:56:11 GMT+00 Fri Jun 15 2018
The system : started=warm start reloaded=by "reload"
Bootup role: Port Extender (PE)
The following segment shows the new PE joining the CB. It is assigned SPX unit ID 17 because it matches the reserved configuration created previously on the CB. This overrides any suggested ID configured earlier on the provisional PE.
[PE]local-17@ICX7450-48P Router# Power supply 1 detected. Power supply 1 is up. Power supply 2 detected. Power supply 2 is up. PoE: Stack unit 1 Power supply 2 with 748000 mwatts capacity is up PoE Info: Adding new 54V capacity of 748000 mW, total capacity is 748000, total free capacity is 748000 PoE Info: PoE module 1 of Unit 1 on ports 1/1/1 to 1/1/48 detected. Initializing.... 2000 log entries of PoE Event Trace Log Buffer is allocated on unit 1 for unit 1 PoE Event Trace Logging enabled for unit 1After the PE joins the CB, an rconsole session to the CB is automatically established from the PE unit. The prompt changes to reflect the remote connection. When the PE is redirected to the CB console, you can manage the Campus Fabric network from the PE if you prefer.
Connecting to control-bridge 1 console... (Press Ctrl Shift - x to exit) ICX7750-26Q Router>
ICX7750-26Q Router> enable No password has been assigned yet... ICX7750-26Q Router# rconsole 17 Connecting to unit 17... (Press Ctrl-o x or type exit to exit) [PE]rconsole-17@ICX7450-48P Router#
The following examples display the
show running-config and
show interface brief command output for PE 17. The example show the configuration and the local interfaces
for PE 17. The commands are entered from the PE console, which has been redirected
to the CB console.
[PE]rconsole-17@ ICX7450-48P Router #show running-config Current configuration: ! ver 08.0.80B7T213 ! spx pe-enable spx unit 17 pe-name finance module 1 icx7450-48p-poe-management-module module 2 icx7400-xgc-4port-40g-module module 3 icx7400-qsfp-1port-40g-module module 4 icx7400-qsfp-1port-40g-module spx-lag 17/2/1 to 17/2/2 spx-lag 17/3/1 17/4/1 ! jumbo ! End
[PE]rconsole-17@ICX7450-48P Router# show interface brief Port Link State Dupl Speed Trunk Tag Pvid Pri MAC Name 17/1/1 Down None None None None no N/A 0 609c.9f2a.d460 17/1/2 Down None None None None no N/A 0 609c.9f2a.d461 17/1/3 Down None None None None no N/A 0 609c.9f2a.d462 17/1/4 Down None None None None no N/A 0 609c.9f2a.d463 17/1/5 Down None None None None no N/A 0 609c.9f2a.d464 17/1/6 Down None None None None no N/A 0 609c.9f2a.d465 17/1/7 Down None None None None no N/A 0 609c.9f2a.d466 17/1/8 Down None None None None no N/A 0 609c.9f2a.d467 17/1/9 Down None None None None no N/A 0 609c.9f2a.d468 17/1/10 Down None None None None no N/A 0 609c.9f2a.d469 17/1/11 Down None None None None no N/A 0 609c.9f2a.d46a 17/1/12 Down None None None None no N/A 0 609c.9f2a.d46b 17/1/13 Down None None None None no N/A 0 609c.9f2a.d46c 17/1/14 Down None None None None no N/A 0 609c.9f2a.d46d 17/1/15 Down None None None None no N/A 0 609c.9f2a.d46e 17/1/16 Down None None None None no N/A 0 609c.9f2a.d46f 17/1/17 Down None None None None no N/A 0 609c.9f2a.d470 17/1/18 Down None None None None no N/A 0 609c.9f2a.d471 17/1/19 Down None None None None no N/A 0 609c.9f2a.d472 17/1/20 Down None None None None no N/A 0 609c.9f2a.d473 17/1/21 Down None None None None no N/A 0 609c.9f2a.d474 17/1/22 Down None None None None no N/A 0 609c.9f2a.d475 17/1/23 Down None None None None no N/A 0 609c.9f2a.d476 17/1/24 Down None None None None no N/A 0 609c.9f2a.d477 17/1/25 Down None None None None no N/A 0 609c.9f2a.d478 17/1/26 Down None None None None no N/A 0 609c.9f2a.d479 17/1/27 Down None None None None no N/A 0 609c.9f2a.d47a 17/1/28 Down None None None None no N/A 0 609c.9f2a.d47b 17/1/29 Down None None None None no N/A 0 609c.9f2a.d47c 17/1/30 Down None None None None no N/A 0 609c.9f2a.d47d 17/1/31 Down None None None None no N/A 0 609c.9f2a.d47e 17/1/32 Down None None None None no N/A 0 609c.9f2a.d47f 17/1/33 Down None None None None no N/A 0 609c.9f2a.d480 17/1/34 Down None None None None no N/A 0 609c.9f2a.d481 17/1/35 Down None None None None no N/A 0 609c.9f2a.d482 17/1/36 Down None None None None no N/A 0 609c.9f2a.d483 17/1/37 Down None None None None no N/A 0 609c.9f2a.d484 17/1/38 Down None None None None no N/A 0 609c.9f2a.d485 17/1/39 Down None None None None no N/A 0 609c.9f2a.d486 17/1/40 Down None None None None no N/A 0 609c.9f2a.d487 17/1/41 Down None None None None no N/A 0 609c.9f2a.d488 17/1/42 Down None None None None no N/A 0 609c.9f2a.d489 17/1/43 Down None None None None no N/A 0 609c.9f2a.d48a 17/1/44 Down None None None None no N/A 0 609c.9f2a.d48b 17/1/45 Down None None None None no N/A 0 609c.9f2a.d48c 17/1/46 Down None None None None no N/A 0 609c.9f2a.d48d 17/1/47 Down None None None None no N/A 0 609c.9f2a.d48e 17/1/48 Down None None None None no N/A 0 609c.9f2a.d48f 17/2/1 Up n/a Full 10G 1 no N/A 0 609c.9f2a.d491 17/2/2 Up n/a Full 10G 1 no N/A 0 609c.9f2a.d492 17/2/3 Down None None None None no N/A 0 609c.9f2a.d493 17/2/4 Down None None None None no N/A 0 609c.9f2a.d494 17/3/1 Up n/a Full 40G 2 no N/A 0 609c.9f2a.d495 17/4/1 Up n/a Full 40G 2 no N/A 0 609c.9f2a.d499 lg1 Up Forward Full 20G 1 No 1 0 609c.9f2a.d491 lg2 Up Forward Full 80G 2 No 1 0 609c.9f2a.d495 mgmt1 Up None Full 1G None No None 0 609c.9f2a.d460 [PE]rconsole-17@ICX7450-48P Router#