Adding or Replacing a Node Device in a QFabric Node Group
Use this set of procedures to add or replace a node device in a:
Network Node group
Server Node group
Redundant server Node group
The Director group in a QFabric system automatically recognizes when devices are added or replaced in the QFabric system. The Director group sends each device its own portion of the Junos OS configuration and adds the device to the QFabric system inventory.
Eligible devices in a Node group are QFX5100-48S, QFX5100-48T, QFX5100-24Q, QFX3600, and QFX3500. When replacing a Node device, it is not necessary to replace the existing device with the same switch model.
The QFabric system might experience data loss when replacing a device in a server Node group during this procedure. Devices in redundant server Node groups and Network Node groups should not experience data loss.
Before You Begin
Before adding a new device or replacing an existing node device, review the following checklist:
If the switch you plan to install as a Node device was previously used as a standalone switch and had advanced feature licenses installed, you can transfer those licenses to a new device. Contact your Juniper Networks sales representative for more information.
Ensure interfaces are grouped into a LAG interface for rerouting of traffic when a device is unavailable.
Ensure all devices have an alias name configured before starting the replacement process. See Gaining Access to the QFabric System Through the Default Partition and Configuring Aliases for the QFabric System.
By default the Node devices are identified using their hardware serial number. Aliases take the place of the hardware serial numbers and help to simplify configuration tasks. The chassis serial number ID label is located in different locations depending upon the QFX switch model. See the hardware guide for your QFX switch model.
Follow all standard installation safety guidelines.
Ensure that you have taken the necessary precautions to prevent electrostatic discharge (ESD) damage. See Prevention of Electrostatic Discharge Damage.
Ensure that you do not need to forward traffic through the device.
If possible, rack mount and install the new or replacement Node device to minimize the amount of time it takes to replace the device.
Ensure that you have the following parts and tools available:
An ESD grounding strap
An external management device such as a PC
An RJ-45 to DB-9 rollover cable to connect the external management device to the console port
Powering Off an Existing QFabric Node Device
Use this procedure to gracefully shut down an existing device in a server Node group, redundant server Node group, or network Node group. This orderly process reduces traffic loss on server Node devices and prevents traffic loss on redundant server Node devices and network member devices.
Do not use the request system halt command to shut down an existing Node device or traffic loss can occur.
- Log into the QFabric default partition on the Director
device and start the CLI.
[root@dg0] # cli
- Discover the device connection status and the alias name
(identifier) by issuing the show fabric administration inventory command.
user@qfabric> show fabric administration inventory Item Identifier Connection Configuration Node group NW-NG-0 Connected Configured P5502-C Disconnected P5502-C Disconnected P8189-C Connected Configured P8189-C Connected TA3713470056 Disconnected TA3713470056 Disconnected TR0214080017 Disconnected TR0214080017 Disconnected Interconnect device IC-TB3713490033 Connected Configured TB3713490033/RE0 Connected IC-TB3714010454 Connected Configured TB3714010454/RE0 Connected Fabric manager FM-0 Connected Configured Fabric control FC-0 Connected Configured FC-1 Connected Configured Diagnostic routing engine DRE-0 Connected Configured Director group 0281022011000011 Connected 0281032012000018 Connected
The Node device must show as connected and configured to have an orderly shutdown.
- Start the orderly shutdown of the Node device by issuing
the request fabric power-off node-device operational mode
command from the QFabric default partition CLI. This command systematically
takes the node offline and gracefully shuts down the device while
preserving system state information. A message appears on the console
or console log, confirming that the operating system has stopped on
You see the following output after entering the command:
root@qfabric> request fabric administration power-off node-device ED1491 STEP 1 of 8 (Acquiring lock): Acquiring lock to perform this operation Acquired lock to perform this operation STEP 2 of 8 (Performing pre-checks): node-device ED1491 is online STEP 3 of 8 (Mastership switch-over): node-device ED1491 is Server Node-group STEP 4 of 8 (Gracefully offlining the node-device): node-device is being offlined node-device is successfully offlined STEP 5 of 8 (Waiting for convergence): Waiting for convergence(this will take few minutes) Convergence complete STEP 6 of 8 (Powering-off the node-device): Now, powering-off the node-device Powered-off the node-device STEP 7 of 8 (Updating inventory): Removing the node-device - ED1491 from inventory node-device - ED1491 is removed from inventory STEP 8 of 8 (Releasing lock): Releasing the lock root@qfabric>
The final output of the request fabric power-off node-device command is the following message: The device is shutting down and can be removed when the LCDs are off. Wait at least 3 to 4 minutes after first seeing this message before following the instructions in Step 5 and Step 6 to disconnect the switch.
- Attach the grounding strap to your bare wrist and to a site ESD point.
Disconnect power to the switch by performing one of the following tasks:
AC power supply—If the AC power source outlet has a power switch, set it to the OFF (O) position. If the AC power source outlet does not have a power switch, gently pull out the male end of the power cord connected to the power source outlet.
DC power supply—Switch the circuit breaker on the panel board that services the DC circuit to the OFF position.
Remove the power source cable from the power supply faceplate:
AC power supply—Remove the power cord from the power supply faceplate by detaching the power cord retainer and gently pulling out the female end of the power cord connected to the power supply faceplate.
DC power supply—Remove the screws securing the ring lugs attached to the power source cables to the power supply using the screwdriver, and remove the power source cables from the power supply. Replace the screws on the terminals and tighten them.
Adding a New Node Device to a Node Group in a QFabric System
To add a new device to a server Node group, redundant server Node group, or network Node group in a QFabric system:
- Ensure that each Node device is set to Node device mode.
By default, the QFX5100, QFX3500, and QFX3600 devices are configured
in standalone mode. You perform this step using the console (
CON) port on the new Node device. Leave the preexisting Node devices powered on. See Converting the Device Mode for a QFabric System Component.
- Shut down the new or replacement Node device using the request fabric administration power-off node-device command.
user@host> request fabric administration power-off node-device
- Disconnect the power on the new Node device.
- Connect the new Node device to the QFabric system control
plane network. See:
- Connect power to the new device to connect to the fabric.
For information on connecting power for your QFX switch model, see
the appropriate QFX hardware guide.
The QFabric system begins to upgrade the new device or to the version of software installed on the QFX3100 Director devices.
- Verify that the new device has been upgraded to the correct
version of software using the show version component all operational mode command from the QFabric default partition CLI.
It takes some time for the software upgrade to occur. Do not proceed to the next step until the show version component all command verifies that the software has been upgraded.
- Verify that the new device is inserted into the fabric
using the show fabric administration inventory node-devices operational mode command from the QFabric default partition CLI.
user@qfabric> show fabric administration inventory Item Identifier Connection Configuration Node group NW-NG-0 Connected Configured P5502-C Disconnected P5502-C Disconnected P8207-C Connected Configured P8207-C Connected TA3713470056 Disconnected TA3713470056 Disconnected TR0214080017 Disconnected TR0214080017 Disconnected Interconnect device IC-TB3713490033 Connected Configured TB3713490033/RE0 Connected IC-TB3714010454 Connected Configured TB3714010454/RE0 Connected Fabric manager FM-0 Connected Configured Fabric control FC-0 Connected Configured FC-1 Connected Configured Diagnostic routing engine DRE-0 Connected Configured Director group 0281022011000011 Connected 0281032012000018 Connected
- Connect the new Node device to each Interconnect device for data plane interconnection.
- Verify the data plane interconnection using the show chassis fabric connectivity operational mode command from the QFabric default partition CLI. Repeat this command if necessary until the new device is shown in the output.
- From the QFabric director, enter the following configuration
mode CLI commands to remove the previous Node device from the inventory
of QFabric system components and associate the serial number of the
new device with the alias of the previous device.
root@fabric# delete fabric aliases node-device old-serial-numberalias-name
root@fabric# set fabric aliases node-device new-serial-numberalias-name
- Add the interface configuration of the new Node device and ensure the interfaces are grouped into a link aggregation group (LAG) for the rerouting of traffic.
- Commit the changes using the commit command, which sends the configuration of the old device to the new device.