Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

 

Upgrading an Operational Standalone Router and Integrating It into a TX Matrix Plus Routing Matrix with 3D SIBs

 

This topic describes the steps you take to upgrade and integrate your operational T640, T1600, or T4000 router into a TX Matrix Plus routing matrix with 3D SIBs. Only one operational T640, T1600, or T4000 router can be integrated into a TX Matrix Plus routing matrix with 3D SIBs. If you plan to later attach additional LCCs, they must be integrated into the TX Matix Plus routing matrix while they are powered off. The operational standalone router must be the only line-card chassis (LCC) attached to the TX Matrix Plus switch-fabric chassis (SFC) during this procedure.

Note

During the integration of an operational standalone router with the routing matrix, the T640, T1600, or T4000 router continues to pass traffic until it is rebooted. The traffic interruption during the reboot is comparable to the interruption that occurs during a Junos OS major upgrade.

Note

This topic does not describe the steps required to upgrade an operational TX Matrix Plus routing matrix to 3D SIBs. See Upgrading an Operational TX Matrix Plus Routing Matrix to 3D SIBs for more information.

Before you begin to upgrade and integrate your operational T640, T1600, or T4000 router into a TX Matrix Plus routing matrix with 3D SIBs:

To upgrade and integrate an operational T640, T1600, or T4000 router into a routing matrix with 3D SIBs:

  1. Upgrading the Host Subsystem on the Standalone Router

  2. Upgrading the Junos OS on the Standalone Router and SFC

  3. Removing and Replacing FRUs in the Standalone Router

  4. Modifying the Configuration on the Standalone Router

  5. Verifying the Configuration Switches on the SFC

  6. Verifying the Configuration Switches on the LCC

  7. Preparing to Upgrade the Switch Fabric on the Standalone Router

  8. Upgrading the Switch Fabric Planes on the Standalone Router

  9. Completing the Upgrade and Restarting the TX Matrix Plus Routing Matrix

Upgrading the Host Subsystem on the Standalone Router

Replace the host subsystem (Routing Engines and Control Boards) on the standalone router if the required hardware is not already installed. The required Routing Engine model is RE-DUO-C1800-8G or RE-DUO-C1800-16G. The required Control Board model is LCC-CB.

  1. Upgrade the Routing Engines (RE-DUO-C1800-8G or RE-DUO-C1800-16G) in the standalone router. See Replacing a T640 Routing Engine, Replacing a T1600 Routing Engine , orReplacing a T4000 Routing Engine for more information.
  2. Upgrade the Control Boards (LCC-CB) in the standalone router. See Replacing a T640 LCC-CB, Replacing a T1600 LCC-CB, or Replacing a T4000 LCC-CB for more information.

    Verify that the two configuration switches on the faceplate of the LCC-CB are set correctly:

    • Set the M/S configuration switch to S.

      Note

      Do not set the M/S configuration switch to M until instructed to do so.

    • Set the CHASSIS ID configuration switch to 0.

Upgrading the Junos OS on the Standalone Router and SFC

Upgrade the Junos OS on the standalone router and SFC to 64-bit Junos OS Release 13.2 or later. See Upgrading the Junos OS on a Routing Matrix with a TX Matrix Plus Router for more information.

Note

The SFC and LCCs must each contain two host subsystems. All host subsystems must be running the same Junos OS release. This is a requirement for graceful switchover.

After confirming that the new packages are successfully installed and running, issue the request system snapshot command on the standalone router and SFC to back up the new software.

See request system snapshot for more information.

Removing and Replacing FRUs in the Standalone Router

Depending on your hardware configuration, you might need to remove or replace FRUs in the standalone router. See Line-Card Chassis Component Overview for information about the required hardware, and Upgrade Kits for TX Matrix Plus Routers and Line-Card Chassis for information about the upgrade kits that can be purchased.

  1. Remove unsupported FPCs and PICs from the T640, T1600, or T4000 router. The following FPCs are not supported in a routing matrix with 3D SIBs:
    • T640-FPC1-E and T640-FPC1-E2

    • T640-FPC2, T640-FPC2-E, and T640-FPC2-E2

    • T640-FPC3, T640-FPC3-E, and T640-FPC3-E2

    See Removing a T640 FPC, Removing a T1600 FPC, or Removing a T4000 FPC for more information.

  2. Install two six-input DC power supplies (model number PWR-T-6-60-DC) in the standalone router. See Upgrading the Line-Card Chassis Power Supplies for more information.
  3. Upgrade the rear fan tray (model number FAN-R-TXP-3D-LCC) in the standalone router. See Upgrading the Line-Card Chassis Rear Fan Tray for more information.
  4. Upgrade the two front fan trays (model number FANTRAY-T4000) in the standalone router. The T4000 router does not need to be upgraded. See Upgrading to a T4000 Upper Front Fan Tray in the T1600 Router and Upgrading to a T4000 Lower Front Fan Tray in the T1600 Router for more information.
  5. (Optional) Upgrade the rear cable management system (model number CBL-MGR-TXP-3D-LCC) in the standalone router. See Installing the Line-Card Chassis Rear Cable Management System for more information.

Modifying the Configuration on the Standalone Router

Modify the existing configuration on the standalone router, and save the new configuration to a new configuration file for later use. To create a configuration file:

  1. Save the existing standalone router configuration using the save command. For example:
    user@host# save standalone.conf
    Note

    We strongly recommend that you transfer the saved configuration file to an intermediate server on the out-of-band management network accessible by the standalone router.

  2. Delete unsupported configurations from the standalone router configuration.

    For any configured CoS schedulers, the non-tcp and tcp options are not supported on the protocol statement. Only the any protocol option is supported in the statement below:

  3. The Routing Engines in the SFC and attached LCCs do not support the fxp0 management interface or the fxp1 and fxp2 internal Ethernet interfaces. References in the configuration file to fxp0, fxp1, or fxp2 must be modified to em0, ixgbe0, and ixgbe1.
  4. Special configuration groups re0 and re1 apply to the Routing Engines in slots 0 and 1 of the SFC. If the standalone router configuration contains these groups, you must change them to lcc0-re0 and lcc0-re1. See Using Configuration Groups and Inheritance in a Routing Matrix with a TX Matrix Plus Router for more information.
  5. If the configuration includes special Routing Engine configuration groups, include the apply-groups statement at the [edit] hierarchy level. For example:
    user@host# apply-groups [ lcc0-re0 lcc0-re1]
  6. Change the configuration hierarchy of all statements at the [edit chassis fpc slot-number] hierarchy level to the [edit chassis lcc lcc-number fpc slot-number] hierarchy level.
  7. Save the modified standalone router configuration. Use a different filename from the one you selected for the previously saved configuration. For example:
    user@host# save lcc0.conf
    Caution

    Do not commit the configuration.

  8. Erase all uncommitted changes you have made to the configuration by issuing the rollback command.
  9. Transfer the modified configuration file that you have prepared to an intermediate server on the out-of-band management network accessible by the standalone router and the SFC.

Verifying the Configuration Switches on the SFC

Verify that the two configuration switches on the craft interface of the SFC are set correctly:

Verifying the Configuration Switches on the LCC

If you did not already do so when installing the Control Boards, verify that the two configuration switches on the faceplate of the LCC-CBs in each LCC are set correctly:

  • Set the M/S configuration switch to S.

    Note

    Do not set the M/S configuration switch to M until instructed to do so.

  • Set the CHASSIS ID configuration switch to 0.

Preparing to Upgrade the Switch Fabric on the Standalone Router

Before you begin upgrading the switch fabric on the standalone router, you must perform the following steps:

  1. On the SFC, issue the show chassis sibs command to ensure the installed SIBs are online. At a minimum, TXP-F13-3D SIBs must be installed in slots 0, 3, 6, 8, and 11. See Switching Plane Connections Between TXP-F13-3D SIBs and TXP-LCC-3D SIBs for more information about the TXP-F13-3D SIBs required for your planned configuration.Caution

    If one or more switch fabric planes are offline, or if other errors are indicated, use the procedures described in Troubleshooting Switching Plane Connections to TX Matrix Plus TXP-F13-3D SIBs to try to resolve any problems. Do not proceed to the next step until the issues are resolved.

  2. Include the fabric upgrade-mode 3d-fabric statement in the configuration of the standalone router at the [edit chassis] hierarchy level, and commit the configuration:
    Caution

    During the commit process, the Junos OS verifies the compatibility of the standalone router hardware. Correct any errors before proceeding to the next step.

  3. Include the fabric upgrade-mode 3d-fabric statement in the configuration of the SFC at the [edit chassis] hierarchy level:
  4. You can boot the standalone router as a T1600 LCC or a T4000 LCC. To configure the standalone router to boot as a T1600 LCC or T4000 LCC perform one of the following steps:

    Note

    During an operational upgrade, the standalone router must be configured as lcc 0.

    • To boot the standalone router as a T1600 LCC, include the lcc-mode lcc 0 mode t1600 statement in the configuration of the SFC at the [edit chassis] hierarchy level

    • To boot the standalone router as a T4000 LCC, include the lcc-mode lcc 0 mode t4000 and lcc-mode lcc 1 mode empty statements in the configuration of the SFC at the [edit chassis] hierarchy level

  5. Commit the configuration on the SFC.
    Caution

    During the commit process Junos OS will verify the compatibility of the SFC router hardware. Correct any errors before proceeding to the next step.

  6. Issue the show chassis sibs command on the standalone router to determine which switch fabric plane is operating as the spare, or standby, switch fabric plane, and make note of the spare plane for later use. There are five switch fabric planes, numbered 0 through 4. The numbers correspond to the slot number of the installed SIB.

    One switch fabric plane operates as the spare switch fabric plane. The other four switch fabric planes are normally online, indicating that they are operational. In the following example, plane 2 on the standalone router is Spare, indicating that switch fabric plane 2 is the standby switch fabric plane. The remaining switch fabric planes are Online:

    user@host> show chassis sibs


    Caution

    If one or more switch fabric planes are offline, or if other errors are indicated, use the procedures described inTroubleshooting the T640 SIBs, Troubleshooting the T1600 SIBs, and Troubleshooting the T4000 SIBs to try to resolve any problems. Do not proceed to the next step until the issues are resolved.

  7. Issue the show chassis fabric plane command on the SFC to determine which switch fabric plane is operating as the spare, or standby, switch fabric plane. In the following example, switch fabric plane 0 on the SFC is Spare, indicating that switch fabric plane 0 is the standby switch fabric plane. The remaining switch fabric planes on the SFC are Online:
    user@host> show chassis fabric plane


    Caution

    If one or more switch fabric planes are offline, or if other errors are indicated, use the procedures described in Troubleshooting Switching Plane Connections to TX Matrix Plus TXP-F13-3D SIBs to try to resolve any problems. Do not proceed to the next step until the issues are resolved.

  8. If the spare switch fabric plane on the standalone router (noted in Step 6) is a different plane than the spare switch fabric plane on the SFC, perform the following steps:

    1. Issue the request chassis fabric plane plane-number offline sfc 0 command on the SFC. Replace plane-number with the switch fabric plane that corresponds to the spare switch fabric plane on the standalone router. For example, if plane 2 on the standalone router is the spare switch fabric plane, bring plane 2 offline on the SFC.

      The acting spare switch fabric plane on the SFC comes online.

    2. Issue the request chassis fabric plane plane-number online sfc 0 command on the SFC. Replace plane-number with the switch fabric plane you brought offline in the previous step.

      As the switch fabric plane comes online, it will become the spare switch fabric plane.

    3. Issue the show chassis fabric plane command on the SFC to verify that all five switch fabric planes are online. At this point, the spare switch fabric planes on the standalone router and SFC should match.

Upgrading the Switch Fabric Planes on the Standalone Router

You must upgrade one switch fabric plane at a time. You will perform this procedure for each switch fabric plane. To upgrade a switch fabric plane:

  1. Issue the request chassis sib slot slot-number offline command to make the SIB that corresponds to the spare switch fabric offline on the standalone router. Replace slot-number with the SIB slot number.
  2. Issue the show chassis fabric plane command on the standalone router to verify that the requested switch fabric plane is offline, indicating that the SIB is powered down.
  3. Replace the offline SIB in the standalone router with a TXP-LCC-3D SIB. See Installing TXP-LCC-3D SIBs in an Operational Standalone Router Before Integrating into a TX Matrix Plus Routing Matrix with 3D SIBs for more information.
  4. Connect the new TXP-LCC-3D SIB to the TXP-F13-3D SIB on the SFC using the AOCs or CXP transceivers and cables. See Connecting Offline SIBs While Performing Operational Upgrades with 3D SIBs.
  5. Bring the TXP-LCC-3D SIB online by using one of the following methods:
    • Issue the request chassis sib slot slot-number online command to bring the TXP-LCC-3D SIB in the standalone router online.

    • Press the ONLINE/OFFLINE button on the TXP-LCC-3D SIB in the standalone router until the OK LED lights green.

  6. Issue the show chassis fabric optics command on the standalone router and the SFC to verify that the new TXP-LCC-3D SIB in the standalone router is online and the cables have been correctly connected. The correct cable state is CABLE_CONNECTED. The following example shows the expected cable state for SIB 0 in an SFC with one connected T1600 LCC:
    user@host> show chassis fabric optics


    Caution

    If the expected cable state is not displayed for any ports, review the procedures described in Connecting Offline SIBs While Performing Operational Upgrades with 3D SIBs; and review the port-to-port mapping described in Switching Plane Connections Between TXP-F13-3D SIBs and TXP-LCC-3D SIBs to try to resolve any problems. Do not proceed to the next step until the issues are resolved.

  7. Issue the show chassis sibs command to verify that the new TXP-LCC-3D SIB in the standalone router is online and the state of the SIB is reported as Spare. If the state of the new SIB is not reported as Spare, issue the show chassis alarms command to determine if there are any hardware errors.Caution

    If any hardware errors are reported, replace the SIB by using the procedures described in Installing TXP-LCC-3D SIBs in an Operational Standalone Router Before Integrating into a TX Matrix Plus Routing Matrix with 3D SIBs. Do not proceed to the next step until the issues are resolved.

  8. Make the next active switch fabric plane offline. After the next active plane is offline, the spare switch fabric plane with the installed TXP-LCC-3D SIB will come online.
    Caution

    During the upgrade and connection of the switching planes, the TX Matrix Plus routing matrix might experience some packet loss, depending on the operational environment. For more information, contact your customer support representative.

    Note

    After you have upgraded the final switch fabric plane, this step will make the first switch fabric plane you upgraded offline. This ensures that each switch fabric plane functioned as an active plane. The offline SIB is brought back online later in this procedure (see Completing the Upgrade and Restarting the TX Matrix Plus Routing Matrix).

    1. Issue the request chassis fabric plane plane-number offline sfc 0 command on the SFC. Replace plane-number with the number of the next active switch fabric plane that you plan to connect. This command will make the four TXP-F2S SIBs and two TXP-F13 SIBs corresponding to the next active plane offline in the SFC.
    2. Issue the request chassis fabric plane plane-number online sfc 0 command on the SFC. Replace plane-number with the switch fabric plane you brought offline in the previous step.

      As the switch fabric plane comes online, it will become the spare switch fabric plane.

    3. Issue the request chassis sib slot slot-number offline command on the standalone router. Replace slot-number with the number of the SIB slot that corresponds to the next active switch fabric plane. This command will make the SIB corresponding to the next active plane offline in the standalone router.Note

      After you have replaced all the SIBs in the standalone router with TXP-LCC-3D SIBs, performing this step will bring the first TXP-LCC-3D SIB you replaced and connected offline. In Step 1 you bring the SIB back online, and it functions as the spare switch fabric plane.

  9. Verify that traffic is flowing through all the active switch fabric planes:

    1. Issue the show chassis fabric stats rates summary command on the standalone router to verify that traffic is flowing through all four switch fabric planes. Monitor Sent and Received statistics to ensure there is traffic passing.
    2. Issue the show chassis fabric stats f13 plane-number rates summary command on the SFC to verify that traffic is flowing through the switch fabric plane that is connected to the standalone router. Monitor Sent and Received statistics to ensure that traffic is passing.Caution

      If traffic is not flowing through a switch fabric plane, bring the SIB offline by issuing the request chassis sib slot slot-number offline command, and then bring it online using the request chassis sib slot slot-number online command. Repeat Step 8 to manually train the optical links to try to resolve any problems. Do not proceed to the next step until the issues are resolved.

  10. Repeat Steps 1 through 10 for each switch fabric plane. Once you have completed upgrading each switch fabric plane proceed to Completing the Upgrade and Restarting the TX Matrix Plus Routing Matrix.Note

    At the end of this process, all SIBs in all switch fabric planes are upgraded, and traffic has flowed through each switch fabric plane. Four switch fabric planes are online and are actively passing traffic. One TXP-LCC-3D SIB is offline. This ensures that each switch fabric plane functioned as an active plane. The offline SIB is brought back online in the next procedure (see Completing the Upgrade and Restarting the TX Matrix Plus Routing Matrix).

Completing the Upgrade and Restarting the TX Matrix Plus Routing Matrix

To complete the upgrade and integration and restart the TX Matrix Plus routing matrix:

  1. Bring the TXP-LCC-3D SIB in the last offline switching plane online by using one of the following methods:
    • Issue the request chassis sib slot slot-number online command to bring the TXP-LCC-3D SIB in the standalone router online.

    • Press the ONLINE/OFFLINE button on the TXP-LCC-3D SIB in the standalone router until the OK LED lights green.

  2. Connect the Control Boards in the standalone router to the TXP-CIP on the SFC to form the control plane. See Connecting the Control Planes in an Operational Line-Card Chassis and Control Plane Connections from the TX Matrix Plus Router to the Line-Card Chassis for more information.
  3. Modify the configuration switches on the faceplate of each LCC-CB on the standalone router:

    • Set the M/S configuration switch to M.

    • Set the CHASSIS ID configuration switch to 0.

  4. On the standalone router, remove the fabric upgrade-mode 3d-fabric statement from the configuration at the [edit chassis] hierarchy level, and commit the configuration.
    user@host# delete fabric upgrade-mode 3d-fabric
    user@host# top
    user@host# commit


  5. On the SFC, apply the configuration for the LCC that you created in Modifying the Configuration on the Standalone Router, using the load merge filename command.
  6. On the SFC, remove the fabric upgrade-mode 3d-fabric statement from the configuration at the [edit chassis] hierarchy level, and commit the configuration.
    user@host# delete fabric upgrade-mode 3d-fabric
    user@host# top
    user@host# commit


  7. Restart the standalone router, using the request system reboot CLI command.
  8. Restart the SFC, using the request system reboot CLI command.
  9. After each system has restarted, issue the show chassis sibs, show chassis fpcs, and show chassis fabric stats f13 rates summary CLI commands to verify that the TX Matrix Plus routing matrix is functioning properly and the standalone router has been properly upgraded and integrated as an LCC.