Upgrading Both Devices in a Chassis Cluster Using a Low-Impact ISSU

Upgrading Both Devices in a Chassis Cluster Using an ISSU

For some platforms, devices in a chassis cluster can be upgraded without a service disruption using an in-service software upgrade (ISSU). The chassis cluster ISSU feature allows both devices in a cluster to be upgraded from supported Junos OS versions with a traffic impact similar to that of redundancy group failovers.

Note: ISSU does not support software downgrades.

Note: If you upgrade from a Junos OS version that supports only IPv4 to a version that supports both IPv4 and IPv6, the IPv4 traffic will continue to work during the upgrade process. If you upgrade from a Junos OS version that supports both IPv4 and IPv6 to a version that supports both IPv4 and IPv6, both the IPv4 and IPv6 traffic will continue to work during the upgrade process. Junos OS Release 10.2 and later releases support flow-based processing for IPv6 traffic.

Before you begin, note the following:

• The ISSUs are available only for Junos OS Release 9.6 and later.
• Before starting an ISSU, you should fail over all redundancy groups so that they are all active on only one node. See Initiating a Chassis Cluster Manual Redundancy Group Failover.
• We recommend that graceful restart for routing protocols be enabled before you start an ISSU.

Once all redundancy groups are active on one node, the upgrade is initiated by using a request command:

1. Fail over all redundancy groups to one node.
2. Start the ISSU from the node that is primary for all the redundancy groups by entering the following command:
   user@host> request system software in-service-upgrade image_name reboot

   Note: For SRX1400, SRX3400, SRX3600, SRX5600, and SRX5800 devices you must include reboot in the command. If reboot is not included, the command fails. For SRX100, SRX210, SRX220, SRX240, SRX550, and SRX650 devices, the reboot parameter is not available because the devices in a cluster are automatically rebooted following an in-band cluster upgrade (ICU).

3. Wait for both nodes to complete the upgrade, then verify that all policies, zones, redundancy groups, and other RTOs return to their correct states. Also verify that both devices in the cluster are running the new Junos OS build.

Note: During the upgrade, both devices might experience redundancy group failovers, but traffic is not disrupted. Each device validates the package and checks version compatibility before doing the upgrade. If the system finds that the new package is not version compatible with the currently installed version, the device refuses the upgrade or prompts you to take corrective action. Sometimes a single feature is not compatible, in which case the upgrade software prompts you to either abort the upgrade or turn off the feature before doing the upgrade.

This feature is available only through the command-line interface. See the “request system software in-service-upgrade” section of the Junos OS CLI Reference.

Rolling Back Devices in a Chassis Cluster After an ISSU

If the ISSU fails to complete and only one device in the cluster has been upgraded, you can roll back to the previous configuration on that device alone by using the following commands on the upgraded device:

• request chassis cluster in-service-upgrade abort
• request system software rollback
• request system reboot

Enabling an Automatic Chassis Cluster Node Failback After an ISSU

If you want redundancy groups to automatically return to node 0 as the primary after the ISSU is complete, you must set the redundancy group priority such that node 0 is primary and enable the preempt option. Note that this method works for all redundancy groups except redundancy group 0. You must manually fail over redundancy group 0. To set the redundancy group priority and enable the preempt option, see Example: Configuring Chassis Cluster Redundancy Groups. To manually fail over a redundancy group, see Initiating a Chassis Cluster Manual Redundancy Group Failover.

Note: To upgrade node 0 and make it available in the chassis cluster, manually reboot node 0. Node 0 does not reboot automatically.

Troubleshooting Chassis Cluster ISSU Failures

Certain circumstances, such as the following, might cause an ISSU attempt to fail.

• If you attempt to upgrade a device pair running a Junos OS image earlier than Release 9.6, the ISSU will fail without changing anything about either device in the cluster. Devices running Junos OS Releases earlier than 9.6 must be upgraded separately using individual device upgrade procedures.
• If the secondary device experiences a power-off condition before it boots up using the new image specified when the ISSU is initiated, when power is restored the newly upgraded device will still be waiting to end the ISSU. To end the ISSU on the secondary device, run request chassis cluster in-service-upgrade abort followed by reboot to abort the ISSU on that device.

When an ISSU encounters an unexpected situation that necessitates an abort, the system message provides you with detailed information about when and why the upgrade stopped and recommendations for the next steps to take. For example, the following message is issued when a node fails to become RG-0 Secondary when it boots up:

Rebooting Secondary Node
Shutdown NOW!
[pid 2120]
ISSU: Backup RE Prepare Done
Waiting for node1 to reboot.
node1 booted up.
Waiting for node1 to become secondary
error: wait for node1 to become secondary failed  (error-code: 5.1)
ISSU aborted. But, both nodes are in ISSU window.
Please do the following:
 1. Log on to the upgraded node.
 2. Rollback the image using rollback command with node option
    Note: Not using the 'node' option might cause
          the images on both nodes to be rolled back
 3. Make sure that both nodes (will) have the same image
 4. Ensure the node with older image is primary for all RGs
 5. Abort ISSU on both nodes
 6. Reboot the rolled back node

{primary:node0}

Deciphering Mismatched Control Link Statistics During a Chassis Cluster ISSU

When using dual control links (supported on the SRX5000 and SRX3000 lines only), mismatched control link statistics might be reported with the show chassis cluster statistics and show chassis cluster control-plane statistics commands while you run an ISSU with nodes on devices running different releases. (ISSUs are available in Junos OS Release 9.6 and later and dual control links are available in Junos OS Release 10.0 and later.) For example, assume that one node on a device is running Junos OS Release 9.6 and another node on a device is running Junos OS Release 10.0. In this example, a mismatch might occur because the latter device is sending heartbeats on both control links, but the other device is receiving heartbeats only on one control link.