Troubleshooting the TX Matrix Plus Cooling System
Problem
During normal operation:
- The fan tray LEDs on the craft interface indicate that
the cooling system is functioning normally:
- The OK LEDs for the fan trays are lit green.
- The FAIL LEDs for the fan trays are off.
- The fans in each fan tray are functioning at less than full speed.
The following alarms, LEDs, and other indications indicate a problem with the cooling system:
- A FAIL LED for a fan tray on the craft interface is lit red.
- An OK LED for a fan tray on the craft interface is not lit.
- An alarm indicates that a fan failed or a fan tray is missing.
- One or more fan trays is operating at an increased speed.
- An alarm indicates that the TX Matrix Plus router temperature exceeds the “temperature warm” or “temperature hot” threshold.
- The power supplies were automatically shut down because the temperature of the TX Matrix Plus router exceeded the maximum (“temperature hot”) threshold.
Solution
To troubleshoot the cooling system:
- Look at the LEDs on the craft interface. The following
LEDs indicate a problem:
- Fail LED for a fan tray is lit red.
- Red alarm LED on the craft interface is lit.
- Find the source of the problem by looking at the display on the craft interface. The number of alarm conditions, as well as the source of each alarm, appears on the screen.
- Place your hand near the exhaust vents at the rear of the chassis to determine whether the fans are pushing air out of the chassis.
- Use the show chassis fan command to verify
that the status of each fan is OK and that each of the fans
are Spinning at normal speed. Fan Tray 0 and Fan Tray 1 refer to the fans in the upper and lower front fan
trays, and Fan Tray 2 through Fan Tray 6 refer to
fans in the rear fan trays.
user@host> show chassis fansfc0-re0: -------------------------------------------------------------------------- Item Status RPM Measurement Fan Tray 0 Fan 1 OK 3450 Spinning at normal speed Fan Tray 0 Fan 2 OK 3420 Spinning at normal speed Fan Tray 0 Fan 3 OK 3480 Spinning at normal speed Fan Tray 0 Fan 4 OK 3360 Spinning at normal speed Fan Tray 0 Fan 5 OK 3360 Spinning at normal speed Fan Tray 0 Fan 6 OK 3390 Spinning at normal speed Fan Tray 1 Fan 1 OK 3420 Spinning at normal speed Fan Tray 1 Fan 2 OK 3450 Spinning at normal speed Fan Tray 1 Fan 3 OK 3450 Spinning at normal speed Fan Tray 1 Fan 4 OK 3420 Spinning at normal speed Fan Tray 1 Fan 5 OK 3480 Spinning at normal speed Fan Tray 1 Fan 6 OK 3420 Spinning at normal speed Fan Tray 2 Fan 1 OK 3420 Spinning at normal speed Fan Tray 2 Fan 2 OK 3420 Spinning at normal speed Fan Tray 2 Fan 3 OK 3420 Spinning at normal speed Fan Tray 2 Fan 4 OK 3390 Spinning at normal speed Fan Tray 2 Fan 5 OK 3450 Spinning at normal speed Fan Tray 2 Fan 6 OK 3360 Spinning at normal speed Fan Tray 2 Fan 7 OK 3390 Spinning at normal speed Fan Tray 2 Fan 8 OK 3420 Spinning at normal speed - Use the show chassis environment sfc 0 command to verify that the status of each component is OK.
user@host> show chassis environment sfc 0sfc0-re0: -------------------------------------------------------------------------- Class Item Status Measurement Temp PEM 0 OK 28 degrees C / 82 degrees F PEM 1 Absent Routing Engine 0 OK 27 degrees C / 80 degrees F Routing Engine 1 OK 29 degrees C / 84 degrees F CB 0 Intake OK 26 degrees C / 78 degrees F CB 0 Exhaust A OK 25 degrees C / 77 degrees F CB 0 Exhaust B OK 25 degrees C / 77 degrees F CB 1 Intake OK 26 degrees C / 78 degrees F CB 1 Exhaust A OK 26 degrees C / 78 degrees F CB 1 Exhaust B OK 26 degrees C / 78 degrees F SIB F13 0 OK 47 degrees C / 116 degrees F SIB F13 0 (B) OK 48 degrees C / 118 degrees F SIB F13 1 OK 38 degrees C / 100 degrees F SIB F13 1 (B) OK 37 degrees C / 98 degrees F SIB F2S 0/0 OK 27 degrees C / 80 degrees F SIB F2S 0/2 OK 28 degrees C / 82 degrees F SIB F2S 0/4 OK 27 degrees C / 80 degrees F SIB F2S 0/6 OK 28 degrees C / 82 degrees F SIB F2S 1/0 OK 26 degrees C / 78 degrees F SIB F2S 1/2 OK 26 degrees C / 78 degrees F SIB F2S 1/4 OK 26 degrees C / 78 degrees F SIB F2S 1/6 OK 26 degrees C / 78 degrees F SIB F2S 2/0 OK 25 degrees C / 77 degrees F SIB F2S 2/2 OK 25 degrees C / 77 degrees F SIB F2S 2/4 OK 23 degrees C / 73 degrees F CIP 0 Intake OK 23 degrees C / 73 degrees F CIP 0 Exhaust A OK 24 degrees C / 75 degrees F CIP 0 Exhaust B OK 24 degrees C / 75 degrees F CIP 1 Intake OK 24 degrees C / 75 degrees F CIP 1 Exhaust A OK 25 degrees C / 77 degrees F CIP 1 Exhaust B OK 25 degrees C / 77 degrees F Fans Fan Tray 0 Fan 1 OK Spinning at normal speed Fan Tray 0 Fan 2 OK Spinning at normal speed Fan Tray 0 Fan 3 OK Spinning at normal speed Fan Tray 0 Fan 4 OK Spinning at normal speed Fan Tray 0 Fan 5 OK Spinning at normal speed Fan Tray 0 Fan 6 OK Spinning at normal speed Fan Tray 1 Fan 1 OK Spinning at normal speed Fan Tray 1 Fan 2 OK Spinning at normal speed Fan Tray 1 Fan 3 OK Spinning at normal speed Fan Tray 1 Fan 4 OK Spinning at normal speed Fan Tray 1 Fan 5 OK Spinning at normal speed Fan Tray 1 Fan 6 OK Spinning at normal speed Fan Tray 2 Fan 1 OK Spinning at normal speed Fan Tray 2 Fan 2 OK Spinning at normal speed Fan Tray 2 Fan 3 OK Spinning at normal speed Fan Tray 2 Fan 4 OK Spinning at normal speed Fan Tray 2 Fan 5 OK Spinning at normal speed Fan Tray 2 Fan 6 OK Spinning at normal speed Fan Tray 2 Fan 7 OK Spinning at normal speed Fan Tray 2 Fan 8 OK Spinning at normal speed Fan Tray 2 Fan 9 OK Spinning at normal speed Fan Tray 3 Fan 1 OK Spinning at normal speed Fan Tray 3 Fan 2 OK Spinning at normal speed Fan Tray 3 Fan 3 OK Spinning at normal speed Fan Tray 3 Fan 4 OK Spinning at normal speed Fan Tray 3 Fan 5 OK Spinning at normal speed Fan Tray 3 Fan 6 OK Spinning at normal speed Fan Tray 3 Fan 7 OK Spinning at normal speed Fan Tray 3 Fan 8 OK Spinning at normal speed Fan Tray 3 Fan 9 OK Spinning at normal speed Fan Tray 4 Fan 1 OK Spinning at normal speed Fan Tray 4 Fan 2 OK Spinning at normal speed Fan Tray 4 Fan 3 OK Spinning at normal speed Fan Tray 4 Fan 4 OK Spinning at normal speed Fan Tray 4 Fan 5 OK Spinning at normal speed Fan Tray 4 Fan 6 OK Spinning at normal speed Fan Tray 4 Fan 7 OK Spinning at normal speed Fan Tray 4 Fan 8 OK Spinning at normal speed Fan Tray 4 Fan 9 OK Spinning at normal speed Fan Tray 5 Fan 1 OK Spinning at normal speed Fan Tray 5 Fan 2 OK Spinning at normal speed Fan Tray 5 Fan 3 OK Spinning at normal speed Fan Tray 5 Fan 4 OK Spinning at normal speed Fan Tray 5 Fan 5 OK Spinning at normal speed Fan Tray 5 Fan 6 OK Spinning at normal speed Fan Tray 5 Fan 7 OK Spinning at normal speed Fan Tray 5 Fan 8 OK Spinning at normal speed Fan Tray 5 Fan 9 OK Spinning at normal speed Misc SPMB 0 OK SPMB 1 OK - Use the show chassis temperature-thresholds to show the temperature thresholds for various components.
user@host> show chassis temperature-thresholdsFan speed Yellow alarm Red alarm Item Normal High Normal Bad fan Normal Bad fan Chassis default 48 54 65 55 75 65 Routing Engine 0 48 54 85 85 100 100 Routing Engine 1 48 54 85 85 100 100 SIB F13 0 64 70 76 72 90 84 SIB F13 1 64 70 76 72 90 84 SIB F13 3 64 70 76 72 90 84 SIB F13 4 64 70 76 72 90 84 SIB F13 6 64 70 76 72 90 84 SIB F13 7 64 70 76 72 90 84 SIB F13 8 64 70 76 72 90 84 SIB F13 9 64 70 76 72 90 84 SIB F13 12 64 70 76 72 90 84 SIB F2S 16 64 70 76 72 90 84 SIB F2S 17 64 70 76 72 90 84 SIB F2S 18 64 70 76 72 90 84 SIB F2S 19 64 70 76 72 90 84 SIB F2S 20 64 70 76 72 90 84 SIB F2S 21 64 70 76 72 90 84 SIB F2S 22 64 70 76 72 90 84 SIB F2S 23 64 70 76 72 90 84 SIB F2S 24 64 70 76 72 90 84 SIB F2S 25 64 70 76 72 90 84 SIB F2S 26 64 70 76 72 90 84 SIB F2S 27 64 70 76 72 90 84 SIB F2S 28 64 70 76 72 90 84 SIB F2S 29 64 70 76 72 90 84 SIB F2S 30 64 70 76 72 90 84 SIB F2S 31 64 70 76 72 90 84 SIB F2S 32 64 70 76 72 90 84 SIB F2S 33 64 70 76 72 90 84 SIB F2S 34 64 70 76 72 90 84 SIB F2S 35 64 70 76 72 90 84
- Issue the show chassis alarms sfc 0 command
to get information about the source of an alarm condition:
user@host> show chassis alarms sfc 0- Temperature hot:
- PEM OK LED on one or both of the power supplies is not lit—Verify that the power supply fans are operating.
- FAULT LED on one or both of the power supplies is lit—Verify that the power supply fans are operating.
- If both power supplies fail, the system temperature might have exceeded the threshold, causing the system to shut down. If the TX Matrix Plus router temperature exceeds the acceptable maximum, the TXP-CB turns off the power supplies.
- Fan Failure—If the other fans are functioning normally, a fan is probably faulty and you need to replace the fan tray.
- Temperature hot:
For information about the alarms, see Table 1.
The text in the column labeled ”LCD Message” appears in the display of the craft interface. The text in the column labeled “CLI Message” appears in the output from the show chassis alarms command.
Table 1: TX Matrix Plus Chassis Alarm Messages for the Cooling System
Component | Alarm Type | Craft Interface Message | CLI Message | Alarm Condition | Solution |
|---|---|---|---|---|---|
Fans | Red | Fan Failure | fan-name Failure | A fan has failed. | Replace the fan tray. |
Fans Missing | Too many fans missing or failing | A fan tray is missing or too many fan trays have failed. | Reinstall the fan tray in the chassis. | ||
Yellow | Fan Removed | fan-name Removed | A fan tray has been removed. | Reinstall the fan tray in the chassis. | |
Temperature sensors | Red | Temperature Hot | Temperature Hot | The chassis temperature exceeded the hot temperature threshold. If this condition persists, the router shuts down. |
|
Sensor Failure | Temperature sensor failure | A temperature sensor failed. | Contact JTAC. | ||
Yellow | Temperature Warm | Temperature Warm | The chassis temperature exceeded the warm temperature threshold. |
|
