ON THIS PAGE
Troubleshooting the PTX3000
PTX3000 Troubleshooting Resources Overview
To troubleshoot a PTX3000, you use the Junos OS CLI, alarms, devices connected to the alarm relay contacts, and LEDs on both the components and craft interface.
LEDs—When the Routing Engine detects an alarm condition, it lights the red or yellow alarm LED on the craft interface as appropriate. In addition, you can also use LEDs on the faceplate of a component and the FANTRAY LEDs on the craft interface to troubleshoot the PTX3000.
Alarm devices connected to the alarm relay contact—When a red or yellow alarm occurs, it trips the corresponding alarm relay contact.
CLI—The CLI is the primary tool for controlling and troubleshooting hardware, Junos OS, routing protocols, and network connectivity. CLI commands display information from routing tables, information specific to routing protocols, and information about network connectivity derived from the ping and traceroute utilities. For information about using the CLI to troubleshoot Junos OS, see the appropriate Junos OS configuration guide.
JTAC—If you need assistance during troubleshooting, you can contact the Juniper Networks Technical Assistance Center (JTAC) by using the Web or by telephone. If you encounter software problems, or problems with hardware components not discussed here, contact JTAC.
PTX3000 LED Overview
Craft Interface LEDs
The craft interface displays system status messages and enables you to troubleshoot the PTX3000. See PTX3000 Craft Interface LEDs.
LEDs on the craft interface include:
Red (major) and yellow (minor) alarm LEDs—One large red circular LED and one large yellow triangular LED indicate two levels of alarm conditions. You can determine the cause of the alarm condition by looking at the
show chassis alarms
command.FANTRAY LEDs—One bicolor green and red LED for each fan tray labeled 0 and 1 that indicates the status of each fan tray.
Component LEDs
The following LEDs are located on various PTX3000 components and display the status of those components:
Control Board LEDs—Three LEDs on each Control Board faceplate—ACTIVE, OK, and FAIL— indicate the status of that Control Board. Two port LEDs—HOST/ETHERNET and ACT—indicate the port speed and status. LNK LEDs indicate the status of the clocking ports—BITS A and BITS B.
FPC LEDs—Each FPC has a STATUS LED that indicate the status of that FPC.
PIC LEDs—Each port on each PIC has an LED that indicates the status of the port.
PSM LEDs—Four LEDs on each PSM faceplate—Input (
) 1, input (
) 2, OK, and fault (
)— indicate the status of that PSM.
SIB LEDs—Three LEDs on each SIB faceplate—ACTIVE, OK, and FAIL—indicate the status of that SIB.
PTX3000 Alarm Messages Overview
When the Routing Engine detects an alarm condition, it lights
the red or yellow alarm LED on the craft interface as appropriate
and trips the corresponding alarm relay contact. To view a more detailed
description of the alarm cause, issue the show chassis alarms
CLI command:
user@host> show chassis alarms 9 alarms currently active Alarm time Class Description 2013-05-07 13:45:08 PDT Minor FPC 12 SIB Link Error 2013-05-07 13:45:07 PDT Minor FPC 8 SIB Link Error 2013-05-07 13:45:06 PDT Minor FPC 6 SIB Link Error 2013-05-07 13:45:05 PDT Minor FPC 10 SIB Link Error 2013-05-07 13:45:04 PDT Minor FPC 2 SIB Link Error 2013-05-07 13:45:03 PDT Minor FPC 0 SIB Link Error 2013-05-07 13:45:02 PDT Minor FPC 4 SIB Link Error 2013-05-07 13:45:01 PDT Minor FPC 14 SIB Link Error 2013-05-07 13:35:17 PDT Minor Host 1 Boot from alternate media
Chassis alarm messages indicate a problem with a chassis component such as the cooling system or power supplies.
See Also
Troubleshooting the PTX3000 Cooling System
Troubleshooting the PTX3000 Fan Trays
Problem
Description
The following alarms and LEDs indicate a problem with the fan trays:
An alarm indicates that a fan failed or a fan tray is missing.
An LED for a fan tray on the craft interface is lit red.
In Table 1, the text in the CLI
Message column appears in the output of the show chassis alarms
command.
Alarm Type |
CLI Message |
Alarm Condition |
Recovery |
---|---|---|---|
Red |
|
A fan has failed. |
Replace the fan tray. |
|
A fan tray is missing or too many fan trays have failed. |
Reinstall the fan tray in the chassis. |
|
Yellow |
|
A fan tray has been removed. |
Reinstall the fan tray in the chassis. |
Solution
To troubleshoot the fan trays:
Find the source of the problem by looking at the display on the craft interface. The number of alarm conditions, as well as the source of each alarm, appears on the screen.
Issue the
show chassis alarms
command to get information about the source of an alarm condition:user@host> show chassis alarms
If the craft interface display lists only one failed fan and the other fans are functioning normally, the fan is probably faulty and you need to replace the failed fan tray.
Place your hand near the exhaust vents at the rear of the chassis to determine whether the fans are pushing air out of the chassis.
Zone 0: The air exhausts from the top rear of the chassis.
Zone 1: The exhaust vent is located at the bottom rear of the chassis.
Power system: The air exhausts from the rear of the power supply modules (PSMs).
Use the
show chassis environment fan
command to verify that the status of each fan isOK
.Note:Fan Tray 0
andFan Tray 1
in the command output cool zone 0 and zone 1, respectively.user@host> show chassis environment fan Fan Tray 0 status: FTC I2CS Voltage: 12.0 V 12180 3.3 V 3280 1.2 V 1210 FTC I2CS temperature 30 degrees C / 86 degrees F Fan Tray 1 status: FTC I2CS Voltage: 12.0 V 12180 3.3 V 3308 1.2 V 1214 FTC I2CS temperature 29 degrees C / 84 degrees F
Use the
show chassis zones
command to verify the status of each cooling zone.user@host> show chassis zones ZONE 0 Status Driving FRU FPC 2 TL0 Temperature 73 degrees C / 163 degrees F Condition OK Num Fans Missing 0 Num Fans Failed 0 Fan Duty Cycle 0 ZONE 1 Status Driving FRU SIB 8 TF Temperature 76 degrees C / 168 degrees F Condition WARM TEMP Num Fans Missing 0 Num Fans Failed 0 Fan Duty Cycle 0
Use the
show chassis zones detail
command to verify the status of each component in cooling zone 0 and cooling zone 1.user@host> show chassis zones detail ZONE 0 Status Item Status Measurement CB 0 OK Routing Engine 0 OK FPC 0 Absent FPC 2 OK PIC Absent FPC 4 OK PIC OK FPC 6 OK Fan Tray 0 OK Spinning at 40% fan tray speed ZONE 1 Status Item Status Measurement CB 1 OK Routing Engine 1 OK SIB 0 OK SIB 1 OK SIB 2 OK SIB 3 OK SIB 4 OK SIB 5 Absent SIB 6 Absent SIB 7 OK SIB 8 WARM TEMP FPC 8 OK PIC Absent FPC 10 Offline FPC 12 OK PIC Absent FPC 14 OK PIC Absent Fan Tray 1 OK Spinning at 40% fan tray speed
See Also
Troubleshooting Temperature Alarms
Problem
Description
Yellow (minor) and red (major) alarms indicate
that the temperature for a router component exceeds the preconfigured temperature warm
or temperature hot
threshold. When the temperature of a component exceeds the preconfigured
maximum Fire Shutdown
threshold, the
PTX3000 is powered off immediately.
In Table 2, the text in the
CLI Message column appears in the output of the show chassis alarms
command.
Alarm Type |
CLI Message |
Alarm Condition |
Recovery |
---|---|---|---|
Red |
|
A temperature sensor failed. |
Contact JTAC. |
|
The Control Board temperature exceeded the hot temperature threshold. If this condition persists, the Control Board shuts down. |
|
|
|
The FPC temperature exceeded the hot temperature threshold. If this condition persists, the FPC shuts down. |
|
|
|
The SIB temperature exceeded the hot temperature threshold. If this condition persists, the SIB shuts down. |
|
|
Yellow |
|
The Control Board temperature exceeded the warm temperature threshold. |
|
|
The SIB temperature exceeded the warm temperature threshold. |
|
|
|
The FPC temperature exceeded the warm temperature threshold. |
|
Solution
To troubleshoot temperature alarms:
Find the source of the problem. Issue the
show chassis alarms
command to get information about the source of an alarm condition:user@host> show chassis alarms
Verify that there is sufficient airflow. See PTX3000 Clearance Requirements for Airflow and Hardware Maintenance and Maintaining PTX3000 Cooling System Components.
Place your hand near the exhaust vents at the rear of the chassis to determine whether the fans are pushing air out of the chassis.
Zone 0: The air exhausts from the top rear of the SIBs.
Zone 1: The exhaust vent is located at the bottom rear of the chassis.
Power system: The air exhausts from the power supply modules (PSMs).
Verify that the cooling system in the chassis is operating properly. See Troubleshooting the PTX3000 Cooling System.
Verify that the room temperature is within acceptable limits. Use the
show chassis temperature-thresholds
to show the temperature thresholds for various components.Note:Exhaust A
andExhaust B
correspond to temperature sensors located on the Control Boards.user@host> show chassis temperature-thresholds Fan speed Yellow alarm Red alarm Fire Shutdown (degrees C) (degrees C) (degrees C) (degrees C) Item Normal High Normal Bad fan Normal Bad fan Normal Routing Engine 0 70 75 90 87 102 97 115 CB 0 Exhaust A 60 65 78 75 85 80 95 CB 0 Exhaust B 60 65 78 75 85 80 95 CB 1 Exhaust A 60 65 78 75 85 80 95 CB 1 Exhaust B 60 65 78 75 85 80 95
Check the temperature of components that are monitored for temperature alarms by issuing the
show chassis environment monitored
command. For more information about temperature alarms, see Table 2.Verify that the status of each component is
OK
.The output is similar to the following:
user@host> show chassis environment monitored Class Item Status Measurement Routing Engine 0 CPU OK 60 degrees C / 140 degrees F Routing Engine 1 CPU OK 57 degrees C / 134 degrees F CB 0 Exhaust A OK 26 degrees C / 78 degrees F CB 0 Exhaust B OK 27 degrees C / 80 degrees F CB 1 Exhaust A OK 28 degrees C / 82 degrees F CB 1 Exhaust B OK 32 degrees C / 89 degrees F SIB 0 Exhaust OK 41 degrees C / 105 degrees F SIB 0 TF OK 50 degrees C / 122 degrees F SIB 1 Exhaust OK 42 degrees C / 107 degrees F SIB 1 TF OK 49 degrees C / 120 degrees F SIB 2 Exhaust OK 42 degrees C / 107 degrees F SIB 2 TF OK 50 degrees C / 122 degrees F SIB 3 Exhaust OK 41 degrees C / 105 degrees F SIB 3 TF OK 53 degrees C / 127 degrees F SIB 4 Exhaust OK 34 degrees C / 93 degrees F SIB 4 TF OK 42 degrees C / 107 degrees F SIB 7 Exhaust OK 50 degrees C / 122 degrees F SIB 7 TF OK 68 degrees C / 154 degrees F SIB 8 Exhaust OK 61 degrees C / 141 degrees F SIB 8 TF OK 75 degrees C / 167 degrees F FPC 2 Exhaust OK 40 degrees C / 104 degrees F FPC 2 Intake OK 39 degrees C / 102 degrees F FPC 2 TL0 OK 73 degrees C / 163 degrees F FPC 2 TQ0 OK 66 degrees C / 150 degrees F FPC 2 TL1 OK 58 degrees C / 136 degrees F FPC 2 TQ1 OK 50 degrees C / 122 degrees F FPC 4 Exhaust OK 36 degrees C / 96 degrees F FPC 4 Intake OK 43 degrees C / 109 degrees F FPC 4 TL0 OK 58 degrees C / 136 degrees F FPC 4 TQ0 OK 54 degrees C / 129 degrees F FPC 4 TL1 OK 58 degrees C / 136 degrees F FPC 4 TQ1 OK 50 degrees C / 122 degrees F FPC 8 Intake OK 44 degrees C / 111 degrees F FPC 8 Exhaust OK 47 degrees C / 116 degrees F FPC 8 TL0 OK 70 degrees C / 158 degrees F FPC 8 TQ0 OK 60 degrees C / 140 degrees F FPC 8 TL1 OK 74 degrees C / 165 degrees F FPC 8 TQ1 OK 63 degrees C / 145 degrees F FPC 12 Intake OK 30 degrees C / 86 degrees F FPC 12 Exhaust OK 48 degrees C / 118 degrees F FPC 12 TL0 OK 47 degrees C / 116 degrees F FPC 12 TQ0 OK 56 degrees C / 132 degrees F FPC 12 TL1 OK 57 degrees C / 134 degrees F FPC 12 TQ1 OK 60 degrees C / 140 degrees F FPC 14 Intake OK 42 degrees C / 107 degrees F FPC 14 Exhaust OK 51 degrees C / 123 degrees F FPC 14 TL0 OK 61 degrees C / 141 degrees F FPC 14 TQ0 OK 57 degrees C / 134 degrees F FPC 14 TL1 OK 51 degrees C / 123 degrees F FPC 14 TQ1 OK 48 degrees C / 118 degrees F
user@host> show chassis environment monitored Class Item Status Measurement Routing Engine 0 OK 52 degrees C / 125 degrees F Routing Engine 0 CPU OK 51 degrees C / 123 degrees F Routing Engine 1 OK 46 degrees C / 114 degrees F Routing Engine 1 CPU OK 50 degrees C / 122 degrees F CB 0 Intake OK 45 degrees C / 113 degrees F CB 0 Exhaust OK 33 degrees C / 91 degrees F CB 1 Intake OK 39 degrees C / 102 degrees F CB 1 Exhaust OK 35 degrees C / 95 degrees F SIB 0 TMP75 OK 51 degrees C / 123 degrees F SIB 0 PF OK 55 degrees C / 131 degrees F SIB 1 TMP75 OK 60 degrees C / 140 degrees F SIB 1 PF OK 63 degrees C / 145 degrees F SIB 2 TMP75 OK 56 degrees C / 132 degrees F SIB 2 PF OK 57 degrees C / 134 degrees F SIB 3 TMP75 OK 53 degrees C / 127 degrees F SIB 3 PF OK 54 degrees C / 129 degrees F SIB 4 TMP75 OK 53 degrees C / 127 degrees F SIB 4 PF OK 52 degrees C / 125 degrees F SIB 5 TMP75 OK 55 degrees C / 131 degrees F SIB 5 PF OK 56 degrees C / 132 degrees F SIB 6 TMP75 OK 63 degrees C / 145 degrees F SIB 6 PF OK 69 degrees C / 156 degrees F SIB 7 TMP75 OK 68 degrees C / 154 degrees F SIB 7 PF OK 77 degrees C / 170 degrees F SIB 8 TMP75 OK 62 degrees C / 143 degrees F SIB 8 PF OK 66 degrees C / 150 degrees F FPC 4 Exhaust OK 64 degrees C / 147 degrees F FPC 4 PE0 OK 71 degrees C / 159 degrees F FPC 4 PE1 OK 75 degrees C / 167 degrees F FPC 4 PFE0-HMC0-DIE OK 65 degrees C / 149 degrees F FPC 4 PFE0-HMC0-TOP OK 64 degrees C / 147 degrees F FPC 4 PFE0-HMC0-BOT OK 68 degrees C / 154 degrees F FPC 4 PFE0-HMC1-DIE OK 69 degrees C / 156 degrees F FPC 4 PFE0-HMC1-TOP OK 66 degrees C / 150 degrees F FPC 4 PFE0-HMC1-BOT OK 68 degrees C / 154 degrees F FPC 4 PFE0-HMC2-DIE OK 71 degrees C / 159 degrees F FPC 4 PFE0-HMC2-TOP OK 68 degrees C / 154 degrees F FPC 4 PFE0-HMC2-BOT OK 72 degrees C / 161 degrees F FPC 4 PFE1-HMC0-DIE OK 76 degrees C / 168 degrees F FPC 4 PFE1-HMC0-TOP OK 73 degrees C / 163 degrees F FPC 4 PFE1-HMC0-BOT OK 78 degrees C / 172 degrees F FPC 4 PFE1-HMC1-DIE OK 75 degrees C / 167 degrees F FPC 4 PFE1-HMC1-TOP OK 74 degrees C / 165 degrees F FPC 4 PFE1-HMC1-BOT OK 77 degrees C / 170 degrees F FPC 4 PFE1-HMC2-DIE OK 76 degrees C / 168 degrees F FPC 4 PFE1-HMC2-TOP OK 74 degrees C / 165 degrees F FPC 4 PFE1-HMC2-BOT OK 80 degrees C / 176 degrees F PIC Ambient OK 43 degrees C / 109 degrees F PIC Framer ASIC0 OK 42 degrees C / 107 degrees F PIC Framer ASIC1 OK 46 degrees C / 114 degrees F PIC Framer ASIC2 OK 50 degrees C / 122 degrees F PIC Framer ASIC3 OK 49 degrees C / 120 degrees F FPC 12 Exhaust OK 50 degrees C / 122 degrees F FPC 12 PE0 OK 73 degrees C / 163 degrees F FPC 12 PE1 OK 63 degrees C / 145 degrees F FPC 12 PFE0-HMC0-DIE OK 74 degrees C / 165 degrees F FPC 12 PFE0-HMC0-TOP OK 79 degrees C / 174 degrees F FPC 12 PFE0-HMC0-BOT OK 79 degrees C / 174 degrees F FPC 12 PFE0-HMC1-DIE OK 73 degrees C / 163 degrees F FPC 12 PFE0-HMC1-TOP OK 74 degrees C / 165 degrees F FPC 12 PFE0-HMC1-BOT OK 76 degrees C / 168 degrees F FPC 12 PFE0-HMC2-DIE OK 70 degrees C / 158 degrees F FPC 12 PFE0-HMC2-TOP OK 66 degrees C / 150 degrees F FPC 12 PFE0-HMC2-BOT OK 71 degrees C / 159 degrees F FPC 12 PFE1-HMC0-DIE OK 59 degrees C / 138 degrees F FPC 12 PFE1-HMC0-TOP OK 62 degrees C / 143 degrees F FPC 12 PFE1-HMC0-BOT OK 66 degrees C / 150 degrees F FPC 12 PFE1-HMC1-DIE OK 53 degrees C / 127 degrees F FPC 12 PFE1-HMC1-TOP OK 54 degrees C / 129 degrees F FPC 12 PFE1-HMC1-BOT OK 54 degrees C / 129 degrees F FPC 12 PFE1-HMC2-DIE OK 57 degrees C / 134 degrees F FPC 12 PFE1-HMC2-TOP OK 57 degrees C / 134 degrees F FPC 12 PFE1-HMC2-BOT OK 62 degrees C / 143 degrees F PIC Ambient OK 54 degrees C / 129 degrees F PIC Framer ASIC0 OK 60 degrees C / 140 degrees F PIC Framer ASIC1 OK 53 degrees C / 127 degrees F PIC Framer ASIC2 OK 42 degrees C / 107 degrees F PIC Framer ASIC3 OK 40 degrees C / 104 degrees F
Note:Exhaust A
,Exhaust B
,TLn
,TQn
, andExhaust
correspond to temperature sensors located on the respective hardware component.Use the
show chassis environment routing-engine
command to check the temperature of each Routing Engine.user@host> show chassis environment routing-engine Routing Engine 0 status: State Online Master CPU Temperature 60 degrees C / 140 degrees F Routing Engine 1 status: State Online Standby CPU Temperature 57 degrees C / 134 degrees F
Use the
show chassis environment cb
command to check the temperature of each Control Board.Note:Exhaust A
andExhaust B
correspond to temperature sensors located on the Control Boards.user@host> show chassis environment cb CB 0 status: State Online Master Intake Temperature 48 degrees C / 118 degrees F Exhaust Temperature 36 degrees C / 96 degrees F Power 1 1.2 V 1199 Power 2 1.05 V 1049 3.3 V 3300 Power 3 0.9 V 919 1.0 V 999 Power 4 1.0 V 999 Power 5 12.0 V RE 902 Power 6 0.75 V 589 1.05 V 1044 1.1 V 1102 1.2 V bias 1195 1.5 V 1498 1.8 V 1804 1.8 V bias 1817 2.5 V 2510 3.3 V bias 3296 3.9 V 3910 5.0 V 4950 Power 7 12.0 V 7097 12.0 V * 12221 Bus Revision 18 FPGA Revision 9 CB 1 status: State Online Standby Intake Temperature 39 degrees C / 102 degrees F Exhaust Temperature 40 degrees C / 104 degrees F Power 1 1.2 V 1199 Power 2 1.05 V 1050 3.3 V 3299 Power 3 0.9 V 919 1.0 V 999 Power 4 1.0 V 999 Power 5 12.0 V RE 903 Power 6 0.75 V 589 1.05 V 1044 1.1 V 1092 1.2 V bias 1192 1.5 V 1488 1.8 V 1798 1.8 V bias 1807 2.5 V 2494 3.3 V bias 3296 3.9 V 3925 5.0 V 4930 Power 7 12.0 V 6644 12.0 V * 12281 Bus Revision 18 FPGA Revision 9
Use the
show chassis environment sib
command to check the temperature of each SIB.Note:Intake
,Exhaust
, andJunction
correspond to temperature sensors located on the SIBs.user@host> show chassis environment sib SIB 0 status: State Online TMP75 Temperature 42 degrees C / 107 degrees F PF Temperature 43 degrees C / 109 degrees F PCIE Switch Temperature 69 degrees C / 156 degrees F Power 1 2.5 V 2458 3.3 V bias 3299 Power 2 1.0 V 1000 1.0 V * 1000 Power 3 0.9 V 897 0.9 V PFE0 898 Power 4 0.9 V PEX 899 0.9 V PFE1 899 Power 5 12.0 V 2820 12.0 V * 12383 Power 6 1.0 V PFE0 998 1.5 V 1500 1.8 V 1790 6.5 V bias 6520 SIB 1 status: State Online TMP75 Temperature 41 degrees C / 105 degrees F PF Temperature 41 degrees C / 105 degrees F PCIE Switch Temperature 67 degrees C / 152 degrees F Power 1 2.5 V 2460 3.3 V bias 3299 Power 2 1.0 V 999 1.0 V * 1000 Power 3 0.9 V 899 0.9 V PFE0 900 Power 4 0.9 V PEX 899 0.9 V PFE1 899 Power 5 12.0 V 2820 12.0 V * 12383 Power 6 1.0 V PFE0 998 1.5 V 1500 1.8 V 1798 6.5 V bias 6504 SIB 2 status: State Online TMP75 Temperature 41 degrees C / 105 degrees F PF Temperature 41 degrees C / 105 degrees F PCIE Switch Temperature 65 degrees C / 149 degrees F Power 1 2.5 V 2462 3.3 V bias 3299 Power 2 1.0 V 1000 1.0 V * 1000 Power 3 0.9 V 899 0.9 V PFE0 900 Power 4 0.9 V PEX 899 0.9 V PFE1 899 Power 5 12.0 V 2820 12.0 V * 12444 Power 6 1.0 V PFE0 1000 1.5 V 1498 1.8 V 1798 6.5 V bias 6512 ...
Use the
show chassis environment fpc
command to check the temperature of each FPC.Note:PMB
,Intake
,Exhaust A
,Exhaust B
,TLn
, andTQn
correspond to temperature sensors located on the FPCs.user@host> show chassis environment fpc FPC 0 status: State Online Exhaust Temperature 54 degrees C / 129 degrees F Intake Temperature 50 degrees C / 122 degrees F PE0 Temperature 57 degrees C / 134 degrees F PE1 Temperature 58 degrees C / 136 degrees F PFE0-HMC0-DIE Temperature 44 degrees C / 111 degrees F PFE0-HMC0-TOP Temperature 49 degrees C / 120 degrees F PFE0-HMC0-BOT Temperature 52 degrees C / 125 degrees F PFE0-HMC1-DIE Temperature 38 degrees C / 100 degrees F PFE0-HMC1-TOP Temperature 49 degrees C / 120 degrees F PFE0-HMC1-BOT Temperature 57 degrees C / 134 degrees F PFE0-HMC2-DIE Temperature 42 degrees C / 107 degrees F PFE0-HMC2-TOP Temperature 53 degrees C / 127 degrees F PFE0-HMC2-BOT Temperature 56 degrees C / 132 degrees F PFE1-HMC0-DIE Temperature 47 degrees C / 116 degrees F PFE1-HMC0-TOP Temperature 56 degrees C / 132 degrees F PFE1-HMC0-BOT Temperature 59 degrees C / 138 degrees F PFE1-HMC1-DIE Temperature 44 degrees C / 111 degrees F PFE1-HMC1-TOP Temperature 56 degrees C / 132 degrees F PFE1-HMC1-BOT Temperature 60 degrees C / 140 degrees F PFE1-HMC2-DIE Temperature 45 degrees C / 113 degrees F PFE1-HMC2-TOP Temperature 52 degrees C / 125 degrees F PFE1-HMC2-BOT Temperature 59 degrees C / 138 degrees F Power MAIN 3.3v 3269 MAIN 1.2v 1175 CPU 1.8v 1808 MAIN 1.5v 1502 MAIN 1.1v 1066 CPU pnnv 970 CPU pvccv 970 CPU vddqv 1502 FPC 1.2v 1200 FPC 1.0v 999 FPC 2.5v 2499 FPC 3.3v 3300 PE0 1 0.9v 898 PE0 2 0.9v 899 PE0 3 0.9v 901 PE0 4 0.9v 901 PE0 5 0.9v 899 PE0 1.2v 1199 PE0 H 0.9v 900 PE0 1 1.0v 999 PE1 2 1.0v 1000 PE1 1 0.9v 898 PE1 2 0.9v 898 PE1 3 0.9v 899 PE1 4 0.9v 899 PE1 5 0.9v 899 PE1 1.2v 1200 PE1 H 0.9v 899 PE1 1 1.0v 999 PE1 2 1.0v 1000 FPC 12.0v 12281 PIC 12.0v 12221 FPC 2 status: State Online Exhaust Temperature 60 degrees C / 140 degrees F Intake Temperature 63 degrees C / 145 degrees F PE0 Temperature 64 degrees C / 147 degrees F PE1 Temperature 67 degrees C / 152 degrees F PFE0-HMC0-DIE Temperature 54 degrees C / 129 degrees F PFE0-HMC0-TOP Temperature 61 degrees C / 141 degrees F PFE0-HMC0-BOT Temperature 67 degrees C / 152 degrees F PFE0-HMC1-DIE Temperature 53 degrees C / 127 degrees F PFE0-HMC1-TOP Temperature 61 degrees C / 141 degrees F PFE0-HMC1-BOT Temperature 63 degrees C / 145 degrees F PFE0-HMC2-DIE Temperature 58 degrees C / 136 degrees F PFE0-HMC2-TOP Temperature 70 degrees C / 158 degrees F PFE0-HMC2-BOT Temperature 72 degrees C / 161 degrees F PFE1-HMC0-DIE Temperature 59 degrees C / 138 degrees F PFE1-HMC0-TOP Temperature 71 degrees C / 159 degrees F PFE1-HMC0-BOT Temperature 79 degrees C / 174 degrees F PFE1-HMC1-DIE Temperature 66 degrees C / 150 degrees F PFE1-HMC1-TOP Temperature 79 degrees C / 174 degrees F PFE1-HMC1-BOT Temperature 80 degrees C / 176 degrees F PFE1-HMC2-DIE Temperature 65 degrees C / 149 degrees F PFE1-HMC2-TOP Temperature 80 degrees C / 176 degrees F PFE1-HMC2-BOT Temperature 80 degrees C / 176 degrees F Power MAIN 3.3v 3268 MAIN 1.2v 1174 CPU 1.8v 1815 MAIN 1.5v 1497 MAIN 1.1v 1067 CPU pnnv 1035 CPU pvccv 1035 CPU vddqv 1502 FPC 1.2v 1199 FPC 1.0v 999 FPC 2.5v 2499 FPC 3.3v 3299 PE0 1 0.9v 898 PE0 2 0.9v 900 PE0 3 0.9v 898 PE0 4 0.9v 899 PE0 5 0.9v 899 PE0 1.2v 1199 PE0 H 0.9v 899 PE0 1 1.0v 1000 PE1 2 1.0v 1001 PE1 1 0.9v 897 PE1 2 0.9v 897 PE1 3 0.9v 898 PE1 4 0.9v 898 PE1 5 0.9v 899 PE1 1.2v 1200 PE1 H 0.9v 899 PE1 1 1.0v 1000 PE1 2 1.0v 1001 FPC 12.0v 12221 PIC 12.0v 12221 ...
Use the
show chassis environment
command to verify that the status of each component isOK
.user@host> show chassis environment Class Item Status Measurement Temp PSM 0 Absent PSM 1 OK 22 degrees C / 71 degrees F PSM 2 Absent PSM 3 OK 22 degrees C / 71 degrees F PSM 4 Check Routing Engine 0 OK 36 degrees C / 96 degrees F Routing Engine 0 CPU OK 60 degrees C / 140 degrees F Routing Engine 1 OK 38 degrees C / 100 degrees F Routing Engine 1 CPU OK 57 degrees C / 134 degrees F CB 0 Intake OK 36 degrees C / 96 degrees F CB 0 Exhaust A OK 26 degrees C / 78 degrees F CB 0 Exhaust B OK 27 degrees C / 80 degrees F CB 1 Intake OK 44 degrees C / 111 degrees F CB 1 Exhaust A OK 28 degrees C / 82 degrees F CB 1 Exhaust B OK 32 degrees C / 89 degrees F SIB 0 Exhaust OK 41 degrees C / 105 degrees F SIB 0 TF OK 49 degrees C / 120 degrees F SIB 0 PCIE Switch OK 68 degrees C / 154 degrees F SIB 1 Exhaust OK 42 degrees C / 107 degrees F SIB 1 TF OK 48 degrees C / 118 degrees F SIB 1 PCIE Switch OK 73 degrees C / 163 degrees F SIB 2 Exhaust OK 42 degrees C / 107 degrees F SIB 2 TF OK 50 degrees C / 122 degrees F SIB 2 PCIE Switch OK 74 degrees C / 165 degrees F SIB 3 Exhaust OK 41 degrees C / 105 degrees F SIB 3 TF OK 53 degrees C / 127 degrees F SIB 3 PCIE Switch OK 68 degrees C / 154 degrees F SIB 4 Exhaust OK 33 degrees C / 91 degrees F SIB 4 TF OK 42 degrees C / 107 degrees F SIB 4 PCIE Switch OK 60 degrees C / 140 degrees F SIB 7 Exhaust OK 50 degrees C / 122 degrees F SIB 7 TF OK 68 degrees C / 154 degrees F SIB 7 PCIE Switch OK 82 degrees C / 179 degrees F SIB 8 Exhaust OK 62 degrees C / 143 degrees F SIB 8 TF OK 76 degrees C / 168 degrees F SIB 8 PCIE Switch OK 94 degrees C / 201 degrees F FPC 2 PMB Exhaust OK 51 degrees C / 123 degrees F FPC 2 PMB Intake OK 50 degrees C / 122 degrees F FPC 2 PMB CPU OK 86 degrees C / 186 degrees F FPC 2 Exhaust OK 40 degrees C / 104 degrees F FPC 2 Intake OK 39 degrees C / 102 degrees F FPC 2 TL0 OK 73 degrees C / 163 degrees F FPC 2 TQ0 OK 66 degrees C / 150 degrees F FPC 2 TL1 OK 57 degrees C / 134 degrees F FPC 2 TQ1 OK 50 degrees C / 122 degrees F FPC 4 PMB Exhaust OK 39 degrees C / 102 degrees F FPC 4 PMB Intake OK 37 degrees C / 98 degrees F FPC 4 PMB CPU OK 48 degrees C / 118 degrees F FPC 4 Exhaust OK 36 degrees C / 96 degrees F FPC 4 Intake OK 43 degrees C / 109 degrees F FPC 4 TL0 OK 58 degrees C / 136 degrees F FPC 4 TQ0 OK 54 degrees C / 129 degrees F FPC 4 TL1 OK 58 degrees C / 136 degrees F FPC 4 TQ1 OK 50 degrees C / 122 degrees F FPC 8 PMB Intake OK 53 degrees C / 127 degrees F FPC 8 PMB Exhaust OK 47 degrees C / 116 degrees F FPC 8 PMB CPU OK 76 degrees C / 168 degrees F FPC 8 Intake OK 44 degrees C / 111 degrees F FPC 8 Exhaust OK 47 degrees C / 116 degrees F FPC 8 TL0 OK 70 degrees C / 158 degrees F FPC 8 TQ0 OK 60 degrees C / 140 degrees F FPC 8 TL1 OK 74 degrees C / 165 degrees F FPC 8 TQ1 OK 63 degrees C / 145 degrees F FPC 12 PMB Intake OK 31 degrees C / 87 degrees F FPC 12 PMB Exhaust OK 28 degrees C / 82 degrees F FPC 12 PMB CPU OK 41 degrees C / 105 degrees F FPC 12 Intake OK 29 degrees C / 84 degrees F FPC 12 Exhaust OK 48 degrees C / 118 degrees F FPC 12 TL0 OK 47 degrees C / 116 degrees F FPC 12 TQ0 OK 56 degrees C / 132 degrees F FPC 12 TL1 OK 57 degrees C / 134 degrees F FPC 12 TQ1 OK 60 degrees C / 140 degrees F FPC 14 PMB Intake OK 53 degrees C / 127 degrees F FPC 14 PMB Exhaust OK 53 degrees C / 127 degrees F FPC 14 PMB CPU OK 76 degrees C / 168 degrees F FPC 14 Intake OK 42 degrees C / 107 degrees F FPC 14 Exhaust OK 51 degrees C / 123 degrees F FPC 14 TL0 OK 61 degrees C / 141 degrees F FPC 14 TQ0 OK 57 degrees C / 134 degrees F FPC 14 TL1 OK 51 degrees C / 123 degrees F FPC 14 TQ1 OK 48 degrees C / 118 degrees F FPM I2CS OK 24 degrees C / 75 degrees F Fans Fan Tray 0 Fan 1 OK 5400 RPM Fan Tray 0 Fan 2 OK 5640 RPM Fan Tray 0 Fan 3 OK 5400 RPM Fan Tray 0 Fan 4 OK 5400 RPM Fan Tray 0 Fan 5 OK 5520 RPM Fan Tray 0 Fan 6 OK 5400 RPM Fan Tray 0 Fan 7 OK 5160 RPM Fan Tray 0 Fan 8 OK 6240 RPM Fan Tray 0 Fan 9 OK 6120 RPM Fan Tray 0 Fan 10 OK 6360 RPM Fan Tray 0 Fan 11 OK 6360 RPM Fan Tray 0 Fan 12 OK 6360 RPM Fan Tray 0 Fan 13 OK 6360 RPM Fan Tray 0 Fan 14 OK 6360 RPM Fan Tray 1 Fan 1 OK 5400 RPM Fan Tray 1 Fan 2 OK 5520 RPM Fan Tray 1 Fan 3 OK 5400 RPM Fan Tray 1 Fan 4 OK 5400 RPM Fan Tray 1 Fan 5 OK 5400 RPM Fan Tray 1 Fan 6 OK 5160 RPM Fan Tray 1 Fan 7 OK 5400 RPM Fan Tray 1 Fan 8 OK 6120 RPM Fan Tray 1 Fan 9 OK 6120 RPM Fan Tray 1 Fan 10 OK 6360 RPM Fan Tray 1 Fan 11 OK 6360 RPM Fan Tray 1 Fan 12 OK 6240 RPM Fan Tray 1 Fan 13 OK 6480 RPM Fan Tray 1 Fan 14 OK 6360 RPM
Note:Exhaust A
,Exhaust B
,TLn
,TQn
,Intake
, andExhaust
correspond to temperature sensors located on the respective hardware component.
Troubleshooting the PTX3000 Power Supply Modules
Problem
Description
The following alarms and LEDs indicate a problem with the power supply modules during normal operations:
One or both of the green input 1 and input 2 LEDs are off, indicating that the input is not receiving voltage.
The green OK LED on a PSM is off when a PSM output has failed or is not receiving voltage, or the PSM power switch is on standby.
The fault (
) LED on a PSM is lit when a PSM has failed, is not properly installed, or is not receiving sufficient voltage.
In Table 3, the text in the CLI Message
column appears in the output of the show chassis alarms
command.
Alarm Type |
CLI Message |
Alarm Condition |
Recovery |
---|---|---|---|
Red (major) |
|
The specified PSM has failed. An input might be bad, or the input might be incorrectly connected. The PSM or the chassis might have exceeded the temperature thresholds, a fan might have failed, and so on. |
|
|
The PTX3000 does not support the power supply module. |
Replace the PSM with a supported PSM. |
|
|
One or more FPCs do not have redundant power supply modules. See Table 4. If nonredundant PSMs that provide power to the FPCs fail, the FPCs will lose service. |
If the minimum number of required PSM are not installed as indicated in PTX3000 Power System Description:
If a PSM fails, fix or replace the PSM. |
Number of PSMs |
Nonredundant Power to the FPCs and PICs |
---|---|
1 |
Nonredundant power to a maximum of one FPC and one PIC |
2 |
Nonredundant power to a maximum of four FPCs and four PICs |
3 to 5 |
Nonredundant power to a maximum of eight FPCs and eight PICs |
Solution
To troubleshoot a PSM:
Issue the
show chassis alarms
command to check for alarms.Issue the
show chassis power
command to check the power usage in watts for all PSMs.user@host> show chassis power Chassis Power Input(V) Used(W) Total Power 1453 PSM 0 Input 1 0 0 Input 2 0 0 PSM 1 Input 1 50 701 Input 2 0 0 PSM 2 Input 1 0 0 Input 2 0 0 PSM 3 Input 1 51 752 Input 2 0 0 PSM 4 Input 1 0 0 Input 2 0 0
Issue the
show chassis power detail
command to check the power usage in watts for hardware components such as FPCs, fan trays, Routing Engines, Control Boards, SIBs, and craft interface.user@host> show chassis power detail Chassis Power Input(V) Used(W) Total Power 1447 PSM 0 Input 1 0 0 Input 2 0 0 PSM 1 Input 1 50 701 Input 2 0 0 PSM 2 Input 1 0 0 Input 2 0 0 PSM 3 Input 1 50 746 Input 2 0 0 PSM 4 Input 1 0 0 Input 2 0 0 Item Used(W) Fan Tray 0 38 Fan Tray 1 27 RE0/CB0 95 RE1/CB1 94 SIB 0 41 SIB 1 42 SIB 2 40 SIB 3 42 SIB 4 45 SIB 5 0 SIB 6 0 SIB 7 44 SIB 8 47 FPC 0 0 PIC 0 0 FPC 2 203 PIC 0 0 FPC 4 187 PIC 0 0 FPC 6 0 PIC 0 0 FPC 8 0 PIC 0 0 FPC 10 0 PIC 0 0 FPC 12 184 PIC 0 0 FPC 14 0 PIC 0 0
If you cannot determine the cause of the problem or need additional assistance, contact JTAC.
See Also
Troubleshooting the PTX3000 Routing Engines
Problem
Description
The following indicate a problem with the Routing Engine:
An alarm indicates that a host subsystem has been removed or failed.
The ONLINE LED on the Routing Engine faceplate is lit steadily red.
Solution
Issue the
show chassis alarms
command to check for alarms.Check the ONLINE LED on the Routing Engine faceplate. If the ONLINE LED is red, issue the
chassis routing-engine
command to check the status of the Routing Engine.user@host> show chassis routing-engine Routing Engine status: Slot 0: Current state Master Election priority Master (default) Temperature 35 degrees C / 95 degrees F CPU temperature 60 degrees C / 140 degrees F DRAM 16365 MB (16365 MB installed) Memory utilization 6 percent CPU utilization: User 2 percent Background 0 percent Kernel 17 percent Interrupt 1 percent Idle 81 percent Model RE-DUO-2600 Serial ID P737A-002791 Start time 2013-05-06 18:54:48 PDT Uptime 20 hours, 51 minutes Last reboot reason 0x1:power cycle/failure Load averages: 1 minute 5 minute 15 minute 0.25 0.25 0.19 Routing Engine status: Slot 1: Current state Backup Election priority Backup (default) Temperature 37 degrees C / 98 degrees F CPU temperature 56 degrees C / 132 degrees F DRAM 16365 MB (16365 MB installed) Memory utilization 6 percent CPU utilization: User 0 percent Background 0 percent Kernel 0 percent Interrupt 0 percent Idle 100 percent Model RE-DUO-2600 Serial ID P737A-002215 Start time 2013-05-07 14:24:59 PDT Uptime 1 hour, 20 minutes, 38 seconds Last reboot reason 0x1:power cycle/failure Load averages: 1 minute 5 minute 15 minute 0.00 0.00 0.00
Use the
show chassis alarms command
to display Routing Engine alarms.
See Also
Troubleshooting the PTX3000 Control Boards
Problem
Description
The following alarms and LEDs indicate a problem with a Control Board:
A red (major) alarm indicates that the Control Board has failed or has been removed.
A yellow (minor) alarm indicates that the Ethernet switch in the Control Board has failed.
The yellow FAIL LED on the Control Board faceplate is lit.
The green OK LED on the Control Board faceplate is not lit.
The red host subsystem FAIL LED on the craft interface is lit.
The green host subsystem OK LED on the craft interface is not lit.
In Table 5, the text in
the CLI Message column appears in the output of the show chassis alarms
command.
Alarm Type |
CLI Message |
Alarm Condition |
Recovery |
---|---|---|---|
Red |
|
A Control Board failed. |
Replace the Control Board. |
|
A Control Board has been removed. |
Reinstall the Control Board. |
|
|
On the BITS A port configured to be the primary or secondary clocking source, loss of signal has occurred. |
Reconnect the cable to the port. |
|
|
On the BITS B port configured to be the primary or secondary clocking source, loss of signal has occurred. |
Reconnect the cable to the port. |
|
Yellow |
|
The Ethernet switch on the Control Board has failed. |
Replace the Control Board. |
In Table 6, the text in the CLI Message
column appears in the output of the show chassis alarms
command.
Alarm Type |
CLI Message |
---|---|
Red |
|
Yellow |
|
Solution
To troubleshoot the Control Boards:
Check the LEDs on the faceplate of each Control Board.
Use the CLI to check for alarms. Issue the
show chassis alarms
command to view the alarms.Issue the
show chassis environment cb
command.user@host> show chassis environment cb CB 0 status: State Online Master Intake Temperature 35 degrees C / 95 degrees F Exhaust A Temperature 25 degrees C / 77 degrees F Exhaust B Temperature 27 degrees C / 80 degrees F Power 1 1.2 V 1201 mV 1.5 V 1506 mV 1.8 V 1810 mV 2.5 V 2521 mV 3.9 V 3886 mV Power 2 1.0 V 999 mV 3.3 V 3300 mV Power 3 1.0 V * 999 mV Power 4 12.0 V * 12281 mV Power 5 1.2 V bias 1202 mV 3.3 V bias 3324 mV Bus Revision 75 FPGA Revision 28 CB 1 status: State Online Standby Intake Temperature 44 degrees C / 111 degrees F Exhaust A Temperature 28 degrees C / 82 degrees F Exhaust B Temperature 31 degrees C / 87 degrees F Power 1 1.2 V 1195 mV 1.5 V 1501 mV 1.8 V 1809 mV 2.5 V 2511 mV 3.9 V 3926 mV Power 2 1.0 V 1000 mV 3.3 V 3300 mV Power 3 1.0 V * 999 mV Power 4 12.0 V * 12281 mV Power 5 1.2 V bias 1198 mV 3.3 V bias 3312 mV Bus Revision 75 FPGA Revision 28 V Bus Revision 130
See Also
Troubleshooting the PTX3000 RCBs
Problem
Description
The following indicate a problem with the Routing and Control Board:
An alarm indicates that a host subsystem has been removed or failed.
A red (major) alarm indicates that the RCB has failed.
A yellow (minor) alarm indicates the following fault conditions:
The RCB has been removed.
The Ethernet switch in the RCB has failed.
Over-voltage threshold has occurred.
Over-temperature threshold has been reached.
Clock failure has occurred.
The green OK LED on the RCB faceplate is not lit.
Note:The green OK LED on the RCB faceplate is not lit when the RCB is taken offline by the user.
In Table 7, the text in the CLI Message column appears in the output of the show chassis alarms
command.
Alarm Type |
CLI Message |
Alarm Condition |
Recovery |
---|---|---|---|
Major |
|
Secure Boot is not enabled on the RCB. |
On the console connected to the RCB:
|
Minor |
|
The BIOS version in the BIOSFlash and the jfirmware do not match. |
Upgrade the BIOS version by adding the appropriate jfirmware package and then reboot the RCB. |
Minor |
|
RCB booted from the alternative SSD. |
Replace the disk with the disk that is similar to junos smartd disk. |
Minor |
|
RCB booted from Alternate software set. |
Make a snapshot recovery so that the primary disk can be recovered. |
Minor |
|
RCB booted from Alternate software set |
Reinstall the image so that primary partition is recovered. |
Minor |
|
At least one of the VM host daemons has failed. |
Reinstall Junos OS. |
Major (companion card) |
|
RCB companion card has been removed. |
Install the companion card. |
Red |
|
A Control Board failed. |
Replace the Routing Engine-Control Board. |
|
A Control Board has been removed. |
Reinstall the RCB. |
|
|
Loss of signal has occurred on the specific GPS port. |
Reconnect the GPS cable. |
|
|
On the BITS A port configured to be the primary or secondary clocking source, loss of signal has occurred. |
Reconnect the cable to the port. |
|
|
On the BITS B port configured to be the primary or secondary clocking source, loss of signal has occurred. |
Reconnect the cable to the port. |
|
Yellow |
|
One or more (or all) ports of the Ethernet Switch on the RCB are down. |
If only one port has a failure, check if the corresponding FPC has a problem. Replace the RCB if multiple or all ports of the switch have failed.
|
|
When you bring one of the RCBs offline by using the request
chassis cb slot slot-number offline
command,
the request vmhost power-off other routing-engine
command
is triggered and a graceful shutdown of the VM host occurs. As a result,
you cannot run the request vmhost power-off other routing-engine
and request chassis cb slot slot-number offline
commands on the other Routing Engine as it is not
reachable.
Table 8 lists the possible Routing Engine switchover conditions when RCB0 is the primary Routing Engine and RCB1 is the backup Routing Engine.
Command/Action |
RCB0 State |
RCB1 State |
Description |
---|---|---|---|
request vmhost power-off other-routing-engine |
Online Primary |
Offline |
RCB0 shuts down the other routing engine, RCB1. |
request vmhost halt other-routing-engine |
Online Primary |
Online Standby |
RCB0 halts the VM host on RCB1. RCB1 is in standby mode.
To power off RCB1, you must use the |
request chassis cb offline slot 1 |
Online Primary |
Offline |
RCB1 is powered off from RCB0. |
CB1 button press |
Online Primary |
Offline |
RCB1 is powered off. |
request vmhost power-off |
Offline |
Online Primary |
RCB0 is powered off and RCB1 is the primary. Thus graceful Routing Engine switchover occurs. |
request vmhost halt |
Online Standby |
Online Primary |
RCB0 is in standby mode and RCB1 becomes the primary. Thus graceful Routing Engine switchover occurs. |
CB0 button press |
Offline |
Online Primary |
RCB0 is powered off and RCB1 is the primary. Thus graceful Routing Engine switchover occurs. |
If the other Routing Engine is not in power-off or halted state, but in an error condition, graceful Routing Engine switchover is not possible using the CLI. This error condition needs manual intervention to ensure that backup Routing Engine is ready to acquire the primary role.
Graceful Routing Engine Switchover (GRES) between the RE-DUO-C2600-16G Routing Engine and the RCB is not supported as both the Routing Engines are running on different software. The RE-DUO-C2600-16G Routing Engine runs on Junos OS and the RCB works on Junos OS running as a virtual machine over a Linux-based host (VM host).
The connection between the RCB and the backplane is configured to work at 10GBASE-KR. If a switchover happens between the RE-DUO-C2600-16G Routing Engine and the RCB, the newly-installed RCB is able to connect to the other RCB over 10-Gigabit Ethernet links on the backplane.
Solution
Issue the
show chassis alarms
command to check for alarms.Check the ONLINE LED on the Routing Engine-Control Board faceplate. If the ONLINE LED is red, issue the
chassis routing-engine
command to check the status of the RCB.user@host> show chassis routing-engine Routing Engine status: Slot 0: Current state Backup Election priority Master (default) DRAM 16343 MB (16384 MB installed) Memory utilization 37 percent 5 sec CPU utilization: User 0 percent Background 0 percent Kernel 0 percent Interrupt 0 percent Idle 100 percent 1 min CPU utilization: User 0 percent Background 0 percent Kernel 0 percent Interrupt 0 percent Idle 98 percent 5 min CPU utilization: User 0 percent Background 0 percent Kernel 1 percent Interrupt 0 percent Idle 57 percent 15 min CPU utilization: User 0 percent Background 0 percent Kernel 0 percent Interrupt 0 percent Idle 24 percent Model RE-PTX-2X00x6 Serial ID BUILTIN Start time 2016-06-28 01:12:40 PDT Uptime 1 hour, 59 minutes, 16 seconds Last reboot reason 0x2000:hypervisor reboot Load averages: 1 minute 5 minute 15 minute 0.32 0.22 0.24 Routing Engine status: Slot 1: Current state Master Election priority Backup (default) DRAM 16343 MB (16384 MB installed) Memory utilization 38 percent 5 sec CPU utilization: User 2 percent Background 0 percent Kernel 4 percent Interrupt 0 percent Idle 94 percent Model RE-PTX-2X00x6 Serial ID BUILTIN Start time 2016-06-28 01:13:36 PDT Uptime 1 hour, 58 minutes, 19 seconds Last reboot reason 0x2000:hypervisor reboot Load averages: 1 minute 5 minute 15 minute 0.25 0.38 0.40
Use the
show chassis alarms command
to display Routing Engine alarms.
If the SSDs do not have a valid Junos OS image, use a USB disk to install an image on the SSDs.
The Routing and Control Board has a battery which is discharged only when the board is powered off, and the battery has a life of 3.6 years. Therefore, a board which has been powered off either continuously or cumulatively for 3 years or more is at risk of suffering a dead battery. This results in the Real Time Clock (RTC) getting reset and the BIOS setting such as the boot order stored in the CMOS getting cleared.
See Also
Troubleshooting the RCB Companion Card
Problem
Description
The following indicate a problem with the RCB companion card:
STATUS LED on the companion card is off.
The
Fru Absent alarm
message indicates the absence of the companion card. See Table 9.
Alarm Type |
CLI Message |
Alarm Condition |
Recovery |
---|---|---|---|
Minor (companion card) |
|
Companion card is absent. |
Install the companion card. |
See Also
Troubleshooting the PTX3000 Switch Interface Boards
Problem
Description
The following LED states and alarms indicate a problem with a SIB:
Table 10 describes the SIB LED trouble states.
Label |
Color |
State |
Description |
---|---|---|---|
OK |
– |
Off |
SIB is offline or not seated properly. |
FAIL |
Yellow |
On steadily |
SIB has failed. |
In Table 11, the text in the CLI
Message column appears in the output from the show chassis alarms
command.
Alarm Type |
CLI Message |
Alarm Condition |
Recovery |
---|---|---|---|
Red (major) |
|
A SIB has failed. This might affect traffic-forwarding capacity. |
Restart the SIB. If this does not fix the issue, contact JTAC. |
Yellow (minor) |
|
The SIB has detected link errors between the SIB and FPCs. This error may affect FPC traffic forwarding. |
To isolate the problem:
|
SIB sib-number Cell Drop error |
The SIB has detected fabric cell drops. This might affect traffic-forwarding capacity |
Restart the SIB. If this does not fix the issue, contact JTAC. |
|
|
The SIB is not in an active state. This might affect the traffic-forwarding capacity. |
Bring the SIB online. Issue the |
|
|
A SIB has been removed. |
Reinstall the SIB in the chassis. |
Solution
To troubleshoot the SIBs:
Note the status of the LEDs on the faceplate of each SIB.
Verify that the SIB is properly seated in the backplane. Check that each ejector handle has been latched firmly.
Use the CLI to check for alarms. Issue the
show chassis alarms
command to view the alarms.show chassis alarms 1 alarms currently active Alarm time Class Description 2012-11-02 15:17:41 PDT Major SIB 3 Absent
Check the status of the SIBs. Issue the
show chassis sib
andshow chassis environment sib
commands.user@host> show chassis sib Slot State Fabric links Errors 0 Online Active None 1 Online Active None 2 Online Active None 3 Empty Unused None 4 Online Active None 5 Online Active None 6 Online Active None 7 Online Active None 8 Online Active None
user@host> show chassis environment sib SIB 0 status: State Online TMP75 Temperature 46 degrees C / 114 degrees F PF Temperature 47 degrees C / 116 degrees F PCIE Switch Temperature 69 degrees C / 156 degrees F Power 1 2.5 V 2463 mV 3.3 V bias 3300 mV Power 2 1.0 V 1000 mV 1.0 V * 1000 mV Power 3 0.9 V 898 mV 0.9 V PFE0 899 mV Power 4 0.9 V PEX 899 mV 0.9 V PFE1 900 mV Power 5 12.0 V 2820 mV 12.0 V * 12444 mV Power 6 1.0 V PFE0 1006 mV 1.5 V 1500 mV 1.8 V 1798 mV 6.5 V bias 6536 mV ...
Use the information gathered in the previous steps with the information in Table 10 and Table 11 to determine the proper course of action.
See Also
Troubleshooting the PTX3000 Switch Fabric
Problem
Description
The switching plane in the PTX3000 consists of the SIBs and the FPCs. A link that is in a down or error state indicates a problem with the switching planes.
Solution
To troubleshoot the switching planes:
Verify that all nine SIBs and all installed FPCs are online. Use the
show chassis fabric summary
command to check for errors.user@host> show chassis fabric summary FRU State Errors SIB0 Online Link Errors SIB1 Online None SIB2 Online None SIB3 Online None SIB4 Online None SIB5 Online None SIB6 Online None SIB7 Online None SIB8 Online None FPC0 Empty FPC1 Empty FPC2 Online None FPC3 Empty FPC4 Online None FPC5 Empty FPC6 Present FPC7 Empty FPC8 Online None FPC9 Empty FPC10 Offline FPC11 Empty FPC12 Online None FPC13 Empty FPC14 Online None FPC15 Empty
If a SIB or FPC is
Offline
, see Troubleshooting the PTX3000 FPCs and Troubleshooting the PTX3000 Switch Interface Boards to correct the problem before proceeding.Use the
show chassis fabric topology
command to query the state of the links.user@host> show chassis fabric topology In-link : FPC# FE# TQ# (TQ-TX sub-chnl #) -> SIB# TF#_FCORE# (TF-RX port#, TF-RX sub-chn#, TF-RX inst#) Out-link : SIB# TF#_FCORE# (TF-TX port#, TF-TX sub-chn#, TF-TX inst#) -> FPC# FE# TQ# (TQ-RX sub-chnl #) SIB 0 FCHIP 0 FCORE 0 : ----------------------- In-links State Out-links State -------------------------------------------------------------------------------- FPC00FE0TQ0(00)->S00F0_0(7,0,07) Down S00F0_0(3,0,11)->FPC00FE0TQ0(00) Down FPC00FE1TQ1(00)->S00F0_0(7,1,07) Down S00F0_0(3,1,11)->FPC00FE1TQ1(00) Down FPC02FE0TQ0(00)->S00F0_0(6,0,06) OK S00F0_0(2,0,10)->FPC02FE0TQ0(00) OK FPC02FE1TQ1(00)->S00F0_0(6,1,06) OK S00F0_0(2,1,10)->FPC02FE1TQ1(00) OK FPC04FE0TQ0(00)->S00F0_0(5,0,05) OK S00F0_0(1,0,09)->FPC04FE0TQ0(00) OK FPC04FE1TQ1(00)->S00F0_0(5,1,05) OK S00F0_0(1,1,09)->FPC04FE1TQ1(00) OK FPC06FE0TQ0(00)->S00F0_0(4,0,04) Down S00F0_0(0,0,08)->FPC06FE0TQ0(00) Down FPC06FE1TQ1(00)->S00F0_0(4,1,04) Down S00F0_0(0,1,08)->FPC06FE1TQ1(00) Down FPC08FE0TQ0(00)->S00F0_0(4,2,04) OK S00F0_0(0,2,08)->FPC08FE0TQ0(00) OK FPC08FE1TQ1(00)->S00F0_0(4,3,04) OK S00F0_0(0,3,08)->FPC08FE1TQ1(00) OK FPC10FE0TQ0(00)->S00F0_0(5,2,05) Down S00F0_0(1,2,09)->FPC10FE0TQ0(00) Down FPC10FE1TQ1(00)->S00F0_0(5,3,05) Down S00F0_0(1,3,09)->FPC10FE1TQ1(00) Down FPC12FE0TQ0(00)->S00F0_0(7,2,07) Error S00F0_0(3,2,11)->FPC12FE0TQ0(00) Down FPC12FE1TQ1(00)->S00F0_0(7,3,07) OK S00F0_0(3,3,11)->FPC12FE1TQ1(00) OK FPC14FE0TQ0(00)->S00F0_0(7,4,07) OK S00F0_0(3,4,11)->FPC14FE0TQ0(00) OK FPC14FE1TQ1(00)->S00F0_0(7,5,07) OK S00F0_0(3,5,11)->FPC14FE1TQ1(00) OK SIB 0 FCHIP 0 FCORE 1 : ----------------------- In-links State Out-links State -------------------------------------------------------------------------------- FPC00FE0TQ0(01)->S00F0_1(3,0,11) Down S00F0_1(7,0,07)->FPC00FE0TQ0(01) Down FPC00FE1TQ1(01)->S00F0_1(3,1,11) Down S00F0_1(7,1,07)->FPC00FE1TQ1(01) Down FPC02FE0TQ0(01)->S00F0_1(2,0,10) OK S00F0_1(6,0,06)->FPC02FE0TQ0(01) OK FPC02FE1TQ1(01)->S00F0_1(2,1,10) OK S00F0_1(6,1,06)->FPC02FE1TQ1(01) OK FPC04FE0TQ0(01)->S00F0_1(1,0,09) OK S00F0_1(4,0,04)->FPC04FE0TQ0(01) OK FPC04FE1TQ1(01)->S00F0_1(1,1,09) OK S00F0_1(4,1,04)->FPC04FE1TQ1(01) OK FPC06FE0TQ0(01)->S00F0_1(0,0,08) Down S00F0_1(4,2,04)->FPC06FE0TQ0(01) Down FPC06FE1TQ1(01)->S00F0_1(0,1,08) Down S00F0_1(4,3,04)->FPC06FE1TQ1(01) Down FPC08FE0TQ0(01)->S00F0_1(0,2,08) OK S00F0_1(4,4,04)->FPC08FE0TQ0(01) OK FPC08FE1TQ1(01)->S00F0_1(0,3,08) OK S00F0_1(4,5,04)->FPC08FE1TQ1(01) OK FPC10FE0TQ0(01)->S00F0_1(1,2,09) Down S00F0_1(5,0,05)->FPC10FE0TQ0(01) Down FPC10FE1TQ1(01)->S00F0_1(1,3,09) Down S00F0_1(5,1,05)->FPC10FE1TQ1(01) Down FPC12FE0TQ0(01)->S00F0_1(2,2,10) OK S00F0_1(6,2,06)->FPC12FE0TQ0(01) OK FPC12FE1TQ1(01)->S00F0_1(2,3,10) OK S00F0_1(6,3,06)->FPC12FE1TQ1(01) OK FPC14FE0TQ0(01)->S00F0_1(3,2,11) OK S00F0_1(7,2,07)->FPC14FE0TQ0(01) OK FPC14FE1TQ1(01)->S00F0_1(3,3,11) OK S00F0_1(7,3,07)->FPC14FE1TQ1(01) OK ...
If the state of the link is
Error
replace the FPC and SIB to determine whether the error still occurs.Tip:Use the
show chassis fabric topology | match error
command to quickly isolate errors.Display the system log messages to obtain information about link failures. The /var/log/messages file is a commonly configured destination for system log messages. To display this file, issue the
show log
command. For example:user@host> show log messages
For more information about system log messages, see the System Log Explorer.
Your customer support representative can assist you with using the information in the system log to determine whether you have a faulty SIB or FPC.
Troubleshooting the PTX3000 FPCs
Problem
Description
The following LED states and alarms indicate a problem with an FPC:
The STATUS LED on the FPC is lit steadily red.
The STATUS LED on the FPC is not lit.
Table 12 describes the FPC LED trouble states.
Label |
Color |
State |
Description |
---|---|---|---|
STATUS |
Red |
On steadily |
FPC has failed. |
– |
Off |
FPC is offline. |
In Table 13, the text in the “CLI
Message column” appears in the output of the show chassis alarms
command.
Alarm Type |
CLI Message |
Alarm Condition |
Recovery |
---|---|---|---|
Yellow (minor) |
|
One or more FPCs do not have redundant power. If the PSM that provides power to the FPCs fails, the FPCs will lose service. |
Verify the minimum number of required PSMs are installed as indicated in PTX3000 Power System Description. If necessary, install an additional PSM, or replace a failed PSM, or uninstall FPCs and PICs until you reach the number of FPCs your PSMs can support. |
Solution
To troubleshoot an FPC:
Note the STATUS LED state.
Verify that the FPC is properly seated in the backplane. Check that each ejector handle has been latched firmly.
Use the CLI to check for alarms. Issue the
show chassis alarms
command to view the alarms.Check the status of an FPC by using the following CLI command:
user@host> show chassis fpc Temp CPU Utilization (%) Memory Utilization (%) Slot State (C) Total Interrupt DRAM (MB) Heap Buffer 0 Empty 1 Empty 2 Online 51 4 0 2048 3 56 3 Empty 4 Online 39 4 0 2048 3 56 5 Empty 6 Present Absent 7 Empty 8 Online 46 4 0 2048 3 56 9 Empty 10 Offline ---Unresponsive--- 11 Empty 12 Online 27 3 0 2048 3 56 13 Empty 14 Online 53 5 0 2048 3 56 15 Empty
Use the following option to display more detailed information:
user@host> show chassis fpc detail
The following examples also specify a slot number, which is optional:
user@host> show chassis fpc detail 6 Slot 6 information: State Present
user@host> show chassis fpc detail 10 Slot 10 information: State Offline Reason Unresponsive Uptime 2 hours, 17 minutes, 45 seconds
user@host> show chassis fpc detail 8 Slot 8 information: State Online Temperature 51 degrees C / 123 degrees F (PMB Intake) Temperature 45 degrees C / 113 degrees F (PMB Exhaust) Temperature 72 degrees C / 161 degrees F (PMB CPU) Temperature 42 degrees C / 107 degrees F (Intake) Temperature 45 degrees C / 113 degrees F (Exhaust) Temperature 67 degrees C / 152 degrees F (TL0) Temperature 57 degrees C / 134 degrees F (TQ0) Temperature 71 degrees C / 159 degrees F (TL1) Temperature 60 degrees C / 140 degrees F (TQ1) Total CPU DRAM 2048 MB Start time 2013-05-07 10:57:19 PDT Uptime 4 hours, 41 minutes, 21 seconds
Use the
show chassis fabric summary
command to check the switch fabric.user@host> show chassis fabric summary FRU State Errors SIB0 Online Link Errors SIB1 Online None SIB2 Online None SIB3 Online None SIB4 Online None SIB5 Empty SIB6 Empty SIB7 Online None SIB8 Online None FPC0 Empty FPC1 Empty FPC2 Online None FPC3 Empty FPC4 Online None FPC5 Empty FPC6 Present FPC7 Empty FPC8 Online None FPC9 Empty FPC10 Offline FPC11 Empty FPC12 Online None FPC13 Empty FPC14 Online None FPC15 Empty
Use the information gathered in the previous steps with the information in Table 12 and Table 13 to determine the proper course of action.
See Also
Troubleshooting the PTX3000 PICs and PIC Cables
Problem
Description
A PIC LED lit red indicates a problem with the PIC.
Solution
To troubleshoot a PIC:
Check the status of the PIC and each PIC port. Look at the LEDs located on the PIC faceplate. For information about the meaning of LED states on different PICs, see the PTX Series Interface Module Reference.
Check the status of a PIC, issuing the
show chassis fpc pic-status
CLI command. In the CLI, all PICs are shown asPIC 0
.user@host> show chassis fpc pic-status Slot 0 Online FPC PIC 0 Online 24x 10GE(LWO) SFP+ Slot 2 Present FPC Slot 4 Online FPC PIC 0 Online 24x 10GE(LWO) SFP+ Slot 6 Online FPC PIC 0 Online 24x 10GE(LAN) SFP+ Slot 8 Online FPC PIC 0 Online 24x 10GE(LAN) SFP+ Slot 10 Online FPC PIC 0 Online 2x 40GE CFP Slot 12 Online FPC PIC 0 Online 2x 100GE CFP Slot 14 Online FPC PIC 0 Online 24x 10GE(LWO) SFP+
See Also
Troubleshooting the PTX3000 IPLCs
Problem
Description
The following LED states and alarms indicate a problem with an IPLC:
The STATUS LED on the IPLC is lit steadily red.
The STATUS LED on the IPLC is not lit.
Table 14 describes the IPLC LED trouble states.
Label |
Color |
State |
Description |
---|---|---|---|
STATUS |
Red |
On steadily |
IPLC has failed. |
– |
Off |
IPLC is offline. |
Solution
To troubleshoot an IPLC:
Note the state of the STATUS LED.
Verify that the IPLC is properly seated in the backplane. Check that each ejector handle has been latched firmly.
Use the IPLC to check for alarms. Issue the
show chassis fpc optical properties alarms fpc-slot fpc-slot
command to view the optical module alarms.user@host> show chassis fpc optical-properties alarms fpc-slot 8 Module Active Alarms Main Board IPLC 8 OSC Add LOS alarm is set Output EDFA IPLC 8 Output Power alarm is set Output EDFA IPLC 8 Out of Gain alarm is set
Check the status of an IPLC by using the following CLI command:
user@host> show chassis fpc Temp CPU Utilization (%) CPU Utilization (%) Memory Utilization (%) Slot State (C) Total Interrupt 1min 5min 15min DRAM (MB) Heap Buffer 0 Online 58 6 0 0 0 0 15010 34 19 1 Empty 2 Empty 3 Empty 4 Online 49 6 2 0 0 0 15010 30 19 5 Empty 6 Online 59 6 0 0 0 0 15010 33 19 7 Empty 8 Online 51 0 0 0 0 0 3 15 3 9 Empty 10 Empty 11 Empty 12 Online 49 4 0 0 0 0 15010 31 19 13 Empty 14 Empty 15 Present Absent
Use the following option to display more detailed information:
The following example also specifies a slot number, which is optional:
user@host> show chassis fpc detail 8 Slot 8 information: State Online Temperature 44 degrees C / 111 degrees F (Intake) Temperature 52 degrees C / 125 degrees F (Exhaust) Total CPU DRAM 3 MB Start time 2016-05-06 16:19:32 PDT Uptime 40 minutes, 27 seconds
Use the information gathered in the previous steps with the information in Table 14 to determine the proper course of action.