Troubleshooting Interfaces
This topic discusses various troubleshooting scenarios.
Troubleshooting: Management Interface Link Is Down for Junos OS Evolved
Problem
Description
The Ethernet Link Down
alarm is raised when you run the show chassis
alarm
operational mode command on the following devices:
-
ACX routers (ACX7100-32C, ACX7100-48L)
-
PTX routers (PTX10001-36MR, PTX10003, PTX10004, PTX10008)
-
QFX switches (QFX5130-32CD, QFX5220-32CD, QFX5220-128C)
Diagnosis
Perform the following tests to check if the management interface is down on the primary Routing Engine or the backup Routing Engine:
-
Run the
show chassis alarms
command.show chassis alarms
user@host0> show chassis alarms 1 alarms currently active Alarm time Class Description 2020-10-19 11:13:02 MYT Major Host 1 re0:mgmt-0.0 : Ethernet Link Down
Is the alarm
Ethernet Link Down
displayed against the management interface of the primary Routing Engine (Host 0)?-
Yes: Contact Juniper Networks Technical Assistance Center (JTAC) for further assistance.
-
No: Continue to the next diagnostic test.
-
-
Run the
show interfaces re0:mgmt-0
and theshow interfaces re0:mgmt-0 terse
operational mode commands.show interfaces re0:mgmt-0
user@host0> show interfaces re0:mgmt-0 Physical interface: re0:mgmt-0, Enabled, Physical link is Up Interface index: 1001, SNMP ifIndex: 193 Type: Ethernet, Link-level type: Ethernet, MTU: 1500, Speed: 1Gbps, Auto-negotiation: Enabled Device flags : Present Running Interface flags: SNMP-Traps ...
show interfaces re0:mgmt-0 terse
user@host0> show interfaces re0:mgmt-0 terse Interface Admin Link Proto Local Remote re0:mgmt-0 up up re0:mgmt-0.0 up up inet 10.100.100.1/30
Is the management interface on the primary Routing Engine
up
?-
Yes: Continue to resolution.
-
No: Contact JTAC for further assistance.
-
Resolution
To Resolve This Issue
The chassis alarm was raised for the management interface in the backup Routing Engine (Host 1) and not for the primary Routing Engine (Host 0).
Implement one of the following solutions on the backup Routing Engine to resolve this issue:
Disable the management interface in the backup Routing Engine:
In configuration mode, go to the
[edit groups re1]
hierarchy level.user@host1# edit groups re1
-
Disable the re1:mgmt-0 interface.
[edit groups re1] user@host1# set interfaces re1:mgmt-0 disable
Ignore the alarm:
In configuration mode, go to the
[edit chassis]
hierarchy level.user@host1# edit chassis
Ignore the
Ethernet link down
alarm on the management interface by setting themanagement-ethernet link-down
alarm option toignore
.[edit chassis] user@host1# set alarm management-ethernet link-down ignore
See Also
Troubleshooting: Invalid Port Speed Configuration for Junos OS Evolved
Problem
Description
The Invalid Port Speed Configuration
alarm is displayed when you run the
show system alarms
operational mode command.
For example:
user@host> show system alarms Alarm time Class Description 2021-12-06 23:09:21 UTC Minor FPC-0 PIC-0: Invalid Port Speed Configuration
Diagnosis
Run the show picd config
command from the cli-pfe
level to identify invalid port speed configurations. Running the command displays
details of port speed/channelization configurations, including which ports are valid
and reasons for any invalid PIC configurations.
For example:
root@re0:~# cli-pfe root@re0:pfe> show picd config
pic_info_table : default config config config computed pic_or_port speed pic_mode port_speed valid speed supported_speeds hidden_speeds ----------- ------- -------- ---------- ------ -------- -------------------------------------------------------- ------------- pic-0/0 - - - yes - port-0/0/0 1x400G - 1x100G - 1x100G [ 1x400G 1x200G 4x10G 1x40G 4x25G 1x100G 4x100G 2x200G ] [ ] port-0/0/1 1x400G - 1x100G - 1x100G [ 1x400G 1x200G 4x10G 1x40G 4x25G 1x100G 4x100G 2x200G ] [ ] port-0/0/2 1x400G - 1x100G - 1x100G [ 1x400G 1x200G 4x10G 1x40G 4x25G 1x100G 4x100G 2x200G ] [ ] port-0/0/3 1x400G - 1x100G - 1x100G [ 1x400G 1x200G 4x10G 1x40G 4x25G 1x100G 4x100G 2x200G ] [ ] ... port-0/0/11 1x400G - - - 1x400G [ 1x400G 1x200G 4x10G 1x40G 4x25G 1x100G 4x100G 2x200G ] [ ] port-0/0/12 1x400G - - - 1x400G [ 1x400G 1x200G 4x10G 1x40G 4x25G 1x100G 4x100G 2x200G ] [ ] port-0/0/13 1x400G - - - 1x400G [ 1x400G 1x200G 4x10G 1x40G 4x25G 1x100G 4x100G 2x200G ] [ ] port-0/0/14 1x400G - - - 1x400G [ 1x400G 1x200G 4x10G 1x40G 4x25G 1x100G 4x100G 2x200G ] [ ] ... usr_config : pic_usr_config : pic_name : pic-0/0 pic_mode_valid : false pic_mode : num_ports_valid : false num_ports : 0 config_invalid : true invalid_reason : Port 12: Speed 4x40G not supported Port 13: Speed 4x40G not supported ptp_mode : false port_usr_config : port_name : port-0/0/0 port_speed_valid : true port_speed : 1x100G sub_ports_cfg : false port_usr_config : port_name : port-0/0/1 port_speed_valid : true port_speed : 1x100G sub_ports_cfg : false port_usr_config : port_name : port-0/0/10 port_speed_valid : true port_speed : 1x40G sub_ports_cfg : false port_usr_config : port_name : port-0/0/11 port_speed_valid : true port_speed : 1x40G sub_ports_cfg : false port_usr_config : port_name : port-0/0/12 port_speed_valid : true port_speed : 4x40G sub_ports_cfg : true port_usr_config : port_name : port-0/0/13 port_speed_valid : true port_speed : 4x40G sub_ports_cfg : true port_usr_config : port_name : port-0/0/20 port_speed_valid : true port_speed : 1x100G sub_ports_cfg : false
Do the results of the show picd config
command indicate an invalid
port speed configuration?
-
Yes: Continue to resolution.
-
No: Contact Juniper Networks Technical Assistance Center (JTAC) for further assistance.
In the example, the results indicate:
Port 12: Speed 4x40G not supported Port 13: Speed 4x40G not supported
Resolution
To Resolve This Issue
The system alarm was raised for a port speed configuration that was not supported. Configure all ports to a valid port speed to resolve the issue. Port speed is configured at the PIC-level.
When an invalid configuration is applied on a port, the currently configured speed/channelization on the other ports of the PIC remain in effect until the next reboot of the device or the next picd app restart. After device reboot, or picd restart, all ports of that PIC revert to default speed. The invalid state and the resulting effect of all ports being in default speed remains in effect until the invalid configuration is corrected.
To determine valid port speeds of a logical PIC, run the show chassis pic
fpc-slot slot-number pic-slot slot-number
command.
The example contains an unsupported port speed/channelization configuration on
ports 0/0/12 and 0/0/13. To determine valid port speeds for the example, run
show chassis pic fpc-slot 0 pic-slot 0
.
root@re0> show chassis pic fpc-slot 0 pic-slot 0 --- Port speed information: Port PFE Capable Port Speeds 0 0 1x40G 1x100G 4x25G 4x10G 1 0 1x40G 1x100G 4x25G 4x10G 4 0 1x40G 1x100G 4x25G 4x10G 5 0 1x40G 1x100G 4x25G 4X10G 8 0 1x40G 1x100G 4x25G 4x10G 9 0 1x40G 1x100G 4x25G 4x10G 12 0 1x40G 1x100G 4x25G 4x10G 13 0 1x40G 1x100G 4x25G 4x10G
The invalid port speed example can be resolved by configuring ports 0/0/12 and 0/0/13 with one of the following valid port speeds:
12 1x40G 1x100G 4x25G 4x10G 13 1x40G 1x100G 4x25G 4x10G
Troubleshooting: Faulty Ethernet Physical Interface for Junos OS Evolved
You can follow the basic troubleshooting actions as explained in the following topics to troubleshoot an Ethernet physical interface on a device that Junos OS Evolved supports.
- Check the Cable Connection
- Check the Physical Link Status of the Interface
- Check the Interface Statistics in Detail
- Perform the Loopback Diagnostic Test
- Check for Other Possibilities
- Enable a Physical Interface
Check the Cable Connection
Problem
Description
Packets are not received or transmitted over the Ethernet physical interface.
Diagnosis
Is the correct cable connected to the correct port?
Yes: Continue to Check the Physical Link Status of the Interface.
No: See Resolve the Cabling Issue.
Resolution
Resolve the Cabling Issue
Perform one or more of the following steps to resolve the cabling issue:
-
Connect the cable properly on the local and remote ends, without any loose connections.
-
If the existing cable is damaged, replace it with a known good cable.
Connect a single-mode fiber cable to a single-mode interface only and a multimode fiber cable to a multimode interface only. To check fiber optic cable integrity, see Check the Fiber Optic Cable Integrity.
Connect the correct small form-factor pluggable transceiver (SFP) on both sides of the cable.
Check the Fiber Optic Cable Integrity
To check the integrity of the fiber optic cable with an external cable diagnostic testing tool:
A single-mode fiber cable must be connected to a single-mode interface.
A multi-mode fiber cable must be connected to a multi-mode interface.
Measure the received light level at the receiver (RX) port to see whether the received light level is within the receiver specification of the Ethernet interface.
-
Measure the transmitted light level at the transmitter (TX) port to see whether the transmitted light level is within the transmitter specification of the Ethernet interface.
Check the Physical Link Status of the Interface
Problem
Description
Unable to transmit or receive packets on the Ethernet interface even though the cable connection is correct.
Solution
To display the physical link status of the interface, run the show interface
interface-name media
operational mode command. For
example, on the et-5/0/1 interface:
user@host> show interfaces et-5/0/1 media Physical interface: et-5/0/1, Enabled, Physical link is Up Interface index: 317, SNMP ifIndex: 1602 Link-level type: Ethernet, MTU: 1514, Speed: 1000mbps, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online, Speed-negotiation: Disabled, Auto-MDIX: Enabled Device flags : Present Running Interface flags: SNMP-Traps Internal: 0x4000 Link flags : None CoS queues : 8 supported, 8 maximum usable queues Current address: 2c:6b:f5:4c:26:73, Hardware address: 2c:6b:f5:4c:26:73 Last flapped : 2020-11-30 01:25:37 UTC (03:46:55 ago) Input rate : 880 bps (1 pps) Output rate : 312 bps (0 pps) Active alarms : None Active defects : None MAC statistics: Input bytes: 901296, Input packets: 9799, Output bytes: 976587, Output packets: 10451 Filter statistics: Filtered packets: 68, Padded packets: 0, Output packet errors: 0 Autonegotiation information: Negotiation status: Complete Link partner: Link mode: Full-duplex, Flow control: Symmetric/Asymmetric, Remote fault: OK Local resolution: Flow control: Symmetric, Remote fault: Link OK Interface transmit statistics: Disabled
Diagnosis
-
Are there any connectivity problems such as input errors and packet loss even though the
Enabled
field displaysPhysical link is Up
status and theActive alarms and Active defect
field displaysNone
?-
Yes: Go to Check the Interface Statistics in Detail.
-
No: Continue to the next diagnostic test.
-
Does the
Enabled
field displayPhysical link is Down
status and theActive alarms and Active defect
field displayLink
?Yes: The interface is either not connected correctly or is not receiving a valid signal. Go to Resolve the Cabling Issue.
No: Continue.
Check the Interface Statistics in Detail
Problem
Description
The physical interface is not working even
though the Enabled
field displays Physical link is Up
status and the Active alarms and Active defect
field displays None
.
Solution
To display the interface statistics in detail, run the show interface
interface-name extensive
operational command. For example,
on the et-5/0/1 interface:
user@host> show interfaces et-5/0/1 extensive Physical interface: et-5/0/1, Enabled, Physical link is Up Interface index: 317, SNMP ifIndex: 1602, Generation: 322 Link-level type: Ethernet, MTU: 1514, Speed: 1000mbps, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online, Speed-negotiation: Disabled, Auto-MDIX: Enabled Device flags : Present Running Interface flags: SNMP-Traps Internal: 0x4000 Link flags : None CoS queues : 8 supported, 8 maximum usable queues Hold-times : Up 0 ms, Down 0 ms Current address: 2c:6b:f5:4c:26:73, Hardware address: 2c:6b:f5:4c:26:73 Last flapped : 2012-11-30 01:25:37 UTC (04:38:32 ago) Statistics last cleared: Never Traffic statistics: Input bytes : 806283 0 bps Output bytes : 1153215 424 bps Input packets: 10818 0 pps Output packets: 11536 0 pps IPv6 transit statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Label-switched interface (LSI) traffic statistics: Input bytes : 0 0 bps Input packets: 0 0 pps Dropped traffic statistics due to STP State: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Input errors: Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Policed discards: 233060, L3 incompletes: 0, L2 channel errors: 0, L2 mismatch timeouts: 0, FIFO errors: 0, Resource errors: 0 Output errors: Carrier transitions: 11, Errors: 0, Drops: 0, Collisions: 0, Aged packets: 0, FIFO errors: 0, HS link CRC errors: 0, MTU errors: 0, Resource errors: 0 Egress queues: 8 supported, 4 in use Queue counters: Queued packets Transmitted packets Dropped packets 0 best-effort 3216 3216 0 1 expedited-fo 0 0 0 2 assured-forw 0 0 0 3 network-cont 8320 8320 0 Queue number: Mapped forwarding classes 0 best-effort 1 expedited-forwarding 2 assured-forwarding 3 network-control Active alarms : None Active defects : None MAC statistics: Receive Transmit Total octets 1007655 1082219 Total packets 10886 11536 Unicast packets 4350 4184 Broadcast packets 32 77 Multicast packets 6504 7275 CRC/Align errors 0 0 FIFO errors 0 0 MAC control frames 0 0 MAC pause frames 0 0 Oversized frames 0 Jabber frames 0 Fragment frames 0 VLAN tagged frames 0 Code violations 0 Filter statistics: Input packet count 10886 Input packet rejects 68 Input DA rejects 68 Input SA rejects 0 Output packet count 11536 Output packet pad count 0 Output packet error count 0 CAM destination filters: 0, CAM source filters: 0 Autonegotiation information: Negotiation status: Complete Link partner: Link mode: Full-duplex, Flow control: Symmetric/Asymmetric, Remote fault: OK Local resolution: Flow control: Symmetric, Remote fault: Link OK Packet Forwarding Engine configuration: Destination slot: 5 CoS information: Direction : Output CoS transmit queue Bandwidth Buffer Priority Limit % bps % usec 0 best-effort 95 950000000 95 0 low none 3 network-control 5 50000000 5 0 low none Interface transmit statistics: Disabled
Diagnosis
-
Does the
Policed discards
,L2 channel errors
,Input DA rejects
, orInput SA rejects
field display any errors?-
Yes: Resolve the errors as needed. Resolving these errors is beyond the scope of this topic.
-
No: Continue with Perform the Loopback Diagnostic Test.
-
Perform the Loopback Diagnostic Test
Problem
Description
The interface cable is connected correctly, and no alarms or errors are associated with the Ethernet physical interface, but the interface is not working.
Solution
To check whether the Ethernet port or PIC is faulty, you must perform the internal loopback test and hardware loopback test.
To perform an internal loopback diagnostic test on an Ethernet interface, for example on et-5/0/1 interface:
-
In configuration mode, go to the
[edit interfaces et-5/0/1]
hierarchy level.[edit] user@host# edit interface et-5/0/1
-
Set the
ether-options
option as loopback, commit the configuration, and quit configuration mode.[edit interfaces et-5/0/1 user@host# set ether-options loopback user@host# commit user@host# quit
-
In operational mode, execute the
show interfaces et-5/0/1 media
command.user@host> show interfaces et-5/0/1 media Physical interface: et-5/0/1, Enabled, Physical link is Up Interface index: 317, SNMP ifIndex: 1602 Link-level type: Ethernet, MTU: 1514, Speed: 1000mbps, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Enabled, Source filtering: Disabled, Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online, Speed-negotiation: Disabled, Auto-MDIX: Enabled Device flags : Present Running Interface flags: SNMP-Traps Internal: 0x4000 Link flags : None CoS queues : 8 supported, 8 maximum usable queues Current address: 2c:6b:f5:4c:26:73, Hardware address: 2c:6b:f5:4c:26:73 Last flapped : 2012-11-30 01:25:37 UTC (03:46:55 ago) Input rate : 880 bps (1 pps) Output rate : 312 bps (0 pps) Active alarms : None Active defects : None MAC statistics: Input bytes: 901296, Input packets: 9799, Output bytes: 976587, Output packets: 10451 Filter statistics: Filtered packets: 68, Padded packets: 0, Output packet errors: 0 Autonegotiation information: Negotiation status: Complete Link partner: Link mode: Full-duplex, Flow control: Symmetric/Asymmetric, Remote fault: OK Local resolution: Flow control: Symmetric, Remote fault: Link OK Interface transmit statistics: Disabled
Delete the loopback
statement after completing
your diagnosis.
Execute one of the following steps for a hardware loopback diagnostic test, as needed:
For an Ethernet PIC with a fiber optic interface—Physically loop the TX and RX port and check the status of the physical link with the
show interfaces interface-name media
operational mode command.For an Ethernet PIC with an RJ-45 Ethernet interface—Build a loopback plug by crossing pin 1 (TX +) to pin 3 (RX +) together and pin 2 (TX -) and pin 6 (RX -) together. Then, check the status of the physical link with the
show interfaces interface-name media
operational mode command.
Diagnosis
-
Does the
Enabled
field displayPhysical link is Up
status and theActive alarms and Active defect
field displayNone
when you perform the loopback test?-
Yes: Go to the Check for Other Possibilities section.
-
No: Continue to the next diagnostic test.
-
-
When the Ethernet interface is connected to a remote Ethernet device over multiple patch panels, check to see whether the connection can be looped back at the different patch panels so you can conduct a loopback diagnostic test. Is the loopback diagnostic test successful?
-
Yes: Go to the Check for Other Possibilities section.
-
No: Contact Juniper Networks Technical Assistance Center (JTAC) for further assistance.
-
Check for Other Possibilities
Problem
Description
Loopback diagnostic test is successful but unable to transmit and receive packets on the Ethernet interface.
Solution
Use the following commands as needed to troubleshoot an Ethernet interface such as an et-5/0/1 interface:
Run the
show interfaces interface-name terse
operational command to check if the physical interface and logical interfaces are administratively disabled. For example, on an et-5/0/1 interface:user@host> show interfaces et-5/0/1 terse Interface Admin Link Proto Local Remote et-5/0/1 up up et-5/0/1.0 up up inet 20.1.1.2/24
Diagnosis
-
Does the physical interface and its corresponding logical interfaces display
down
in the output of theshow interfaces interface-name terse
operational mode command?-
Yes: Enable the interfaces as shown in Enable a Physical Interface.
-
No: Continue to the next diagnostic test.
-
-
Are the
speed
,duplex
, andauto-negotiation
fields in the output ofshow interfaces interface-name extensive
operational mode command set correctly for the interface?Note:Check if the associated device supports speed and auto-negotiation settings for Flexible PIC Concentrator (FPC).
-
Yes: Check Ethernet Interfaces User Guide for Routing Devices for more troubleshooting tips.
-
No: Contact JTAC for further assistance.
-
Enable a Physical Interface
To enable a physical interface: