Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

 
ON THIS PAGE
 

Configuring 10-Gigabit Ethernet PICs

You can learn about the 10-Gigabit Ethernet PICs in this topic. You can configure LAN and WAN framing, modes of operation, and alarm generation when link is down.

10-port 10-Gigabit Ethernet LAN/WAN PIC Overview

This section describes the main features and caveats of the 10-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (model number PD-5-10XGE-SFPP) and specifies which routers support this PIC.

The 10–port 10-Gigabit Ethernet LAN/WAN PIC (PD-5-10XGE-SFPP) is supported on Juniper Networks T640 Core Routers, T1600 Core Routers, and T4000 Core Routers. It has the following features:

  • Access to all 10-Gigabit Ethernet port counters through SNMP

  • Intelligent handling of oversubscribed traffic in applications such as data centers and dense-core uplinks

  • Line-rate operation for five 10-Gigabit Ethernet ports from each port group, or a total WAN bandwidth of 100 Gbps with Packet Forwarding Engine bandwidth of 50 Gbps

  • Flexible encapsulation, source address and destination address media access control (MAC) filtering, source address MAC learning, MAC accounting, and MAC policing

  • Interface encapsulations, such as the following:

    • ethernet-ccc—Ethernet cross-connect

    • vlan-ccc—802.1Q tagging for a cross-connect

    • ethernet-tcc—Ethernet translational cross-connect

    • vlan-tcc—Virtual LAN (VLAN) translational cross-connect

    • extended-vlan-ccc—Standard Tag Protocol Identifier (TPID) tagging for a cross-connect

    • ethernet-vpls—Ethernet virtual private LAN service

    • vlan-vpls—VLAN virtual private LAN service

    • flexible-ethernet-services—Allows per-unit Ethernet encapsulation configuration

  • WAN PHY features, such as the following:

    • WAN PHY mode on a per-port basis

    • Insertion and detection of path trace messages

    • Ethernet WAN Interface Sublayer (WIS) object

    Note:

    The T4000 Core Router supports only LAN PHY mode in Junos OS Release 12.1R1. Starting with Junos OS Release 12.1R2, WAN PHY mode is supported on the T4000 routers with the 12-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-12XGE-SFPP). Starting with Junos OS Release 12.2, WAN PHY mode is supported on the T4000 routers with the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-24XGE-SFPP).

  • Single, stacked, and flexible VLAN tagging modes

  • Native VLAN configuration to allow untagged frames to be received on the tagged interfaces

  • Maximum transmission unit (MTU) size of up to 9192 bytes for Ethernet frames

  • Link aggregation group (LAG) on single chassis

  • Interoperability with other 10-Gigabit Ethernet PICs in M Series and T Series routers in the LAN PHY and WAN PHY modes

  • Interrupt-driven link-down detection mechanism

  • Two-to-one oversubscription of traffic across a port group

    Traffic from 10 ingress ports to the Packet Forwarding Engine traffic is statically mapped to one of the 5 egress ports. 10 Gbps of bandwidth toward the Packet Forwarding Engine is shared by two ingress ports (called a port group), thereby achieving two-to-one oversubscription. This scheme provides two-to-one oversubscription across a port group and not across the entire PIC.

  • Four queues per physical interface on ingress and eight queues per physical interface on egress

  • A separate control queue per physical interface to ensure that the control packets are not dropped during oversubscribed traffic. The control queue can be disabled in the CLI.

  • Optical diagnostics

  • Behavior aggregate (BA) classification (IPv4 DSCP, IPv6 DSCP, Inet precedence, IEEE 802.1P, IEEE 802.1AD, MPLS EXP) and fixed classification

  • Weighted round-robin scheduling with two queue priorities (low and strict-high)

  • Committed information rate and peak information rate shaping on a per-queue basis

  • Excess information rate configuration for allocation of excess bandwidth

  • IEEE 802.3ah Operation, Administration, and Maintenance (OAM)-related operations, such as the following:

    • Link fault management

    • Link discovery

    • Graceful Routing Engine Switchover

  • IEEE 802.3ag Operation, Administration, and Maintenance (OAM)-related operations, such as the following:

    • Connectivity fault management (CFM)

    • Linktrace

    • Loopback

    • Graceful Routing Engine switchover (GRES)

The 10-port 10-Gigabit Ethernet LAN/WAN PIC has the following caveats:

  • Source address and destination address MAC filtering takes place after oversubscription is handled.

  • Oversubscription on the PIC operates across a port group of two ports and not at the PIC level.

  • Queuing is not supported at the logical interface level.

  • Committed information rate and peak information rate configurations are not supported at the physical interface level.

  • There is limited packet buffering of 2 MB.

  • Delay-bandwidth buffering configuration is not supported.

  • Multifield classifiers are not supported at the PIC level.

    The multifield classification can be done at the Packet Forwarding Engine using the firewall filters, which overrides the classification done at the PIC level. The multifield classification at the Packet Forwarding Engine occurs after the PIC handles the oversubscribed traffic.

  • Egress MAC policer statistics not supported.

  • Byte counters are not supported at the queue level.

  • Only TPID (0x8100) is supported.

  • Line-timing mode is not supported.

  • MAC-level Rx VLAN tagged frames counter is not supported.

  • OAM unified in-service software upgrade (unified ISSU) is not supported.

  • OAM remote loopback is not supported.

The 10-port 10-Gigabit Ethernet LAN/WAN PIC (PD-5-10XGE-SFPP) supports link aggregation. For bandwidth aggregation, load sharing, and link protection, LAG can be enabled. Once aggregated Ethernet is enabled, Link Aggregation Control Protocol (LACP) forms an aggregated bundle of member links.

Only features that are supported across all of the linked devices will be supported in the resulting LAG bundle. The following caveats apply to LAG bundles that involve 10-port 10-Gigabit Ethernet LAN/WAN PIC (PD-5-10XGE-SFPP) ports:

  • Non-standard TPID for VLAN tagging is not supported, except for 0x8100.

  • The number of user created IFLs is limited to 4065/PIC and 1022/port.

  • Classifier tables are limited to 8 for each BA classifier type.

  • Forwarding classes are limited to 8.

  • The guaranteed-rate and shaping-rate statements are not supported at the IFD level.

  • The per-unit-scheduler and hierarchical-scheduler statements are not supported.

  • Only the strict-high and low levels of scheduling priorities are supported.

  • The excess-priority configuration is not supported.

  • The buffer-size configuration under schedulers is not supported.

  • WRED is not supported.

  • srTCM and trTCM are not supported.

  • Shared scheduler mode is not supported.

Table 1 10-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PD-5-10XGE-SFPP).

Table 1: Capabilities of 10-Gigabit Ethernet LAN/WAN PICs

Capability

Support

Maximum VLANs per PIC

4065

Maximum VLANs per port

1022

MAC learning per port

960

MAC accounting per port

960

MAC filtering per port

960 (64 filters per physical or logical interface)

960 filters across multiple logical interfaces

MAC policers

128 ingress Mac policers

128 egress Mac policers

Classifers

Eight classifiers per PIC for each BA classifier type

See Also

12-port 10-Gigabit Ethernet LAN/WAN PIC on Type 5 FPC Overview

The 10-Gigabit Ethernet LAN/WAN PIC on Type 5 FPC is a 12-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (model number, PF-12XGE-SFPP) on T4000 Core Routers.

The following features are supported on the 10-Gigabit Ethernet LAN/WAN PIC on Type 5 FPC:

  • Access to all 10-Gigabit Ethernet port counters through SNMP.

  • Logical interface–level MAC filtering, accounting, policing, and learning for source media access control (MAC).

  • Flexible encapsulation.

  • Single, stacked, and flexible VLAN tagging modes.

  • Native VLAN configuration to allow untagged frames to be received on the tagged interfaces.

  • Maximum transmission unit (MTU) size of up to 9192 bytes for Ethernet frames.

  • Link aggregation group (LAG) on single chassis.

  • Interoperability with other 10-Gigabit Ethernet PICs on M Series and T Series routers in LAN PHY mode.

  • Eight queues per physical interface on egress.

  • Behavior aggregate (BA) classification (IPv4 DSCP, IPv6 DSCP, Inet precedence, IEEE 802.1P, IEEE 802.1AD, MPLS EXP) and fixed classification.

  • Defining the VLAN rewrite operation to be applied to the incoming and outgoing frames on logical interfaces on this PIC.

    Note:

    Only the Tag Protocol Identifier (TPID) 0x8100 is supported.

  • Interface encapsulations, such as the following:

    • untagged—Default encapsulation, when other encapsulation is not configured.

      • You can configure only one logical interface (unit 0) on the port.

      • You cannot include the vlan-id statement in the configuration of the logical interface.

    • vlan-tagging—Enable VLAN tagging for all logical interfaces on the physical interface.

    • stacked-vlan-tagging—Enable stacked VLAN tagging for all logical interfaces on the physical interface.

    • ethernet-ccc—Ethernet cross-connect.

    • ethernet-tcc—Ethernet translational cross-connect.

    • vlan-ccc—802.1Q tagging for a cross-connect.

    • vlan-tcc—Virtual LAN (VLAN) translational cross-connect.

    • extended-vlan-ccc—Standard Tag Protocol Identifier (TPID) tagging for a cross-connect.

    • extended-vlan-tcc—Standard Tag Protocol Identifier (TPID) tagging for an Ethernet translational cross-connect.

    • ethernet-vpls—Ethernet virtual private LAN service.

    • vlan-vpls—VLAN virtual private LAN service.

    • flexible-ethernet-services—Allows per-unit Ethernet encapsulation configuration.

  • The following Layer 3 protocols are also supported:

    • IPv4

    • IPv6

    • MPLS

  • WAN PHY features, such as the following:

    • WAN PHY mode on a per-port basis.

    • Insertion and detection of path trace messages.

    • Ethernet WAN Interface Sublayer (WIS) object.

    Note:

    The T4000 Core Router supports only LAN PHY mode in Junos OS Release 12.1R1. Starting with Junos OS Release 12.1R2, WAN PHY mode is supported on T4000 routers with 12-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+.

The 10-Gigabit Ethernet LAN/WAN PIC on Type 5 FPC does not support:

  • MAC filtering, accounting, and policing for destination MAC at the logical interface level.

    Note:

    Because destination MAC filtering is not supported, the hardware is configured to accept all the multicast packets. This enables the OSPF protocol to work.

  • Premium MAC policers at the logical interface level.

  • MAC filtering, accounting, and policing at the physical interface level.

  • Multiple TPIDs

Capability

Support

Maximum logical interfaces per PIC

32,000

Maximum logical interfaces per port

For IPv4 the limit is 4093.

For IPv6 the limit is 1022.

Classifers

Eight classifiers per PIC for each BA classifier type

See Also

24-port 10-Gigabit Ethernet LAN/WAN PIC on Type 5 FPC Overview

This section describes the main features and caveats of the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (model number PF-24XGE-SFPP).

The following major software features are supported on the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (model number PF-24XGE-SFPP):

  • Twenty-four 10-Gigabit Ethernet interfaces in two-to-one oversubscription of traffic in oversubscribed mode or 12 ports in line-rate mode. For more information about oversubscribed mode and line-rate mode, see the Configuring Line-Rate Mode on PICs Supporting Oversubscription.

  • Traffic is classified as control traffic or best-effort traffic with non-class-of-service-aware tail drops of best-effort traffic in oversubscribed mode.

    The aggregate bandwidth of all the ports together is 120 Gbps. No hard partitioning of bandwidth is done—that is, if one port group is active, it can support 120 Gbps traffic. The bandwidth for best-effort traffic is shared among all the 24 ports.

    Note that the preclassification is restricted to two traffic classes, and is not user-configurable.

  • All Junos OS configuration commands supported on the existing 10-Gigabit Ethernet LAN/WAN PIC with SFP+.

  • The output of the show interfaces extensive operational mode command now displays preclassification queue counters.

  • Line-rate mode operation of the first 12 ports can be achieved by using the [set chassis fpc fpc-number pic pic-number linerate-mode] command. By default, the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ works in oversubscribed mode.

  • LAN PHY mode and WAN PHY mode on a per-port basis. WAN PHY mode can be achieved by using the [set interfaces interface-name framing wan-phy] command.

  • WAN PHY features, such as the following:

    • Insertion and detection of path trace messages.

    • Ethernet WAN Interface Sublayer (WIS) object.

  • Aggregated Ethernet is supported only in line-rate mode.

  • Link aggregation group (LAG) is supported only in line-rate mode.

  • 4000 logical interfaces per physical interface and 32,000 logical interfaces per chassis.

  • Access to all 10-Gigabit Ethernet port counters through SNMP.

Note:

Graceful Routing Engine switchover (GRES) and nonstop active routing (NSR) are now supported on T4000 routers.

See Also

P2-10G-40G-QSFPP PIC Overview

Starting with Junos OS Release 14.1R2 and 14.2R1, the PTX5000 Packet Transport Router supports the P2-10G-40G-QSFPP PIC on the FPC2-PTX-P1A FPC.

All the ports on the P2-10G-40G-QSFPP PIC are plugged into quad small form-factor pluggable plus transceivers (QSFP+) that, in turn, are connected to fiber-optic cables that support both 10-Gigabit Ethernet standards and 40-Gigabit Ethernet standards, thereby enabling you to configure the PIC to operate either in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode.

Starting from Junos OS Release 14.2R3 and 16.1R1, you can configure the ports on the PIC in 10-Gigabit Ethernet mode or 40-Gigabit Ethernet mode at the port group level.

The following sections describe the P2-10G-40G-QSFPP PIC and the various framing modes that are supported on it:

Understanding Dual Configuration on P2-10G-40G-QSFPP PIC

All the ports on the P2-10G-40G-QSFPP PIC are QSFP+ based—that is, all the ports are connected to fiber-optic cables by means of QSFP+ transceivers.

The QSFP+ module—which includes the transceiver and the fiber-optic cable—supports the following standards on the P2-10G-40G-QSFPP PIC:

  • 10-Gigabit Ethernet in LAN PHY framing mode (also known as native Ethernet mode) and WAN PHY framing mode.

    Note that the ports follow a 4-level interface-naming convention—et-fpc/pic/QSFP+ port:channel in this mode.

  • 40-Gigabit Ethernet in LAN PHY framing mode.

    Note that the ports follow a 3-level interface-naming convention—et-fpc/pic/QSFP+ port in this mode.

Note:

The P2-10G-40G-QSFPP PIC provides forty-eight 10-Gigabit Ethernet ports or twelve 40-Gigabit Ethernet ports. or .

The PIC can be configured either in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode with the set chassis fpc fpc-number pic pic-number pic-mode (10G | 40G) configuration command. By default, the PIC is configured in 10-Gigabit Ethernet LAN PHY framing mode.

Note:

If you want configure the PIC in 10-Gigabit Ethernet mode to operate in 40-Gigabit Ethernet mode, you must:

  1. Delete all the interfaces in the PIC at the [edit interfaces] hierarchy level.

  2. Configure the PIC to operate in 40-Gigabit Ethernet mode by using the set chassis fpc fpc-slot pic pic-slot pic-mode 40G configuration command and commit.

The PIC reboots and starts operating in the new mode.

The same procedure is applicable when you can configure the PIC in 40-Gigabit Ethernet PIC to operate in 10-Gigabit Ethernet mode. In this case, you must execute the set chassis fpc fpc-slot pic pic-slot pic-mode 10G configuration mode command.

To check the current diagnostics of the PIC, you must run the relevant operational mode CLI commands such as show chassis hardware, show interfaces diagnostics optics interface-name,

Understanding Port Group

The FPC2-PTX-P1A FPC on PTX5000 routers can host two PICs and has eight Packet Forwarding Engines. The first four Packet Forwarding Engines on the FPC are associated with PIC 0 and the next four are associated with PIC 1.

All ports associated to one Packet Forwarding Engine compose a port group. Each PIC supports four Packet Forwarding Engines. Therefore, four port groups exist for each P2-10G-40G-QSFPP PIC.

Each Packet Forwarding Engine providesthroughput of 120 Gbps.

Points to Remember

Consider the following points when configuring the PIC at the port group level:

  • You can configure the ports in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode at the port group level.

  • You can configure the port speed only on the first port in the port group. That is, you must configure the port speed for the port group on the ports numbered 0, 3, 6, and 9—the first ports in the respective port groups. An error message is logged when you try to configure the speed on any other port in the port group and this configuration will not have any effect on the PIC.

  • You can configure the port speed of a port group only when the value of the pic-mode statement at the [edit chassis fpc fpc-slot pic pic-slot pic-mode] is set to 10G or when the statement is not configured.

  • You cannot configure different speeds for the ports in the same port group.

  • You can configure different speeds for different port groups.

Port Group in 10-Gigabit Ethernet Mode

Each Packet Forwarding Engine supports twelve 10-Gigabit Ethernet ports in LAN PHY or in WAN PHY framing mode.

Note that when a port group is configured from 10-Gigabit Ethernet mode to 40-Gigabit Ethernet mode, the ports with 4-level interface-naming convention are deleted and three 40-Gigabit Ethernet mode ports with 3-level interface-naming convention are created.

Note that when the configuration of a port group is changed from 10-Gigabit Ethernet mode to 40-Gigabit Ethernet mode, the configuration of the twelve 10-Gigabit Ethernet ports is deleted and the 4-level interface-naming convention of the ports is also lost. Instead, three 40-Gigabit Ethernet ports are configured and these ports adhere to the 3-level interface-naming convention

Port Group in 40-Gigabit Ethernet Mode

Each Packet Forwarding Engine supports three 40-Gigabit Ethernet ports in LAN PHY framing mode.

Note that when the configuration of a port group is changed from 40-Gigabit Ethernet mode to 10-Gigabit Ethernet mode, the configuration of the three 40-Gigabit Ethernet ports is deleted and the 3-level interface-naming convention of the ports is also lost. Instead, twelve 10-Gigabit Ethernet ports are configured and these ports adhere to the 4-level interface-naming convention.

Port Number Mapping When Port Groups Are Configured

Table 2shows the port numbering in 40-Gigabit Ethernet mode and in 10-Gigabit Ethernet mode at the port group level.

Table 2: Port Number Mapping When Port Groups Are Configured

QSFP+ Port Number

Port Numbering in 40-Gigabit Ethernet Mode

Port Numbering in 10-Gigabit Ethernet Mode

0 (0)

et-1/1/0

et-1/1/0:0

et-1/1/0:1

et-1/1/0:2

et-1/1/0:3

et-1/1/1

et-1/1/1:0

et-1/1/1:1

et-1/1/1:2

et-1/1/1:3

et-1/1/2

et-1/1/2:0

et-1/1/2:1

et-1/1/2:2

et-1/1/2:3

3(1)

et-1/1/3

et-1/1/3:0

et-1/1/3:1

et-1/1/3:2

et-1/1/3:3

et-1/1/4

et-1/1/4:0

et-1/1/4:1

et-1/1/4:2

et-1/1/4:3

et-1/1/5

et-1/1/5:0

et-1/1/5:1

et-1/1/5:2

et-1/1/5:3

6(2)

et-1/1/6

et-1/1/6:0

et-1/1/6:1

et-1/1/6:2

et-1/1/6:3

et-1/1/7

et-1/1/7:0

et-1/1/7:1

et-1/1/7:2

et-1/1/7:3

et-1/1/8

et-1/1/8:0

et-1/1/8:1

et-1/1/8:2

et-1/1/8:3

6(2)

et-1/1/6

et-1/1/6:0

et-1/1/6:1

et-1/1/6:2

et-1/1/6:3

et-1/1/7

et-1/1/7:0

et-1/1/7:1

et-1/1/7:2

et-1/1/7:3

et-1/1/8

et-1/1/8:0

et-1/1/8:1

et-1/1/8:2

et-1/1/8:3

9(3)

et-1/1/9

et-1/1/9:0

et-1/1/9:1

et-1/1/9:2

et-1/1/9:3

et-1/1/10

et-1/1/10:0

et-1/1/10:1

et-1/1/10:2

et-1/1/10:3

et-1/1/11

et-1/1/11:0

et-1/1/11:1

et-1/1/11:2

et-1/1/11:3

Port Numbering on P2-10G-40G-QSFPP PIC When Port Groups Are Not Configured

Table 3 shows the port numbering in 40-Gigabit Ethernet mode and in 10-Gigabit Ethernet mode when port groups are not configured on the P2-10G-40G-QSFPP PIC.

Table 3: Port Number Mapping When Port Groups Are Not Configured

QSFP+ Port Number

Port Numbering in 40-Gigabit Ethernet Mode

Port Numbering in 10-Gigabit Ethernet Mode

0

et-1/1/0

et-1/1/0:0

et-1/1/0:1

et-1/1/0:2

et-1/1/0:3

1

et-1/1/1

et-1/1/1:0

et-1/1/1:1

et-1/1/1:2

et-1/1/1:3

2

et-1/1/2

et-1/1/2:0

et-1/1/2:1

et-1/1/2:2

et-1/1/2:3

3

et-1/1/3

et-1/1/3:0

et-1/1/3:1

et-1/1/3:2

et-1/1/3:3

4

et-1/1/4

et-1/1/4:0

et-1/1/4:1

et-1/1/4:2

et-1/1/4:3

5

et-1/1/5

et-1/1/5:0

et-1/1/5:1

et-1/1/5:2

et-1/1/5:3

6

et-1/1/6

et-1/1/6:0

et-1/1/6:1

et-1/1/6:2

et-1/1/6:3

7

et-1/1/7

et-1/1/7:0

et-1/1/7:1

et-1/1/7:2

et-1/1/7:3

8

et-1/1/8

et-1/1/8:0

et-1/1/8:1

et-1/1/8:2

et-1/1/8:3

9

et-1/1/9

et-1/1/9:0

et-1/1/9:1

et-1/1/9:2

et-1/1/9:3

10

et-1/1/10

et-1/1/10:0

et-1/1/10:1

et-1/1/10:2

et-1/1/10:3

11

et-1/1/11

et-1/1/11:0

et-1/1/11:1

et-1/1/11:2

et-1/1/11:3

10-Gigabit Ethernet Mode

A 10-Gigabit Ethernet interface can operate in 10-Gigabit Ethernet LAN PHY framing mode or in 10-Gigabit Ethernet WAN PHY framing mode.

You can configure a 10-Gigabit Ethernet interface at the [edit interface interface-name framing-mode (lan-phy | wan-phy)] hierarchy level to operate in 10-Gigabit Ethernet LAN PHY framing mode or in 10-Gigabit Ethernet WAN PHY framing mode.

Each P2-10G-40G-QSFPP PIC provides 48 physical interfaces. The interfaces are represented by the 4-level interface-naming convention—et-fpc/pic/QSFP+ port:channel, where the value of the QSFP+ port option ranges from 0 through 11 and the value of the channel option ranges from 0 through 3.

Framing Mode Overview

When a P2-10G-40G-QSFPP PIC is configured in 10-Gigabit Ethernet framing mode, it can operate in one of the following framing modes:

  • LAN PHY framing mode. Note that by default, the PIC is in 10-Gigabit Ethernet LAN PHY framing mode. You can configure loopback at the [edit interfaces interface-name sonet-options loopback] hierarchy level.

    Note:

    The ports are set to LAN PHY framing mode by default when the framing-mode statement is not configured at the [edit interface interface-name] hierarchy level.

  • WAN PHY framing mode

Supported Features on LAN PHY and WAN PHY Framing Mode

The following features are supported in LAN PHY and WAN PHY framing mode when the PIC operates in 10-Gigabit Ethernet mode:

  • The following are supported for WAN interface sublayer statistics, defects, and alarms when the PIC operates in WAN PHY framing mode:

    • GR 253 standard.

    • show interfaces interfaces-name operational mode command displays WAN interface sublayer statistics, defects and alarms.

    • Interrupt-driven notification for WAN interface sublayer defects.

    • Path trace and trigger options for WAN interface sublayer alarms.

    • Transmitting and receiving J1 (path trace) messages—J1 is a part of path overhead in a WAN interface sublayer frame.

  • Line loopback and local loopback. Loopback is configured at the [edit interfaces interface-name sonet-options loopback] hierarchy level in WAN PHY framing mode.

  • The defects PHY LOL (loss of light) and PHY PLL (loss of PLL lock) are detected and reported at the physical level in WAN PHY framing mode.

Fast reroute (FRR) in WAN PHY framing mode:

  • Enable or disable preemptive fast reroute (FRR) options at the [edit interfaces interface-name otn-options preemptive-fast-reroute] hierarchy level.

  • Configure thresholds and interval for the optical channel data unit (ODU) signal degradation (odu-signal-degrade) and the configurable pre-FEC bit error rate (BER) (ber-threshold-signal-degrade) at the [edit interfaces interface-name otn-options odu-signal-degrade] hierarchy level and the [edit interfaces interface-name otn-options signal-degrade] hierarchy level, respectively.

40-Gigabit Ethernet Mode

You can configure twelve 40-Gigabit Ethernet interfaces that operate in LAN PHY framing mode. The interfaces are represented by the 3-level interface-naming convention et-fpc/pic/QSFP+ port, where the value of the QSFP+ port variable ranges from 0 through 11.

See Also

Configuring the P2-10G-40G-QSFPP PIC

Starting with Junos OS Release 14.1R2, PTX5000 supports the P2-10G-40G-QSFPP PIC on the FPC2-PTX-P1A FPC. You can configure the P2-10G-40G-QSFPP PIC to operate either in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode..

The following tasks explain how to configure the P2-10G-40G-QSFPP PIC in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode and to configure the framing modes on it.

Configuring the PIC in 10-Gigabit Ethernet Mode or in 40-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode:

  1. In configuration mode, go to the [edit chassis] hierarchy level.
  2. Configure the PIC in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode after specifying the required FPC slot and PIC slot. Note that all the PIC ports in a PIC are configured at once with this configuration command.

Configuring the PIC in 10-Gigabit Ethernet Mode to Operate in 40-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC that is configured in 10-Gigabit Ethernet mode to operate in 40-Gigabit Ethernet mode:

  1. In configuration mode, go to the [edit interfaces] hierarchy level.
  2. Delete all the interfaces in the PIC, commit, and then move to the top of the hierarchy level.
  3. Configure the PIC to operate in 40-Gigabit Ethernet mode and commit.

After the configuration is committed, the PIC reboots and starts operating in the 40-Gigabit Ethernet mode. You can now configure the parameters, such as encapsulation, framing mode, and so on, for the twelve 40-Gigabit Ethernet interfaces in the PIC as needed.

Configuring the PIC in 40-Gigabit Ethernet Mode to Operate in 10-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC that is configured in 40-Gigabit Ethernet mode to operate in 10-Gigabit Ethernet mode:

  1. In configuration mode, go to the [edit interfaces interfaces-name] hierarchy level.
  2. Delete all the interfaces in the PIC, commit, and then move to the top of the hierarchy level.
  3. Configure the PIC to operate in 10-Gigabit Ethernet mode and commit.

After the configuration is committed, the PIC reboots and starts operating in the 10-Gigabit Ethernet mode. You can now configure the parameters, such as encapsulation, framing mode, and so on, for the forty-eight 10-Gigabit Ethernet interfaces in the PIC as needed.

Configuring the PIC at Port Group Level

Before You Begin

Verify that the pic-mode statement at the [edit chassis fpc fpc-slot pic pic-slot pic-mode] is not configured or that its value is set to 10G.

To configure a port group in the P2-10G-40G-QSFPP PIC to operate in 10-Gigabit Ethernet mode or 40-Gigabit Ethernet mode:

  1. In configuration mode, go to the [edit chassis fpc fpc-slot pic pic-slot] hierarchy level.
  2. Configure the port number as 0, 3, 6, or 9 and the speed as 10G or 40G. Note that you can configure the port speed only on the first port in the port group. That is, configure the port speed only on the ports numbered 0, 3, 6, and 9. An error message is displayed when you try to configure the speed on any other port in the port group.
Note:

A system log message is logged when you try to configure a different port speed on a port when the port group is operating at another speed.

Configuring Framing Mode on P2-10G-40G-QSFPP PIC

You can configure LAN PHY, or WAN PHY framing mode when the PIC is operating in 10-Gigabit Ethernet mode. You can configure LAN PHY framing mode when the PIC is operating in 40-Gigabit Etherent mode. The following tasks explain how to configure the various framing modes on the PIC:

Configuring LAN PHY or WAN PHY Framing Mode in 10-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC in 10-Gigabit Ethernet mode to operate in LAN PHY framing mode or in WAN PHY framing mode, you must configure the framing mode individually on all the interfaces:

  1. In configuration mode, go to the [edit interfaces interfaces-name] hierarchy level, where the interface name is in et-fpc/pic/port:channel format.
  2. Configure the framing mode as LAN PHY or WAN PHY and commit.

    For example, you can configure the framing mode as LAN PHY or WAN PHY on the et-1/1/1:0 interface.

Configuring LAN PHY Framing Mode in 40-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC in 40-Gigabit Ethernet mode to operate in LAN PHY framing mode:

  1. In configuration mode, go to the [edit interfaces interfaces-name] hierarchy level, where the interface name is in et-fpc/pic/port format.
  2. Configure the framing mode as LAN PHY and commit.

    For example, you can configure the framing mode as LAN PHY on the et-2/2/2 interface.

See Also

Example: Configuring the P2-10G-40G-QSFPP PIC

Requirements

This example uses the following hardware and software components:

  • Junos OS Release 14.1R2 or Junos OS Release 14.2 or later

  • One PTX5000 router with P2-10G-40G-QSFPP PIC

Overview

Starting with Junos OS Release 14.1R2 and 14.2R1, PTX5000 supports the P2-10G-40G-QSFPP PIC on the FPC2-PTX-P1A FPC.

All the ports on the P2-10G-40G-QSFPP PIC are QSFP+ based—that is, all the ports are connected to fiber-optic cables by means of QSFP+ transceivers. The P2-10G-40G-QSFPP PIC provides forty-eight 10-Gigabit Ethernet ports or twelve 40-Gigabit Ethernet ports.

The QSFP+ module—which includes the transceiver and the fiber-optic cable—supports the following standards on the P2-10G-40G-QSFPP PIC:

  • 10-Gigabit Ethernet in LAN PHY framing mode (also known as native Ethernet mode) and WAN PHY framing mode.

  • 40-Gigabit Ethernet in LAN PHY framing mode.

Configuration

To configure the P2-10G-40G-QSFPP PIC to operate in 10-Gigabit Ethernet mode, and to set the framing mode and other options on an interface on this PIC, perform the following tasks:

Configuring the P2-10G-40G-QSFPP PIC in 10-Gigabit Ethernet Mode

Step-by-Step Procedure

Configure the PIC in 10-Gigabit Ethernet mode.

  1. In configuration mode, go to the [edit chassis] hierarchy level.

  2. Configure the PIC in 10-Gigabit Ethernet mode after specifying the required FPC slot and PIC slot. Note that the PIC restarts after the configuration is committed and all the ports in the PIC come up in the 10-Gigabit Ethernet mode.

Configuring the Framing Mode on an Interface

Step-by-Step Procedure

To configure an interface et-1/1/1:0 in the P2-10G-40G-QSFPP PIC to operate in LAN PHY framing mode:

  1. In configuration mode, go to the [edit interfaces et-1/1/1:0] hierarchy level.

  2. Configure the framing mode for the interface as LAN PHY and commit.

    Similarly, you can configure LAN PHY or WAN PHY framing mode for the other interfaces in the PIC.

Configuring the Interface Options

Step-by-Step Procedure

Configure the interface options for the interface et-1/1/1:0 as needed. The following procedure configures a few interface-specific options.

  1. In configuration mode, go to the [edit interfaces et-1/1/1:0] hierarchy level.

  2. Configure the encapsulation as ethernet-ccc.

  3. Configure the family as CCC for the logical interface 0.

  4. Enable flow control to regulate the flow of packets from the router to the remote side of the network connection.

  5. Enable loopback mode for the interface, commit the configuration, and exit the configuration mode.

Verification

Displaying Interface Details
Purpose

To display interface-specific details of the et-1/1/1:0 interface.

Action

Execute the show interfaces et-1/1/1:0 operational command.

Meaning

The interface details are displayed. Note that to display information for an interface in 10-Gigabit Ethernet mode for the P2-10G-40G-QSFPP PIC, you must use the et-fpc/pic/port:channel format.

See Also

Framing Overview

The 10-Gigabit Ethernet interfaces support operation in two modes:

  • 10GBASE-R, LAN Physical Layer Device (LAN PHY)

  • 10GBASE-W, WAN Physical Layer Device (WAN PHY)

When the external interface is running in LAN PHY mode, it bypasses the WIS sublayer to directly stream block-encoded Ethernet frames on a 10-Gigabit Ethernet serial interface. When the external interface is running in WAN PHY mode, it uses the WIS sublayer to transport 10-Gigabit Ethernet frames in an OC192c SONET payload.

WAN PHY mode is supported on MX240, MX480, MX960, T640, T1600, T4000 and PTX Series Packet Transport routers only.

Note:

The T4000 Core Router supports only LAN PHY mode in Junos OS Release 12.1R1. Starting with Junos OS Release 12.1R2, WAN PHY mode is supported on the T4000 routers with the 12-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-12XGE-SFPP). Starting with Junos OS Release 12.2, WAN PHY mode is supported on the T4000 routers with the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-24XGE-SFPP).

Although the external interface provides a lower throughput when running in WAN PHY mode because of the extra SONET overhead, it can interoperate with SONET section or line level repeaters. This creates an advantage when the interface is used for long-distance, point-to-point 10-Gigabit Ethernet links. When the external interface is running in WAN PHY mode, some SONET options are supported. For information about SONET options supported on this interface, see Configuring SONET Options for 10-Gigabit Ethernet Interfaces.

Note:

SONET or SDH framing mode configuration framing (sdh | sonet) is not applicable on the 10-Gigabit Ethernet ports. Configuring the wan-phy framing mode on the 10-Gigabit Ethernet ports allows the interface to accept SONET or SDH frames without further configuration.

See Also

Understanding WAN Framing

If you use the wan-phy statement option at the [edit interfaces xe-fpc/pic/0 framing] hierarchy level to configure Trio WAN mode framing for 10-Gigabit Ethernet interfaces, then the alarm behavior of the link, although in full compliance with the IEEE 802.3ae 10-Gigabit Ethernet standard, might not be as expected.

In particular:

  • The interface does not distinguish between loss of light (LOL), loss of phase lock loop (PLL), or loss of signal (LOS). If a loss of PLL or LOS alarm occurs, then both PLL and LOS alarms are raised. LOL is also raised because there is no separate LOL indication from the hardware.

  • The interface does not raise LOS, PLL, or LOL alarms when the fiber in disconnected from the interface port. You must remove the hardware to raise this alarm.

  • The interface line-level alarm indicator signal (AIS-L) is not always raised in response to a loss of framing (LOF) defect alarm.

  • If the AIS-L or path-level AIS (AIS-P) occurs, the interface path-level loss of code delineation (LCD-P) is not detected. LCD-P is seen during the path-level remote defect indicator (RDI-P) alarm.

  • If an AIS-L alarm occurs, the AIS-P is not detected, but the LOP alarm is detected.

None of the alarm issues are misleading, but they make troubleshooting the root cause of problems more complex.

See Also

Configuring Ethernet Framing

The 10-Gigabit Ethernet interfaces uses the interface type xe-fpc/pic/port. On single port devices, the port number is always zero.

The xe-fpc/pic/port interface inherits all the configuration commands that are used for gigabit Ethernet (ge-fpc/pic/port) interfaces.

To configure LAN PHY or WAN PHY operating mode, include the framing statement with the lan-phy or wan-phy option at the [edit interfaces xe-fpc /pic/0 ] hierarchy level.

Note:

  • The T4000 Core Router supports only LAN PHY mode in Junos OS Release 12.1R1. Starting with Junos OS Release 12.1R2, WAN PHY mode is supported on the T4000 routers with the 12-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-12XGE-SFPP). Starting with Junos OS Release 12.2, WAN PHY mode is supported on the T4000 routers with the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-24XGE-SFPP).

  • On PTX Series Transport Routers, WAN PHY mode is supported only on the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+

  • When the PHY mode changes, interface traffic is disrupted because of port reinitialization.

To display interface information, use the operational mode command show interfaces xe-fpc/pic/port extensive.

Note:

  • SONET or SDH framing mode configuration framing (sdh | sonet) is not applicable on the 10-Gigabit Ethernet ports. Configuring the wan-phy framing mode on the 10-Gigabit Ethernet ports allows the interface to accept SONET or SDH frames without further configuration.

  • If you configure the WAN PHY mode on an aggregated Ethernet interface, you must set the aggregated Ethernet link speed to OC192.

See Also

Modes of Operation

10-Gigabit Ethernet PICs operate in the following modes:

  • Line-rate mode—By default, the 12-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-12XGE-SFPP) operates in line-rate mode.

    In a 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-24XGE-SFPP), 12 ports (ports 0–11)can operate in line-rate mode . To configure the PF-24XGE-SFPP PIC to operate in line-rate mode, include the linerate-mode statement at the [edit chassis set fpc fpc-number pic pic-number] hierarchy level.

  • Oversubscribed mode—In this mode, all ports on the PIC are enabled with two-to-one oversubscription. In a PF-24XGE-SFPP PIC, by default, two-to-one oversubscription of traffic is achieved in oversubscribed mode—Traffic from 24 ingress ports to the Packet Forwarding Engine is statically mapped to one of the 12 egress ports. 10 Gbps of bandwidth traffic moving toward the Packet Forwarding Engine is shared by two ingress ports (called a port group), thereby achieving two-to-one oversubscription. This scheme provides two-to-one oversubscription across a port group and not across the entire PIC.

    Note:

    PF-12XGE-SFPP PIC always operates at line rate.

  • Mixed-rate mode or dual-rate mode—Dual-rate mode or mixed-rate mode for PF-24XGE-SFPP allows you to configure a mix of port speeds of 1 Gbps and 10 Gbps. However, on PF-12XGE-SFPP, note that you can configure port speeds of either 1 Gbps and 10 Gbps when the PIC is in line rate mode. You can enable mixed-rate mode and set port speeds with the mixed-rate-mode and speed 1G |10G statements respectively at the [edit chassis fpc x pic y] hierarchy level. You can disable mixed-rate mode with the delete chassis fpc x pic y mixed-rate-mode statement.

    Note:

    To change the port speed from 10 Gbps to 1 Gbps on the PF-24XGE-SFPP and PF-12XGE-SFPP PICs, SFP optics is required.

See Also

Configuring Mixed-Rate Mode Operation

To configure mixed-rate mode operation for a PF-24XGE-SFPP PIC:

  1. Navigate to the [edit chassis] hierarchy level.
  2. On a T4000 router, configure the mixed-rate mode by including the mixed-rate-mode statement at the [edit chassis fpc slot-number pic pic-number] hierarchy level.

    On an LCC in a routing matrix, configure the mixed-rate mode by including the mixed-rate-mode statement at the [edit chassis lcc lcc number fpc slot-number pic pic-number] hierarchy level.

  3. Specify the port and the port speed that need to be configured. You can use one of the following speed attributes for this configuration.
    Note:

    On a 12 port 10-Gigabit Ethernet PIC (PF-12XGE-SFPP), you can configure the port speed as 1G by including the set fpc fpc-slot pic pic-number port port-number speed 1G statement at the [edit chassis] hierarchy level.

    Note:

    To change the port speed from 10 Gbps to 1 Gbps on PF-24XGE-SFPP and PF-12XGE-SFPP PICs, SFP optics is required.

To disable mixed-rate mode operation, include the delete chassis fpc x pic y mixed-rate-mode statement at the [edit chassis] hierarchy level.

See Also

Configuring Line-Rate Mode on PICs Supporting Oversubscription

For 10-Gigabit Ethernet LAN/WAN PICs supporting oversubscription, oversubscribed Ethernet mode is set by default. To configure these PICs in line-rate mode, include the linerate-mode statement at the [edit chassis set fpc fpc-number pic pic-number] hierarchy level:

To return to the default oversubscribed Ethernet mode, delete the linerate-mode statement at the [edit chassis fpc fpc-number pic pic-number] hierarchy level.

Note:

When the mode of operation of a PIC is changed, the PIC is taken offline and then brought back online immediately.

The following 10-Gigabit Ethernet LAN/WAN PICs support line-rate mode:

  • 10-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (model number PD-5-10XGE-SFPP)

  • 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (model number PF-24XGE-SFPP)

See Also

Example: Handling Oversubscription on a 10-Gigabit Ethernet LAN/WAN PIC

Table 4 lists the scenarios of handling oversubscription on the 10-port 10-Gigabit Ethernet LAN/WAN PIC for different combinations of port groups and active ports on the PIC.

Table 4: Handling Oversubscription on 10-Gigabit Ethernet LAN/WAN PICs

Number of Port Groups with Two Active Ports (A)

Number of Port Groups with One Active Port (B)

Total Number of Ports Used on PIC (C = Ax2 + B)

Status of Oversubscription and Throughput

0

1

1

Oversubscription is not active. Each port will receive 10 Gbps throughput.

0

2

2

Oversubscription is not active. Each port will receive 10 Gbps throughput.

0

5

5

Oversubscription is not active. Each port will receive 10 Gbps throughput.

1

0

2

Oversubscription is active. Each port will receive 5 Gbps throughput (with default shaper configuration).

1

4

6

Oversubscription is active for the port group that has two active ports. Each port in this port group will receive 5 Gbps throughput (with default shaper configuration).

For the remaining four ports, oversubscription is not active. Each port will receive 10 Gbps throughput.

3

0

6

Oversubscription is active. Each port will receive 5 Gbps throughput (with default shaper configuration).

5

0

10

Oversubscription is active on all 10 ports (5 port groups). Each port will receive 5 Gbps throughput (with default shaper configuration).

See Also

Disabling Control Queue Disable on a 10-port 10-Gigabit Ethernet LAN/WAN PIC

On a 10-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (model number PD-5-10XGE-SFPP), a control queue is used to queue all control packets received on an ingress port. This ensures that control protocol packets do not get dropped randomly when there is congestion due to oversubscription. The following control protocols are supported:

  • OSPF

  • OSPF3

  • VRRP

  • IGMP

  • RSVP

  • PIM

  • BGP

  • BFD

  • LDP

  • IS-IS

  • RIP

  • RIPV6

  • LACP

  • ARP

  • IPv6 NDP

  • Connectivity fault management (CFM)

  • Link fault management (LFM)

These control packets can either terminate locally or transit through the router. The control queue has a rate limiter to limit the control traffic to 2 Mbps (fixed, not user-configurable) per port. Hence, if transit control traffic is taking too much bandwidth, then it can cause drops on locally terminating control traffic, as shown in Figure 1.

Figure 1: Control Queue Rate Limiter ScenarioControl Queue Rate Limiter Scenario

If the end users generate a mass of malicious traffic for which the port number is 179 (BGP), the router dispatches that traffic to the ingress control queue. Further, if congestion occurs in this ingress control queue due to this malicious traffic, the provider's network control packets may be affected.

In some applications, this can be perceived as a new vulnerability. To address this concern, you can disable the control queue feature. With the control queue feature disabled, you must take precautions to protect control traffic through other means, such as mapping control packets (using BA classification) to a queue that is marked strict-high or is configured with a high CIR.

You can disable the control queue for all ports on the PIC. To disable the control queue, use the set chassis fpc n pic n no-pre-classifier command. By default, the no-pre-classifier statement is not configured and the control queue is operational.

Deleting the no-pre-classifier statement re-enables the control queue feature on all ports of the 10-Gigabit Ethernet LAN/WAN PIC.

Note:

  • This functionality is applicable both in OSE and line-rate modes.

  • The control queue feature is enabled by default in both OSE and line-rate modes, which can be overridden by the user configuration.

  • When the control queue is disabled, various show queue commands will show control queue in the output. However, all control queue counters are reported as zeros.

  • Changing this configuration (enabling or disabling the control queue feature) results in the PIC being taken offline and brought back online.

Once the control queue is disabled, the Layer 2/Layer 3 control packets are subject to queue selection based on BA classification. However, some control protocol packets will not be classified using BA classification, because they might not have a VLAN, MPLS, or IP header. These are:

  • Untagged ARP packets

  • Untagged Layer 2 control packets such as LACP or Ethernet OAM

  • Untagged IS-IS packets

When the control queue feature is disabled, untagged ARP, IS-IS, and other untagged Layer 2 control packets will go to the restricted queue corresponding to the forwarding class associated with queue 0, as shown in the following two examples.

Forwarding Untagged Layer2 Control Packets to Queue 3

With this configuration, the forwarding class (FC) associated with queue 0 is "be" (based on the forwarding-class statement configuration). "be" maps to restricted-queue number 3 (based on the "restricted-queue" configuration). Hence, with this particular configuration, untagged ARP, IS-IS, and other untagged Layer 2 control packets will go to ingress queue 3 (not to ingress queue 0).

Forwarding Untagged Layer2 Control Packets to Queue 3

With this configuration, the FC associated with queue 0 is "ef" (based on the forwarding-class statement configuration). "ef" maps to restricted-queue number 0 (based on the restricted-queue statement configuration). Hence, with this particular configuration, untagged ARP, IS-IS, and other untagged Layer 2 control packets would go to ingress queue 0.

For tagged ARP, IS-IS, or Layer2 control packets, users should configure an explicit dot1p/dot1ad classifier to make sure these packets are directed to the correct queue. Without an explicit dot1p/dot1ad classifier, tagged ARP, IS-IS, or Layer 2 control packets will go to the restricted-queue corresponding to the forwarding class associated with queue 0.

See Also

Related Documentation

Change History Table

Feature support is determined by the platform and release you are using. Use Feature Explorer to determine if a feature is supported on your platform.

Release
Description
14.1R2
Starting with Junos OS Release 14.1R2, PTX5000 supports the P2-10G-40G-QSFPP PIC on the FPC2-PTX-P1A FPC.
12.2
Starting with Junos OS Release 12.2, WAN PHY mode is supported on the T4000 routers with the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-24XGE-SFPP).
12.2
Starting with Junos OS Release 12.2, WAN PHY mode is supported on the T4000 routers with the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-24XGE-SFPP).
12.1R2
Starting with Junos OS Release 12.1R2, WAN PHY mode is supported on the T4000 routers with the 12-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-12XGE-SFPP).
12.1R2
Starting with Junos OS Release 12.1R2, WAN PHY mode is supported on the T4000 routers with the 12-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+ (PF-12XGE-SFPP).