Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

 
 

Understanding QFX3000-M QFabric System Hardware Configurations

The QFX3000-M QFabric system is made up of multiple hardware components:

  • EX Series switches—Two EX4200 switches or two EX4300 switches are required for a QFX3000-M QFabric system control plane and management network interconnection. You may not mix EX4200 and EX4300 switches on the same QFabric system.

    • EX4200–Use EX4200-24T switches with an SFP+ uplink module installed for copper-based control planes and EX4200-24F for fiber-based control planes. Two small form-factor pluggable (SFP) Gigabit Ethernet uplink ports on each EX4200 switch interconnect the two EX4200 switches.

    • EX4300–Use EX4300-48T switches with an SFP+ uplink module installed for copper-based control planes and EX4300-48P for fiber-based control planes. Four quad small form-factor pluggable plus (QSFP+) 40-Gigabit Ethernet uplink ports on each EX4300 interconnect the two EX Series switches.

  • QFX3100 Director devices—Two QFX3100 Director devices are required for a QFX3000-M QFabric system. Together, the two Director devices are called a Director group.

    • Four Gigabit Ethernet ports on each QFX3100 Director device provide connection to the control plane and management network through the EX4200 switches.

    • Two Gigabit Ethernet ports on each QFX3100 Director device interconnect two Director devices in a Director group.

    • One Gigabit Ethernet RJ-45 management port on each QFX3100 Director device provides connection to the management network through your out-of-band management network.

    Note:

    For a copper-based QFX3000-M QFabric system control plane network, use QFX3100 Director devices with RJ-45 network modules installed. For a fiber-based control plane network, use QFX3100 Director devices with SFP network modules installed.

  • QFX5100-24Q or QFX3600-I Interconnect devices—Two interconnect devices are required for a QFX3000-M QFabric system. Up to four interconnect devices can be used in a QFX3000-M QFabric system.

    • QFX5100-24Q Interconnect device

      • Up to 24 40-Gbps QSFP+ ports on each Interconnect device connect the QFX5100, QFX3600, or QFX3500 Node devices to the data plane network across fiber-optic cables and a high-speed backplane.

      • Two Gigabit Ethernet management ports connect each QFX5100-24Q Interconnect device to the control plane and management network through the EX4200 switches.

        Note:

        For a copper-based QFX3000-M QFabric system control plane network, use the 1000BASE-T management port labeled C0 and the SFP management port labeled C1 on QFX5100-24Q Interconnect devices. For a fiber-based control plane network, use the SFP management ports labeled C0 and C1 on QFX5100-24Q Interconnect devices.

        Figure 1: QFX5100-24Q Management PanelQFX5100-24Q Management Panel
          1

        Status LEDs

          4

        em0–RJ-45 (1000 Base-T) management Ethernet port (C0)

        Some SKUs have an additional SFP management Ethernet port (second C0)

          2

        em1–SFP management Ethernet port (C1)

        Cage (socket for either 1 GbE copper SFP or fiber SFP)

          5

        RJ-45 console port (CON) )

          3

        Reset button, see caution statement below

          6

        USB port

        CAUTION:

        Do not use the Reset button to restart the power sequence unless under the direction of Juniper Networks Technical Assistance Center (JTAC).

    • QFX3600-I Interconnect device

      • Up to 16 40-Gbps quad form-factor-pluggable plus (QSFP+) ports on each QFX3600-I Interconnect device connect the QFX3500 or QFX3600 Node devices to the data plane network across fiber-optic cables and a high-speed backplane.

      • Two Gigabit Ethernet management ports connect each QFX3600-I Interconnect device to the control plane and management network through the EX Series switches.

        Note:

        For a copper-based QFX3000-M QFabric system control plane network, use the 1000BASE-T management ports labeled C0 and C1 on QFX3600-I Interconnect devices. For a fiber-based control plane network, use the SFP management ports labeled C0S and C1S on QFX3600-I Interconnect devices.

      Figure 2 shows the front of a QFX3600-I Interconnect device.

      Figure 2: QFX3600-I Interconnect Device Front PanelQFX3600-I Interconnect Device Front Panel
        1

      LCD panel

        6

      C0 management port

        2

      Chassis status LEDs

        7

      C0S management port

        3

      Access and uplink ports

        8

      C1S management port

        4

      Chassis serial number label and ESD point

        9

      Console (CON) port

        5

      C1 management port

      10

      USB port

  • QFX3500, QFX3600. QFX5100-24Q, QFX5100-48S, or QFX5100-48T Node devices—Up to 16 Node devices can be connected to the QFX3000-M QFabric system.

    Table 1: Connecting Node Devices to Servers, Storage, or External Networks

    Node Device

    Description

    QFX3500

    Total of 48 10-Gbps SFP+ ports.

    • 12 (ports 0 through 5 and 42 through 47) can be configured as 2-Gbps, 4-Gbps, or 8-Gbps Fibre Channel ports.

    • 36 (ports 6 through 41) can be configured as Gigabit Ethernet ports.

    • No limitations on which ports can be configured as 10-Gigabit Ethernet ports.

    • However, if a Fibre Channel transceiver is in ports 0 through 5 or 42 through 47, all of the ports in that group must be configured as Fibre Channel, even though only one port in a group might have a Fibre Channel transceiver, and no port in the group can use a 10-Gigabit Ethernet transceiver.

    QFX3600

    Up to 14 40-Gbps QSFP+ ports (Q2 through Q15) on each Node device use QSFP+ DAC breakout cables or QSFP+ transceivers with fiber breakout cables to support 48 10-Gigabit Ethernet interfaces.

    • By default, 12 ports (Q4 through Q15) are configured for 10-Gigabit Ethernet connections between the Node device and servers, storage, or external networks.

    • Optionally, you can configure ports Q2 through Q15 for 10-Gigabit Ethernet connections.

    QFX5100-24Q

    The base model supports 24 40-Gbps Ethernet QSFP+ ports. With two QFX-EM-4Q expansion modules inserted, eight additional QSFP+ ports provide a total of 32 40-Gbps ports. The availability of these ports depends on the system mode you configure.

    Optionally, you can configure these ports on each Node device use QSFP+ direct-attach copper (DAC) breakout cables or QSFP+ transceivers with fiber breakout cables to support 96 10-Gigabit Ethernet interfaces. With two QFX-EM-4Q expansion modules inserted, eight additional QSFP+ ports provide a total of 104 10-Gbps ports.

    QFX5100-48S

    Total of 48 10-Gbps SFP+ ports and 6 40-Gbps QSFP+ ports.

    • 48 (ports 0 through 47) can be configured as either 1-Gigabit Ethernet, using a breakout cable, or 10-Gigabit Ethernet interfaces.

    • By default, 4 of the QSFP+ interfaces (labeled fte-0/1/0 through fte-0/1/3) are configured for 40-Gbps uplink connections between your Node device and your Interconnect devices, and 2 QSFP+ interfaces (labeled xle-0/1/4 and xle-0/1/5) provide 40-Gigabit Ethernet connections to either endpoint systems (such as servers and storage devices) or external networks. Optionally, you can choose to configure the middle two interfaces (xle-0/1/8 and xle-0/1/15) for10-Gigabit Ethernet or 40-Gigabit Ethernet connections to either endpoint systems or external networks, and you can choose to configure the last two interfaces (fte-0/1/4 and fte-0/1/5) for uplink connections between your Node device and your Interconnect devices.

    QFX5100-48T

    The base supports 48 10GBASE-T ports and 6 QSFP+ ports.

    • The forty-eight copper physical ports (0 through 47) are tri-speed (10GbE/1GbE/100 Mbps) and can be configured as access ports.

    • By default, 4 of the QSFP+ interfaces (labeled fte-0/1/0 through fte-0/1/3) are configured for 40-Gbps uplink connections between your Node device and your Interconnect devices, and 2 QSFP+ interfaces (labeled xle-0/1/4 and xle-0/1/5) provide 40-Gigabit Ethernet connections to either endpoint systems (such as servers and storage devices) or external networks. Optionally, you can choose to configure the middle two interfaces (xle-0/1/8 and xle-0/1/15) for10-Gigabit Ethernet or 40-Gigabit Ethernet connections to either endpoint systems or external networks, and you can choose to configure the last two interfaces (fte-0/1/4 and fte-0/1/5) for uplink connections between your Node device and your Interconnect devices.

    Table 2: Connecting Node Devices to the Data Plane

    Node Device

    Interconnect Device

    Description

    QFX3500

    QFX3600-I or QFX5100-24Q

    Up to four 40-Gbps QSFP+ uplink ports (Q0 through Q3) connect to the data plane network.

    QFX3600

    QFX3600-I or QFX5100-24Q

    Up to eight 40-Gbps QSFP+ uplink ports (Q0 through Q7) connect to the data plane network.

    • By default, four ports (Q0 through Q3) are configured for connection between the Node device and the data plane network.

    • Optionally, you can configure the first eight ports (Q0 through Q7) for this connection.

    QFX5100-24Q

    QFX3600-I

    When introducing a QFX5100-24Q into an existing QFX3000-M QFabric System, install the QFX5100-24Q as the interconnect device and convert the QFX3600-I to a QFX3600 for use as a node device. See Converting the Device Mode for a QFabric System Component.

    QFX5100-24Q

    Any of the 24 40-QSFP+ uplink ports (0 through 23) may be used to connect to the data plane network.

    QFX5100-48S

    QFX3600-I or QFX5100-24Q

    Up to six 40-Gbps QSFP+ uplink ports (48 through 53) connect to the data plane network.

    QFX5100-48T

    QFX3600-I or QFX5100-24Q

    Up to six 40-Gbps QSFP+ uplink ports (48 through 53) connect to the data plane network.

    Table 3: Connecting Node Devices to the Control Plane and Management Network through EX4200 Switches

    Node Device

    Description

    QFX3500

    Two Gigabit Ethernet management ports on each Node device provide connection to the control plane and management network.

    • For a copper-based QFX3000-M QFabric system control plane network, use the management ports on Node devices with a 1000BASE-T management board installed.

    • For a fiber-based control plane network, use the management ports on Node devices with an SFP management board installed.

    QFX3600

    Two Gigabit Ethernet management ports on each Node device provide connection to the control plane and management network.

    • For a copper-based control plane network, use the 1000BASE-T management ports (C0 and C1) on Node devices.

    • For a fiber-based control plane network, use the SFP management ports (C0S and C1S) on Node devices.

    QFX5100-24Q

    Two Gigabit Ethernet management ports on each Node device provide connection to the control plane and management network.

    • For a copper-based QFX3000-M QFabric system control plane network, use the RJ-45 management port (C0) and the SFP management port (C1) on Node devices with a 1 Gbps copper SFP.

    • For a fiber-based control plane network, use the SFP management port (C0) and (C1) on Node devices with a 1 Gbps fiber SFP.

      Note:

      Not all QFX5100-24Q product SKUs support an all-fiber connection.

    QFX5100-48S

    Two Gigabit Ethernet management ports on each Node device provide connection to the control plane and management network.

    • For a copper-based QFX3000-M QFabric system control plane network, use the RJ-45 management port (C0) and the SFP management port (C1) on Node devices with a 1 Gbps copper SFP.

    • For a fiber-based control plane network, use the SFP management port (C0) and (C1) on Node devices with a 1 Gbps fiber SFP.

      Note:

      Not all QFX5100-48S product SKUs support an all-fiber connection.

    QFX5100-48S

    Two Gigabit Ethernet management ports on each Node device provide connection to the control plane and management network.

    • For a copper-based QFX3000-M QFabric system control plane network, use the RJ-45 management port (C0) and the SFP management port (C1) on Node devices with a 1 Gbps copper SFP.

    • For a fiber-based control plane network, use the SFP management port (C0) and (C1) on Node devices with a 1 Gbps fiber SFP.

      Note:

      Not all QFX5100-48S product SKUs support an all-fiber connection.

    QFX5100-48T

    Two Gigabit Ethernet management ports on each Node device provide connection to the control plane and management network.

    • For a copper-based QFX3000-M QFabric system control plane network, use the RJ-45 management port (C0) and the SFP management port (C1) on Node devices with a 1 Gbps copper SFP.

    • For a fiber-based control plane network, use the SFP management port (C0) and (C1) on Node devices with a 1 Gbps fiber SFP.