Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

 
 

Installation

Address Pool manager 3.5.0 installation requires the minimum system requirements listed in this section.

The BNG CUPS Controller can be installed on a single Kubernetes cluster or on a multiple geography, multiple cluster setup. The installation requirements and installation process for these two types of setups are different.

For information on how to install APM, see Address Pool Manager Installation Guide.

APM installs on a Kubernetes cluster comprised of physical or virtual machines (VMs).

For the Kubernetes cluster requirements for your setup, see the following:

Table 1: Single Kubernetes Cluster Setup Requirements
Category Details

Cluster

A single cluster with 3 hybrid nodes.

Kubernetes node

The Kubernetes nodes require the following:

  • For the operating system, you can use either of the following:

    • Ubuntu 22.04 LTS (for a BBE Cloudsetup cluster)

    • Red Hat Enterprise Linux CoreOS (RHCOS) 4.16 or later (for a Red Hat OpenShift Container Platform cluster)

  • CPU: 14 or 16 cores. Use a 16 core node if you plan on running other applications on the cluster (such as the BNG CUPS Controller application).

  • Memory: 64 GB

  • Storage: 512 GB storage partitioned as 128 GB root (/), 128 GB /var/lib/docker, and 256 GB /mnt/longhorn(application data

  • Kubernetes role: Control plane etcd function and worker node

This specification establishes a cluster that can run APM as well as its companion applications such as BBE Event Collection and Visualization and BNG CUPS Controller simultaneously.

Jump host

The jump host requires the following:
  • Operating system: Ubuntu version 22.04 LTS or 24.04 LTS

  • CPU: 2 core

  • Memory: 8 gibibytes (GiB)

  • Storage: 128 gibibytes (GiB)

  • Installed software:

    • Python 3.10-venv (Ubuntu 22.04) or 3.12-venv (Ubuntu 24.04)

    • Helm utility

    • Docker utility

    • OpenShift CLI. Required if you are using a Red Hat OpenShift Container Platform (RHOCP) cluster.

Cluster software

The cluster requires the following software:

  • RKE version 1.3.15 (Kubernetes 1.24.4)—Kubernetes distribution

  • MetalLB version 0.13.7—Network load balancer

  • Keepalived version 2.2.8—Kubelet HA VIP Controller

  • Longhorn version 1.2.6—CSI

  • Flannel version 0.15.1—CNI

  • Registry version 2.8.1—Container registry

  • OpenShift version 4.16 or later—Kubernetes Distribution for RHOCP. Uses compatible versions of Longhorn (CSI), and MetalLB, OVN (CNI), and OpenShift Image Registry

Jump host software

The jump host requires the following software:

  • Kubectl version 1.28.6+rke2r1—Kubernetes client

  • Helm version 3.12.3—Kubernetes package manager

  • Docker-ce version 20.10.21—Docker engine

  • Docker-ce-cli version 20.10.21—Docker engine CLI

  • OpenShift version 4.16 or later—Kubernetes distribution for RHOCP clusters.

Storage

A storage class named jnpr-bbe-storage.

Network load balancer address

One for APMi.

Registry storage

Each APM release requires approximately 3 gibibytes (GiB) of container images.

Table 2: Multiple Geography Kubernetes Cluster Setup Requirements
Category Details

Cluster

The multiple cluster consists of three clusters with each cluster consisting of 3 hybrid nodes.

The three clusters must consist of one management cluster and two workload clusters.

Note:

Make sure that the cluster and service CIDRs for each workload cluster do not overlap. The cluster internal networks of each workload cluster are connected by a Submariner IP tunnel. The internal CIDRS must be distinct.

Management cluster Kubernetes node

The management cluster Kubernetes node requires the following:

  • For the operating system, you can use either of the following:

    • Ubuntu 22.04 LTS (for a BBE Cloudsetup cluster)

    • Red Hat Enterprise Linux CoreOS (RHCOS) 4.16 or later (for a RHOCP cluster)

  • CPU: 8

  • Memory: 24 GB

  • Storage: 256 GB of storage, partitioned according to the following:

    • On a Rancher Kubernetes Engine 2 Kubernetes (RKE2) system—64 GB root (/), 96 GB /var/lib/rancher, and 96 GB /var/lib/longhorn (application data)

    • On a RHOCP system—64 GB root (/), 96 GB /var/lib/containers, and 96 GB /var/lib/longhorn

  • Kubernetes role: Control plane etcd function and worker node

This specification establishes a cluster that can run Karmada and ECAV simultaneously.

Workload cluster Kubernetes node

The workload cluster Kubernetes node requires the following:

  • For the operating system, you can use either of the following:

    • Ubuntu 22.04 LTS (for a BBE Cloudsetup cluster)

    • Red Hat Enterprise Linux CoreOS (RHCOS) 4.16 or later (for a RHOCP cluster)

  • CPU: 14 or 16 cores. Use a 16 core node if you plan on running other applications on the cluster (such as the BNG CUPS Controller application).

  • Memory: 64 GB

  • Storage: 512 GB of storage, partitioned according to the following:

    • On a RKE2 system— 128 GB root (/), 128 GB /var/lib/rancher, 256 GB /var/lib/longhorn;

    • On a RHOCP system—128 GB root (/), 128 GB /var/lib/containers, and 256 GB /var/lib/longhorn

  • Kubernetes role: Control plane etcd function and worker node

This specification establishes a cluster that can run APM as well as its companion applications such as BBE Event Collection and Visualization and BNG CUPS Controller simultaneously.

Jump host

The jump host requires the following:
  • Operating system: Ubuntu version 22.04 LTS or 24.04 LTS

  • CPU: 2 core

  • Memory: 8 gibibytes (GiB)

  • Storage: 128 gibibytes (GiB)

  • Installed software:

    • Python 3.10-venv (Ubuntu 22.04) or 3.12-venv (Ubuntu 24.04)

    • Helm utility

    • Docker utility

    • OpenShift CLI. Required if you are using a RHOCP cluster.

Cluster software

The cluster requires the following software:

  • RKE2 version 1.28.6+rke2r1—Kubernetes distribution

    • MetalLB version 0.14.3—Network load balancer

    • Kube-vip version 0.7.1—Kubelet HA VIP Controller

    • Longhorn version 1.6.0—CSI

    • Canal—CNI (part of RKE2 distribution)

    • Registry version 2.8.1—Container registry

  • OpenShift version 4.16 or later—Kubernetes Distribution for RHOCP. Uses compatible versions of Longhorn (CSI), and MetalLB, OVN (CNI), and OpenShift Image Registry.

  • Karmada version 1.13.1—Multiple cluster orchestration. Required for the management cluster.

  • Submariner version 0.20.0—Layer 3 tunneling.

Jump host software

The jump host requires the following software:

  • Kubectl version 1.28.6+rke2r1—Kubernetes client.

  • Helm version 3.12.3—Kubernetes package manager.

  • Docker-ce version 20.10.21—Docker engine.

  • Docker-ce-cli version 20.10.21—Docker engine CLI.

  • OpenShift CLI Tool (oc) version 4.16 or later—Kubernetes distribution for RHOCP clusters.

  • Subctl version 0.20.0—Submariner CLI utility.

  • Kubectl Karmada version 1.13.1—Kubectl karmada plug-in.

Storage

A storage class named jnpr-bbe-storage

Network load balancer addresses

One on each workload cluster for APMi and one on the management cluster for bbe-observer.

Registry storage

Each APM release requires approximately 3 gibibytes (GiB) of container images. Required for each cluster.

Additional Requirements

The BNG is a Juniper Networks MX Series router running Junos, or a Juniper BNG CUPS Controller (BNG CUPS Controller).

We recommend the following releases:

  • Junos OS Release 23.4R2-S5 or later

  • BNG CUPS Controller 24.4R2 or later

For APM, confirm that you have a juniper.net user account with permissions to download the APM software package. Download and install the APM software from a machine that will not be part of the Kubernetes cluster.