System Requirements for Tanzu Deployment
Read this section to understand the system, resource, port, and licensing requirements for installing Juniper Cloud-Native Router on a VMWare Tanzu platform.
Minimum Host System Requirements for Tanzu
Table 1 lists the host system requirements for installing Cloud-Native Router on Tanzu.
Component | Value/Version | Notes |
---|---|---|
CPU | Intel x86 | The tested CPU is Intel Xeon Gold 6212U 24-core @2.4 GHz |
Host OS (for TKG 2.3) |
Photon OS 3.0 | |
Kernel Version (for TKG 2.3) | 4.19.x | |
NIC |
|
Support for Mellanox NICs is considered a Juniper Technology Preview (Tech Preview)
feature. When using Mellanox NICs, ensure your interface names do not exceed 11 characters in length. |
IAVF driver | 4.8.2 | |
ICE_COMMS | 1.3.35.0 | |
ICE | 1.11.20.13 | ICE driver is used only with the Intel E810 NIC |
i40e | 2.22.18.1 | i40e driver is used only with the Intel XL710 NIC |
Kubernetes (TKG 2.3) | 1.23.8+vmware.3 | |
Calico | 3.22.x | |
Multus | 3.8 | |
Helm | 3.9.x | |
Container-RT (TKG 2.3) | containerd 1.6.6x | |
Note:
The component versions listed in this table are expected to work with JCNR, but not every version or combination is tested in every release. |
Resource Requirements for Tanzu
Table 2 lists the resource requirements for installing Cloud-Native Router on Tanzu.
Resource | Value | Usage Notes |
---|---|---|
Data plane forwarding cores | 1 core (1P + 1S) | |
Service/Control Cores | 0 | |
UIO Driver | VFIO-PCI | To enable, follow the steps
below:cat /etc/modules-load.d/vfio.conf vfio vfio-pci |
Hugepages (1G) | 6 Gi | See Configure the Number of Huge Pages Available on a Node. |
Cloud-Native Router Controller cores | .5 | |
Cloud-Native Router vRouter Agent cores | .5 |
Miscellaneous Requirements for Tanzu
Table 3 lists additional requirements for installing Cloud-Native Router on Tanzu.
Requirement |
Example |
---|---|
Enable the host with SR-IOV and VT-d in the system's BIOS. |
Depends on BIOS. |
Enable VLAN driver at system boot. |
Configure /etc/modules-load.d/vlan.conf as follows: cat /etc/modules-load.d/vlan.conf 8021q Reboot and verify by executing the command: lsmod | grep 8021q |
Enable VFIO-PCI driver at system boot. |
Configure /etc/modules-load.d/vfio.conf as follows: cat /etc/modules-load.d/vfio.conf vfio vfio-pci Reboot and verify by executing the command: lsmod | grep vfio |
Set IOMMU and IOMMU-PT in GRUB. |
Add the following line to
/etc/default/grub.GRUB_CMDLINE_LINUX_DEFAULT="console=tty1 console=ttyS0 default_hugepagesz=1G hugepagesz=1G hugepages=64 intel_iommu=on iommu=pt" Update grub and reboot. grub2-mkconfig -o /boot/grub2/grub.cfg reboot |
Additional kernel modules need to be loaded on the host before deploying
Cloud-Native Router in L3 mode. These modules are usually available in
Note:
Applicable for L3 deployments only. |
Create a /etc/modules-load.d/crpd.conf file and add the following kernel modules to it: tun fou fou6 ipip ip_tunnel ip6_tunnel mpls_gso mpls_router mpls_iptunnel vrf vxlan |
Enable kernel-based forwarding on the Linux host. |
ip fou add port 6635 ipproto 137 |
Exclude Cloud-Native Router interfaces from NetworkManager control. |
NetworkManager is a tool in some operating systems to make the management of network interfaces easier. NetworkManager may make the operation and configuration of the default interfaces easier. However, it can interfere with Kubernetes management and create problems. To avoid NetworkManager from interfering with Cloud-Native Router interface configuration, exclude Cloud-Native Router interfaces from NetworkManager control. Here's an example on how to do this in some Linux distributions:
|
Verify the core_pattern value is set on the host before deploying JCNR. |
sysctl kernel.core_pattern kernel.core_pattern = |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e You can update the core_pattern in kernel.core_pattern=/var/crash/core_%e_%p_%i_%s_%h_%t.gz |
Enable iommu unsafe interrupts and unsafe noiommu mode. |
echo Y > /sys/module/vfio_iommu_type1/parameters/allow_unsafe_interrupts echo Y > /sys/module/vfio/parameters/enable_unsafe_noiommu_mode |
Configure iptables to accept specified traffic. |
iptables -I INPUT -p tcp --dport 830 -j ACCEPT iptables -I INPUT -p tcp --dport 24 -j ACCEPT iptables -I INPUT -p tcp --dport 8085 -j ACCEPT iptables -I INPUT -p tcp --dport 8070 -j ACCEPT iptables -I INPUT -p tcp --dport 8072 -j ACCEPT iptables -I INPUT -p tcp --dport 50053 -j ACCEPT iptables -A INPUT -p icmp -j ACCEPT iptables -A OUTPUT -p icmp -j ACCEPT iptables -A INPUT -s 224.0.0.0/4 -j ACCEPT iptables -A FORWARD -s 224.0.0.0/4 -d 224.0.0.0/4 -j ACCEPT iptables -A OUTPUT -d 224.0.0.0/4 -j ACCEPT |
On the ESXi Hypervisor, enable 16 queues. |
set esxcli system module parameters set -m icen -p NumQPsPerVF=16,16,16,16 |
On the ESXi Hypervisor, enable trust and disable spoofcheck: |
esxcli intnet sriovnic vf set -s false -t true -v 0 -n vmnic2 Check the settings: esxcli intnet sriovnic vf get -n vmnic2 VF ID Trusted Spoof Check 0 true false |
Port Requirements
Juniper Cloud-Native Router listens on certain TCP and UDP ports. This section lists the port requirements for the cloud-native router.
Protocol | Port | Description |
---|---|---|
TCP | 8085 | vRouter introspect–Used to gain internal statistical information about vRouter |
TCP | 8070 | Telemetry Information- Used to see telemetry data from the Cloud-Native Router vRouter |
TCP | 8072 | Telemetry Information-Used to see telemetry data from Cloud-Native Router control plane |
TCP | 8075, 8076 | Telemetry Information- Used for gNMI requests |
TCP | 9091 | vRouter health check–cloud-native router checks to ensure the vRouter agent is running. |
TCP | 9092 | vRouter health check–cloud-native router checks to ensure the vRouter DPDK is running. |
TCP | 50052 | gRPC port–Cloud-Native Router listens on both IPv4 and IPv6 |
TCP | 8081 | Cloud-Native Router Deployer Port |
TCP | 24 | cRPD SSH |
TCP | 830 | cRPD NETCONF |
TCP | 666 | rpd |
TCP | 1883 | Mosquito mqtt–Publish/subscribe messaging utility |
TCP | 9500 | agentd on cRPD |
TCP | 21883 | na-mqttd |
TCP |
50053 |
Default gNMI port that listens to the client subscription request |
TCP | 51051 | jsd on cRPD |
UDP | 50055 | Syslog-NG |