Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

 
ON THIS PAGE
 

Tests and Monitors Overview

Monitoring key performance indicators (KPIs) such as the response time, congestion, and reachability is important to gauge the quality of your network. To evaluate the KPIs, Active Assurance enables you to create and run Test and Monitors to measure common metrics such as delay, delay variance (jitter), packet loss, round-trip response time, and so on.

A Test is a set of verifications that is performed by one or more Test Agents for a finite amount of time. For more information on Tests, see Measuring Metrics Using Active Assurance Tests.

A Monitor is a set of verifications that is performed by one or more Test Agents for an infinite amount of time. For more information on Monitors, see Measuring Metrics Using Active Assurance Monitors.

Both Tests and Monitors entails Tasks. The Task contains the configuration to measure a specific metrics by using certain protocols. For information on the protocols that are supported in Paragon Automation, see Supported Protocols.

When you create and run a Test or Monitor, the Test Agent receives the measurement configuration that you have defined in the Test or Monitor. Based on the protocols that you have defined during the Task creation, the Test Agent downloads the required protocols from Paragon Automation, starts collecting the measurements, and shares the data in the form of streams that you can view in the Paragon Automation GUI. This information helps you to gain insights into your network's health, performance, and quality.

Measuring Metrics Using Active Assurance Tests

A Test is a set of verifications that are performed by one or more Test Agents for a finite amount of time. A Test contains one or more Steps and Tasks, which validates whether KPIs that are defined in the Tests can be considered as operational (pass) or not (fail).

A Test can consist of several Steps that are executed sequentially. Each Step can consist of one or more Tasks that run concurrently. A Task contain the configuration to measure specific metrics.

Figure 1 illustrates the relation between a Test, Steps, and Tasks in Paragon Automation.

Figure 1: Components in an Active Assurance Test Components in an Active Assurance Test

Test measures metrics in a time-bound manner and therefore you need to set the duration for each Step which determines the duration of the entire Test.

A Test delivers a binary result—Pass or Fail.

Note:

If any one Task with the Test fails, then Test status is displayed as Fail.

Measuring Metrics Using Active Assurance Monitors

A Monitor is a set of verifications that are performed by one or more Test Agents for an infinite amount of time. A Monitor can contain multiple Tasks, which run in parallel and continuously monitors the KPIs that are defined in the Monitor. A Task contains the configuration to measure specific metrics.

Figure 2 illustrates the relation between a Monitor and Tasks in Paragon Automation.

Figure 2: Components in an Active Assurance Monitor Components in an Active Assurance Monitor

Monitors measure the metrics indefinitely until you decide to stop the Monitor. There is no limited time duration for which you want to stop a Monitor. Since you can start and stop a Monitor at will you need not set the duration.

A Monitor delivers a time-framed result as it runs continuously.

Supported Protocols

Paragon enables you to configure the protocols listed in Table 1 for a Task.

Table 1: List of Protocol Tasks

Protocol

Description

DNS

The DNS task is used to test and monitor DNS servers.

When a DNS task starts, the test agents send a request to resolve a lookup address, and collect statistics on response times. DNS primarily uses User Datagram Protocol (UDP) on port number 53 to serve requests. DNS queries consist of a single UDP request from the client followed by a single UDP reply from the server.

Running a DNS task provides information about the response times of your DNS servers from different locations. High DNS response times translate into high response times for all services that use DNS to resolve IP addresses, such as web surfing.

This task is applicable for both IPv4 and IPv6.

HTTP

The HTTP Task is used to test or monitor HTTP servers.

Running an HTTP Task checks the performance of a website or web application of the web server and of the network between the web server and the Test Agent. You can request web pages and verify response codes from distributed locations inside or outside of your network.

When an HTTP Task starts, the Test Agents make an HTTP Get request towards the specified URL and fetch the response. The task does not render HTML pages. Hence, test agents do not make additional requests for linked resources, (images, CSS files, and so forth).

Measured parameters include TCP connect time, time until first byte received, time until last byte received, and download speed.

This task is applicable for both IPv4 and IPv6.

IPTV MPEG

The IPTV MPEG Task is used to monitor the IPTV channel quality.

Running an IPTV MPEG Task provides information about the collecting MPEG loss, PCR jitter, rate, packet loss, and continuity count errors at Test Agent end-points. When the Task starts, the Test Agents join the channels by sending IGMP join messages. On receiving the MPEG streams, the Test Agents continuously measures quality.

Netflix Speedtest

The Netflix Speedtest Task is used to assess the performance of a Netflix speed test transaction.

Running a speed test provides information on the bandwidth, latency, or threshold violations, if any. Paragon Automation instructs Test Agents to download Netflix test segments over HTTPS, so that your network can handle Netflix streaming optimally.

OTT-HLS

The OTT-HLS Task is used to integrate OTT service monitoring and selecting the highest possible quality to avoid buffering.

When running an OTT-HLS Task, Test Agent parses the manifest file and starts downloading the video segments. The algorithm adapts to the current network conditions and selects the highest bit rate to avoid buffering.

Ping

The Ping task initiates a task that checks connectivity to the remote device.

Running a ping task provides information about the delay, delay variance (jitter), packet loss of the connection to the remote host. The Ping tool uses Internet Control Message Protocol (ICMP) or UDP to initiate a single request from the test agent to the host, followed by a single response from the host.

This task works with both IPv4 and IPv6.

RPM HTTP

Use this Task if you are using ACX, PTX or MX device.

The RPM HTTP Task checks connectivity to the remote device.

RPM ICMP

Use this Task if you are using ACX, PTX or MX device.

You can measure one-way measurements for ICMP timestamp probes that includes information on

  • Minimum, maximum, standard deviation, and jitter measurements for egress and ingress times

  • Number of probe responses received

  • Percentage of lost probes

  • Number of probes sent

RPM TCP

Use this Task if you are using ACX, PTX or MX device.

RPM TWAMP

Use this Task if you are using ACX, PTX or MX device.

The two way active measurement protocol (TWAMP) facilitates the measurement of two-way or round-trip network performance metrics. Running a TWAMP Task provides information about the round-trip delay, delay variance (jitter), and packet loss. The Session-Initiator creates TWAMP test packets and sends to the Session-Reflector in the TWAMP server, and the Session-Reflector sends back a measurement packet when a test packet is received. TWAMP uses TWAMP-Control protocol to perform a handshake between initiator and reflector.

RPM UDP

Use this Task if you are using ACX, PTX or MX device.

This Test checks if your network is good enough for quality-demanding services such as client–server applications and video conferencing.

When a UDP Task starts, the Test Agents will generate traffic at the rate you specify. The rate is the Layer 2 Ethernet rate, also known as the Committed Information Rate (CIR). It includes the Ethernet headers with the CRC checksum but not the Frame Gap, Preamble, or Start of Frame Delimiter. The UDP flow sent by the sender Test Agent includes timestamps and sequence numbers, so that the receiving Test Agent can calculate one-way delay, jitter, and packet loss.

TCP

The TCP Task is used to assess the network performance for client-server applications by sending TCP sessions between Test Agents.

Running a TCP Task provides information about the latency, jitter, throughput bandwidth, and monitor network congestion.

When a TCP Task starts, the client Test Agents send TCP packets to server Test Agents, and receives measurement information from server Test Agents. This gives an overall view of the network.

TWAMP Reflector

The TWAMP Reflector is a component of TWAMP. It receives test packets from the Session-Initiator and reflects them back.

Running a TWAMP Reflector helps in evaluation of the quality of the network and provides information on how data is transmitted in two-directions; between Session-Initiator and Session-Reflector. This bidirectional communication enables the measurement of performance metrics such as round-trip delay, delay variance (jitter), and packet loss.

This Task is applicable for both IPv4 and IPv6.

TWAMP/TWAMP Light

  • TWAMP—The two way Active measurement protocol facilitates the measurement of two-way or round-trip network performance metrics. Running a TWAMP Task provides information about the round-trip delay, delay variance (jitter), and packet loss. The Session-Initiator creates TWAMP test packets and sends to the Session-Reflector in the TWAMP server, and the Session-Reflector sends back a measurement packet when a test packet is received. TWAMP uses TWAMP-Control protocol over TCP to perform a handshake between initiator and reflector.

  • TWAMP Light—The two way Active measurement protocol light is a simplified version of TWAMP. It is a stateless version of TWAMP where test parameters are predefined instead of negotiated. All test packets received by the server on a test port are reflected back and forgotten right away.

    Running a TWAMP Light Task provides information about the round-trip delay, delay variance (jitter), and packet loss. Unlike TWAMP, TWAMP Light does not use TWAMP-Control protocol.

    This Task is applicable for both IPv4 and IPv6.

UDP

The UDP Task is used to evaluate the network quality for client-server applications and video conferencing.

Running a UDP Task measures one-way delay, jitter, packet loss, and misorders of packets. When a UDP task starts, the client Test Agents send packets that include timestamps and sequence numbers to the server Test Agents at the rate you specify. In this way, the server Test Agent can calculate one-way delay, jitter, and packet loss.

Y.1731 DM

Y.1731 Delay Measurement (DM) task is used to evaluate the network performance with respect to time. It is a service OAM (Operations, Administration, and Maintenance) mechanism defined by the ITU-T to monitor network performance.

Running a Y.1731 DM task measures delay and delay variance of packets. The local maintenance end point (MEP) sends packets that has timestamps to the remote maintenance end point (MEP) and vice-versa. The Test Agents then calculate one-way delay as well as two-way delay measurements. For more information on Y.1731 Ethernet Service OAM, see ITU-T Y.1731 Ethernet Service OAM Overview.

Y.1731 SLM

Y.1731 Synthetic Loss Measurement (SLM) task is used to measure the frame loss across the network. It is a service OAM (Operations, Administration, and Maintenance) mechanism defined by the ITU-T to monitor network performance.

Running a Y.1731 Synthetic Loss Measurement (SLM) task measures the number of frames lost during transmission. The local MEP sends synthetic frames to the remote MEP and compares the number of frames transmitted with the number received. The ratio of lost frames to the total number of frames that are sent is calculated to measure the frame loss on the network. For more information on Y.1731 Ethernet Service OAM, see ITU-T Y.1731 Ethernet Service OAM Overview.

Benefits of Using Active Assurance Tests and Monitors

  • Enables you to analyze reachability, congestion, and response time in networks to support business critical applications.

  • Access historical view of errors in your network.

  • Customize parameters and thresholds to reflect the optimum network performance that you require.

Related Documentation