Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

 
 

Create a Test

Tests measure metrics in a time-bound manner to produce a static measurement for the given duration. Tests have two sub components namely, Steps and Tasks. A Test is a collection of Steps, and a Step is a collection of Tasks. In Tests, Tasks under Steps are run parallel and each Step runs for the duration you configure. For more information, see Tests and Monitors Overview.

To create a Test:

  1. Do one of the following to access the Measurement Designer page:

    1. Access Measurement Designer page through the Tests page.

      1. Navigate to the Tests (Observability > Active Assurance > Tests) page.

        The Tests page appears.

      2. Click the Add (+) icon.

        The Create new page appears.

        The Create new page displays All, Tests, and Monitors mode, and the Tests mode is enabled by default.

      3. Select the + Create blank Test.

        The Measurement Designer page appears.

    2. Access Measurement Designer page directly.

      1. Navigate to the Measurement Designer (Observability > Active Assurance > Measurement Designer) page.

        The Create new page appears.

        The Create new page displays All, Tests, and Monitors modes, and the All mode is enabled by default.

      2. Select the Tests mode.

      3. Select the + Create blank Test.

        The Measurement Designer page appears.

  2. Specify a name for the Test.

    Click the Sequence Name or click the Edit (pencil) icon to enter a name for the Test in the Sequence Name text box.

    Sequence Name is the placeholder name for the Test.

  3. Click + Add Step to add Steps for a Test.

    Note:

    In the Measurement Designer page, the first Step and the Task selector are available by default in the GUI.

    For the Step, you can do the following:

    • (Optional) Edit the name of a Step—Click the Edit (pencil) icon near the Step Name and specify a name for the Step.

    • (Optional) Edit the duration of a Step—Click the Edit (pencil) icon near the Duration (clock) icon to edit the duration.

      The default duration for a Step is set to 30 seconds. The duration range is 30s through 86400s.

    • (Optional) Delete a Step—To delete a step, do one of the following:

      • Click the horizontal ellipsis (three dots) in the Step and click Remove.

      • Drag the Step anywhere on the screen.

      A confirmation message appears asking to confirm if you want to remove the Step. Click Yes.
  4. Select a Task from the Task selector page displayed by default, or click + Add Task to add Tasks for a Step. The Tasks page displays the list of protocols that can be configured for a Test.

    In the Tasks page, do one of the following:

    • Select a Task from the Tasks page. For example, click DNS to add DNS as one of the Tasks in the Step.

    • Click the Add (+) icon next to the Task.

    • Drag and drop the Task inside the Step that you are configuring.

    Select the Close (X) icon to close the Tasks page.

    For a Task, you can do the following:

    • (Optional) Edit the name of a Task—To edit a Task, do one of the following:

      • Click the Edit (pencil) icon to specify a name for the Task in the Task-Name text box.

      • Click the Task-Name and specify a name for the Task in the Task-Name text box.

      By default, the plugin name is displayed. If you do not edit, the default name will be used.

    • (Optional) Delete the Task—To delete a Task, do one of the following:

      • Click the down arrow in the Task box and click Remove.

      • Drag the Task anywhere on the empty portion of the screen.

      A confirmation message appears asking to confirm if you want to remove the Task. Click Yes.

    • Configure the parameters for a Task—Click the Settings (gear) icon on the Task box to configure a Task. The Step Name page appears and displays the Task you added. This page includes the following tabs:

      • Parameters tab—Configure parameters for the Tasks that you have added. For more information on parameters that you can configure for a Task, see Table 1.

        You can also configure input variables for each parameter so that the same values are consistently used across different Steps. For more information on input variables, see Create Input Variables.

      • Evaluation criteria tab—The Evaluation Criteria for each Task is added by default. You can configure customized evaluation criteria for metrics by using threshold expressions. On violation of any configured expression, Paragon Automation generates events. For more information on metrics that you can configure, see Table 17.

  5. Click + Add Task to add Task for a Step.

    A Test can include one or more Steps, and a Step can include one or more Tasks. Based on your requirements, repeat Step 3 and Step 4.

  6. Click the Global icon on the right side of the Measurement Designers page to manage input variables. For more information on input variables, see Create Input Variables.

  7. Click Test Settings (gear) icon on the right side of the page to,

    • Specify the wait duration (in seconds)—You can specify the maximum wait duration. After the Test Agent completes a Step, Paragon Automation waits for the Test Agents to configure or download the plugins or for the Test Agents to be ready to run the Steps.

      By default, the Step wait duration is 60 seconds. The Max wait duration has no effect on the Test duration.

    • (Optional) Specify a short description for the Test.

    • (Optional) Add Tags—Specify a key-value pair in the key:value format.

      You can configure Tags for the Test in the key:value format to provide additional information about the Test you are configuring. A tag is a key-value pair in which the key signifies a category for which you configure a value. The value is an identifier for the category. Examples of key-value pairs are device and device name (edgedevice:acx7000), site and site name (site:bangalore).

  8. Click Run.

    A message confirming that the Test is created successfully appears and you are redirected to the Test-Name (Observability > Active Assurance > Tests > Test-Name) page. On the Test-Name page, Test status is displayed as Running indicating that the Test is in progress. The status changes to Completed when the Test is complete and you can view the details of the Test. See About the Test-Name page for more information about the Test details.

    Note:

    The Run button is disabled until you add a Task under a Step. Also, You cannot run a Test if you have not specified the Test Name.

Table 1: Tasks and its parameters
Tasks Description

DNS

For information on the parameters that you can configure for DNS, see Table 2.

HTTP

For information on the parameters that you can configure for HTTP, see Table 3.

Ping

For information on the parameters that you can configure for ping, see Table 4.

IPTV MPEG

For information on the parameters that you can configure for IPTV MPEG, see Table 5.

Netflix Speedtest

For information on the parameter that you can configure for Netflix Speedtest, see Table 6.

OTT - HLS

For information on the parameters that you can configure for OTT-HLS, see Table 7.

TCP

For information on the parameters that you can configure for TCP, see Table 8.

UDP

For information on the parameters that you can configure for UDP, see Table 9.

TWAMP/TWAMP Light

For information on the parameters that you can configure for TWAMP/TWAMP Light, see Table 10.

TWAMP Reflector

For information on the parameters that you can configure for TWAMP Reflector, see Table 11.

RPM HTTP

For information on the parameters that you can configure for RPM HTTP, see Table 12.

RPM PING

For information on the parameters that you can configure for RPM PING, see Table 13.

RPM TCP

For information on the parameters that you can configure for RPM TCP, see Table 14.

RPM TWAMP

For information on the parameters that you can configure for RPM TWAMP, see Table 15.

RPM UDP

For information on the parameters that you can configure for RPM UDP, see Table 16.

Table 2: DNS Parameters
Parameter Description
General
Clients

Select one or more Test Agent interfaces on which you want to run the Test.

To select one or more Test Agents:

  1. Click the Clients text box.

    The Select interfaces page appears.

  2. Select one or more Test Agents. For information on filtering Test Agents, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Select Test Agent/Interfaces page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Lookup names

Specify the domain name to lookup.

For example, example.net

Lookup is the process of querying the server to translate a domain name into IP address.

When you click the Lookup names text box, a Select Lookup name page appears. You can add a name in the Lookup text box. To add more than one Lookup names, click + Add Lookup.

Time between requests

Specify the time that Test Agent should wait between successive DNS queries.

Unit—seconds (s)

Default value—10.00 s

Range—0.01 s through 3600 s

DNS server

Specify the IP address of the DNS server to query.

If left empty, Test Agents use the default DNS server.

Maximum Length—200 characters

DNS record type

Select the DNS record type.

A DNS record is a set of unstructured data stored in a DNS database. The database consists of information on a domain and its services. DNS has different resource records. Each record type has different functions in the resolution process.

  • A (Address)—Associates a domain name with an IPv4 address.

  • AAAA ( IPV6 Address)—Associates a domain name with an IPv6 address.

  • SOA Record (Start of Authority )—Provides information about a DNS zone.

  • MX (Mail Exchange)—Associates a domain name to the email server responsible for receiving an email.

  • NS (Name Server)—Provides domain information of an address. It specifies the servers responsible for hosting DNS servers for a particular domain.

  • TXT (Text)—Provides storage for text data. It is also used for domain verification.

  • PTR (Pointer)—Performs reverse DNS operation. It associates an IP address with a domain name.

  • CNAME (Canonical Name)—Maps domain names to another domain and not an IP address.

By default, the record type is A.

Thresholds for errored seconds (ES)
Timeout

Specify the timeout value.

If no response is received for the DNS request within the defined timeout period, an errored-second is raised unless the request lifetime expires.

Unit—Milliseconds (ms)

Default value—1000 ms

Range—1ms through 30000 ms

Advanced
Request lifetime

Specify the timeout value.

If no response is received for the DNS request within the defined timeout period, an errored-second is raised unless the request lifetime expires.

Request lifetime value is the duration for which a DNS request is alive. It determines how long a request persists without getting terminated.

Unit—Milliseconds (ms)

Default value—5000 ms

Range—1 ms through 30000 ms

Recursive requests

Enable or disable the Recursive Requests toggle button.

Recursive Request is the process where a DNS server queries other DNS servers until it resolves the lookup address.

If you enable the Recursive Requests toggle button, the Recursion Desired flag is set on the DNS queries.

By default, the toggle button is enabled.

Response code

Select the DNS response code. You can select one of the following response codes:

  • NOERROR—Indicates that the query was successful.

  • SERVFAIL—Indicates that the server has failed to complete the request.

  • NXDOMAIN—Indicates that the domain name does not exist.

  • REFUSED—Indicates that the server refused to perform the operation.

  • NOTAUTH—Indicates that the server is not authoritative for the zone.

The DNS response code can be any value from 0 to 9. The value indicates the outcome of a DNS query.

For more information on DNS response codes and strings with descriptions, see IANA link.

Expected response

Specify an expected response from the DNS server.

If the actual response does not match the expected response, an errored-second is raised. In case, the response consists of more than one codes, at least one code must match the expected response.

For more information on DNS response codes and strings with descriptions, see IANA link.

Table 3: HTTP Parameters
Parameter Description
General
Clients

Select one or more Test Agent interfaces on which you want to run the Test.

To select one or more Test Agent interfaces:

  1. Click the Clients text box.

    The Test Agent/Interfaces page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

URLs

Specify the URL for the HTTP request.

Maximum Length—200 characters

Time between requests

Specify the time taken between successive HTTP requests initiated by Test Agent.

Unit—Seconds (s)

Default value—10.00 s

Range—0.01 s through 3600 s

Thresholds for errored seconds (ES)
Timeout

Specify the timeout value.

If no response is received to the HTTP request within the defined timeout period, an errored second for timeout is raised.

Unit—Milliseconds (ms)

Default value—1000 ms

Range—1 ms through 30000 ms

Response content

Specify the regular expression (case-insensitive) against which the HTTP response content is validated.

Maximum Length—50 characters

Advanced
Request lifetime

Specify the maximum time to wait for a response before the HTTP request is canceled. If this time expires without a response, an errored second for lifetime expiry is raised.

Unit—Milliseconds (ms)

Default value—5000 ms

Range—1 ms through 30000 ms

HTTP response code

Specify the HTTP response code for Test Agent.

If the HTTP response code does not match the specified response code, an errored-second is raised.

For more information on HTTP response codes, see RFC 9110.

Proxy server

Specify the IP address of the HTTP proxy server optionally.

Proxy port

Specify the HTTP proxy port when using HTTP proxy server.

Default value—8080

Range—1 through 65535

Proxy authentication

Select the authentication method that the Test Agent uses when connecting to a proxy server. Select one of the following authentication method:

  • None—Indicates that you can access the remote endpoint without any authentication.

  • Basic—Indicates that you can access the remote endpoint by using a username and password.

  • Digest—Indicates that you can access the remote endpoint by using a username and password, but it will send a hashed version of the password, making the password resistant to attacks.

  • Ntlm—Indicates that you can access a remote endpoint by using Single Sign-on. That is, without a password.

Proxy authenticates the incoming request from a Test Agent. This ensures that only the authorized users have access to the internet.

Proxy username

Specify the username for authorized access to a proxy.

Proxy password

Specify the password for authorized access to a proxy server.

Table 4: Ping Parameters
Parameter Description
General
Clients

Select one or more Test Agent interfaces on which you want to run the Test.

To select one or more Test Agent interfaces:

  1. Click the Clients text box.

    The Select interfaces page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Select interfaces page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Hosts

Specify the hostname or the destination IP. A host is the remote endpoint to which the Test Agent sends the request.

When you click the Host text box, the Select Host page appears where you can enter hostnames. To add more than one hosts, click + Add Host and specify the following:

  • Host—The hostname or the IP address of the remote endpoint.

    Maximum length—255 characters

  • Name—The text box is automatically populated based on the data you specified in the Host text box.

Time between requests

Specify the time taken between successive ping requests initiated by Test Agent.

Unit—Seconds (s)

Default value—10.00 s

Range—0.01 s to 3600 s

Thresholds for error seconds (ES)
Delay

Specify the maximum threshold for the delay. If the round-trip time for a Ping response exceeds this value, an errored-second is raised.

Unit—Milliseconds (ms)

Default value—1000 ms

Range—1 ms through 30000 ms

DV (Delay variance)

Specify the maximum threshold value for jitter or delay variance (DV).

DV is the difference between the maximum and minimum delay experienced in a one second metrics interval. If the DV exceeds the defined value, an errored-second is raised.

Delay variation (DV) occurs when different packets take different amount of time to travel from a Test Agent to a remote endpoint. Packets are sent at regular interval of time and if variation is experienced in consecutive packets, the Test Agent generates an errored-second event.

Unit—Milliseconds (ms)

Default value—500 ms

Range—0 ms through 10000 ms

Advanced
UDP echo

Enable UDP Echo protocol instead of ICMP Ping.

By default, the toggle button is disabled.

Payload

Specify the size of the ping payload. Payload is the actual data in a request packet.

Unit—Bytes

Default value—56 bytes

Range—0 byte through 65000 bytes

TTL (Time to Live)

Specify the number of times the packets hop before a device discards the packet.

Time to live (TTL) value indicates lifespan of a request packet. TTL prevents infinite loop in a network when the packet fails to reach the destination.

For example, if you have entered the TTL value as 64, every time the packet passes a device, the value is reduced by one until the packet reaches the remote server. If the entered value reaches zero before reaching the remote endpoint, the packet is discarded.

Default value—64

Range—1 through 255

Request Lifetime

Specify the request lifetime value.

Request lifetime value is the maximum duration for which a ping request is alive. It determines how long a request persists before it is counted as lost.

Unit—Milliseconds (ms)

Default value—2000 ms

Range—1 ms through 30000 ms

DSCP/IPP

Specify the Differentiated Services Code Point (DSCP) or the IP Precedence (IPP) value that is used in the IP packet headers.

The IPP is the three-bit binary values (Precedence) in the ToS field of the IP header. An IPP value can be in the 0-7 range. IPP value informs the router about the priority of the packet. The higher the IPP value, the more the priority of the packet. See RFC 791 for more information.

DSCP is a six-bit binary value in the DS field of the IP header. DSCP value facilitates QoS for traffic management through the Best Effort, Assured Forwarding, Class Selector, and the Expedited Forwarding categories. See RFC 2474 for more information.

Default value—0

Range—0 through 255

Table 5: IPTV MPEG Parameters
Parameter Description
General
Clients

Select one or more Test Agent interfaces on which you want to run the Test.

To select one or more Test Agent interfaces:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

IPTV Channels

Specify one or more IPTV channels to monitor from the preset IPTV channel list.

When you click IPTV Channels, the Select Channel page appears where you can enter channels. To add more than one channels, click + Add channel and specify the following:

  • Multicast group address—Specify the IPv4 or IPv6 multicast address of the IPTV channel.

    Maximum length—64 characters.

  • Multicast group port—Specify the UDP destination port used in the IPTV multicast stream.

    Range—1 through 65535.

  • Multicast group source—Specify the source address of the multicast group. When provided, IGMPv3 (for IPv4) or MLDv2 (for IPv6) is used for joining the channels.

  • Program number—Specify the program number of the channel within a multicast group.

  • Name—Specify the name of the IPTV channel.

Thresholds for error seconds (ES)

MPEG loss (CC errors/s)

Specify the maximum allowed MPEG packet loss (Continuity Count errors) per second. An errored-second is raised if the MPEG loss exceeds this threshold.

Continuity Counter (CC) error indicates an issue with the packet sequence in an MPEG transport stream.

PAT/PMT delay variation (ms)

Specify the maximum tolerated jitter (delay variation) of the received MPEG stream. An errored-second is triggered if the PCR jitter or RTP jitter exceeds this threshold.

PCR provides timestamps to maintain synchronization of audio and video,

RTP provides end-to-end delivery of real-time data over IP networks.

PAT/PMT interval (s)

Specify the maximum allowable time interval between Program Allocation Table (PAT)/ Program Map Table (PMT) transmissions.

PAT has information on all the available programs in a transport stream. PAT maps all the programs numbers to PMT packet identifiers.

PMT has information on the streams and lists the PIDs of all the streams associated with a program.

PID interval (s)

Specify the maximum allowable time interval between audio or video Packet Identifiers (PIDs) as specified by Program Map Table (PMT).

PID is a 13-bit field in the header of a transport stream used to identify different data streams, such as video, audio, subtitles, within a transport stream.

Table 6: Netflix Speedtest Parameters
Parameter Description
General
Clients

Select one or more Test Agent interfaces on which you want to run the Test.

To select one or more Test Agent interfaces:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Measurement Cycle period

Specify the time interval between successive measurement cycles.

On each measurement cycle, the Test Agent downloads Netflix test segments over HTTPS from one or several OCAs (Open Connect Appliances) operated by Netflix.

OCA is a server appliance to cache and deliver content locally to subscribers, reducing the load on Netflix's central servers.

Unit—Minutes (min)

Default value—15 min

Range—1 min through 60 min

Upload or Download

Select the type of bandwidth to measure the rate of the data transfer.

Upload data transfer is calculated from the Test Agent to OCAs, while download is calculated from the OCAs to the Test Agent.

Advanced

Minimum Duration (s)

Specify the minimum duration of speedtest that must be run before checking for throughput stabilization.

Unit—Seconds (s)

Default value—2 s

Range—1 s through 3600 s

Maximum Duration (s)

Specify the maximum duration of speedtest that must be run to check for throughput stabilization.

Unit—Seconds (s)

Default value—30 s

Range—5 s through 3600 s

Minimum Concurrent OCA connections

Specify the minimum number of concurrent Open Connect Appliance (OCA) connections used for bandwidth testing.

Default value—3.

Range—1 through 5.

Maximum Concurrent OCA connections

Specify the maximum number of concurrent Open Connect Appliance (OCA) connections used for bandwidth testing.

Default value—5

Range—1 through 5

Thresholds for error seconds (ES)

Minimum bandwidth (Mbit/s)

Specify the minimum expected bandwidth during the speedtest.

An errored-second is raised if the bandwidth drops below the defined value.

Maximum latency (ms)

Specify the minimum expected bandwidth during the speedtest.

An errored-second is raised if the bandwidth drops below the defined value.

Table 7: OTT - HLS Parameters
Parameter Description
General
Clients

Select one or more Test Agent interfaces on which you want to run the Test.

To select one or more Test Agent interfaces:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

URLs

Specify the URL of the video stream to which you send the connection requests.

The URL can either be a playlist linking to other playlists for the different variants, or a playlist containing the segments. The file extension is .m3u or .m3u8.

When you click URLs, the Select URL page appears where you can enter URLs. To add more than one URLs, click + Add URL and specify the following:

  • URL—The host or the IP address of the remote endpoint.

  • Name—The text box is automatically populated based on the data you specified in URL.

Buffer size (s)

Specify the target duration of the buffered data.

If the duration of the buffer data drops below the defined value, new segments are downloaded.

Unit—Seconds (ms)

Default value—60 s

Minimum—1 s

Initial Buffering (s)

Specify the duration of the initial buffered data required before the playback begins.

Unit—Seconds (ms)

Default value—10 s

Minimum—1 s

Loop

Enable or disable the Loop button.

If enabled, the playback loops when the stream reaches the end of the playlist.

If disabled, the playback stops, and errored-seconds are raised.

By default, the toggle button is enabled.

Thresholds for error seconds (ES)

Minimum playback rate (Mbit/s)

Specify the minimum expected playback rate of the video stream.

An errored second is triggered if its value drops below this threshold.

Unit—Megabit per second (Mbit/s)

Minimum value—0 Mbit/s

Minimum download rate (Mbit/s)

Specify the minimum expected playback rate of the video stream.

An errored-second is raised if the download rate drops below the defined value.

Unit—Megabit per second (Mbit/s)

Minimum value—0 Mbit/s

Minimum selected rate (Mbit/s)

Specify the minimum expected download rate for the segments.

An errored-second is raised if the selected rate drops below the defined value.

Variants are the versions of media streams that is encoded at a specific rate. They enable adaptive streaming where the Test Agents can select variants to provide the best experience.

Unit—Megabit per second (Mbit/s)

Minimum value—0 Mbit/s

Minimum buffer size (s)

Specify the minimum expected duration of the data segment buffered in the Test Agent.

An errored-second is triggered if its value drops below the defined value.

Unit—Megabit per second (Mbit/s)

Minimum value—0 Mbit/s

Table 8: TCP Parameters
Parameter Description
General
Clients

Select one or more Test Agent interfaces which you want to use as TCP clients.

To select one or more Test Agent interfaces:

  1. Click Clients.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Server

Select one or more Test Agent interfaces that you want to use as UDP servers.

To select one or more Test Agent interfaces:

  1. Click Clients.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agents, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Direction

Choose the direction of the test traffic. The data is sent from 'Server to Client' or 'Client to Server'.

Client to server—Evaluates the data upload capabilities.

Server to client—Evaluates the data download capabilities.

Rate (Mbit/s)

Rate indicates the target data rate between the server and the client Test Agents.

ES Rate is the number of errored-seconds occurred when the rate at which the TCP packet reception drops below the defined value.

Unit—Megabit per second (Mbit/s)

Range—0.01 Mbit/s through 1000000.0 Mbit/s

Advanced

Server TCP port

Specify the port number used by the server Test Agent.

Default value—5000

Range—1 through 65535

Client TCP port

Specify the port number used by the client Test Agent.

Range—1 through 65535

Number of flows

Specify the number of TCP flows.

If more than one flows are specified, you should not set the Client port. If set, the plug-in activates an invalid configuration error, and if not set, the Client port gets a randomly assigned port number.

Default value—1

Range—1 through 64

DSCP/IPP

Specify the Differentiated Services Code Point (DSCP) or the IP Precedence (IPP) value that is used in the IP packet headers.

DSCP is a six-bit binary value in the DS field of the IP header. DSCP value facilitates QoS for traffic management through the Best Effort, Assured Forwarding, Class Selector, and the Expedited Forwarding categories. See RFC 2474 for more information.

Default value—0

Range—0 through 63

VLAN priority (PCP)

Specify the value for the VLAN priority code point to be used in VLAN header.

Range—0 through 7

Client connect delay (s)

Specify the allowable delay until the client initiates TCP connection towards the server.

Unit— Seconds (s)

Default value—0

Range—0 through 10

Proxy address

Specify the IP address of the TCP proxy server.

Proxy port

Specify the port number that the Test Agent uses for TCP proxy server.

Range—1 through 65535

Thresholds for error seconds (ES)

Min rate (Mbit/s)

Specify the minimum expected rate. An errored-second is raised if the TCP data rate drops below the defined value.

Unit—Megabit per second (Mbit/s)

Minimum—0.001 Mbit/s

Max rate (Mbit/s)

Specify the minimum expected rate. An errored-second is raised if the TCP data rate drops below the defined value.

Unit—Megabit per second (Mbit/s)

Minimum—0.001 Mbit/s

Table 9: UDP Parameters
Parameter Description
General
Clients

Select one or more Test Agent interfaces which you want to use as UDP client.

To select one or more Test Agent interfaces:

  1. Click Clients.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Server

Select one or more Test Agent interfaces which you want to use as UDP server.

To select one or more Test Agent interfaces:

  1. Click Clients.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Direction

Choose the direction of the test traffic. The data is sent from 'Server to Client' or 'Client to Server'.

Client to server—Evaluates the data upload capabilities.

Server to client—Evaluates the data download capabilities.

Rate (Mbit/s)

Specify the target data rate at which the client or server Test Agent transmits the UDP frames.

Unit—Megabit per second (Mbit/s)

Range—0.01 Mbit/s through 1000000.0 Mbit/s

Advanced

Server UDP port

Specify the port number of the UDP server to which the client Test Agent form a connection.

Default value—5000

Range—1 through 65535

Client TCP port

Specify the port number of the UDP server to which the client Test Agent form a connection.

Range—1 through 65535

Number of flows

Specify the total number of UDP connections established between the client and server Test Agents.

If more than one flows are specified, you should not set the Client port. If set, the plug-in activates an invalid configuration error, and if not set, the Client port gets a randomly assigned port number.

Default value—1

Range—1 through 64

Don't Fragment flag

Enable the Don’t Fragment Flag (DF Flag) to restrict the fragmentation of the packets that exceed the MTU. DF Flag is configured in an IP header. Router drops the packet if fragmentation is needed.

Enabling the toggle button may cause performance degradation both in the network and in the sending or receiving Test Agents.

By default, the toggle button is disabled.

Ethernet frame size (Bytes)

Specify the size of Layer 2 Ethernet frame for the data flow.

Frame Size indicates the total size of the data frame sent from a remote endpoint to the Test agent as a response to a request.

Default—1518

Range—64 bytes through 9018 bytes

DSCP/IPP

Specify the Differentiated Services Code Point (DSCP) or the IP Precedence (IPP) value that is used in the IP packet headers.

DSCP is a six-bit binary value in the DS field of the IP header. DSCP value facilitates QoS for traffic management through the Best Effort, Assured Forwarding, Class Selector, and the Expedited Forwarding categories. See RFC 2474 for more information.

Default value—0

Range—0 through 63

VLAN priority (PCP)

Specify the value for the VLAN priority code point to be used in VLAN header.

Range—0 through 7

Thresholds for error seconds (ES)

Loss (%)

Specify the loss percentage value. If the loss percentage exceeds the configured value, an errored-second is triggered.

Unit—Percentage (%)

Range—0.0% through 100.0%

Delay (ms)

Specify the threshold value for the minimum delay measured between the Test Agent client and server. If delay exceeds the defined value, an errored-seconds is raised.

Unit—Milliseconds (ms)

Minimum—0.0 ms

Jitter (ms)

Specify the maximum threshold value for delay variance (jitter) in UDP transaction.

Delay variation (DV) occurs when different packets take different amount of time to travel from a Test Agent to a remote endpoint.

Unit—Milliseconds (ms)

Minimum—0.0 ms

Expected DSCP

Specify the expected DSCP that must be in the frame when received by Test Agent.

If the received DSCP value does not match the configured value, an errored-second is raised.

Range—0 through 64

Thresholds for severely error seconds (SES)

Loss (%)

Specify the maximum allowable loss percentage value.

If the loss percentage exceeds the configured value, an errored-second is raised.

Unit—Percentage (%)

Range—0.0% through 100.0%

Delay (ms)

Specify the maximum allowable value for delay measurement.

If the delay between server and client exceeds the configured value during a one-second interval, a severely-error seconds is indicated.

Unit—Milliseconds (ms)

Minimum—0.0 ms

Jitter (ms)

Specify the maximum threshold value for delay variance (jitter).

Packets are sent at regular interval of time and if variation is experienced in consecutive packets, the Test Agent generates an errored-second event.

Unit—Milliseconds (ms)

Minimum—0.0 ms

Table 10: TWAMP/TWAMP Light Parameters
Parameter Description
General

Senders

Select one or more Test Agent interfaces on which you want to run the Test.

To select one or more Test Agent interfaces:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

The TWAMP/TWAMP Light plugin cannot be run on Test Agents associated with devices. To run TWAMP/TWAMP Light plugin on devices, use the RPM TWAMP/TWAMP Light plugin.

Reflectors

Specify the reflector address. A Test Agent application can run a Reflector plugin whereas a Test Agent that is associated with a device needs to be configured to run Reflector plugin.

When you click the text box, the Select reflectors page appears where you can add reflectors. On this page:

  • Reflector hostname—Specify the hostname for the reflector. The reflector receives the TWAMP request packets and reflect the packet back to the sender.

    Maximum length—64 characters

  • Test session port—Specify the destination port for the Test session.

    Range—0 through 65535

  • Control session port—Specify the port for the control session. If set to zero, TWAMP Light is used.

    Default value—0

    Range—0 through 65535

  • Source port for Test session port—Specify the port for the control session. If set to zero, TWAMP Light is used.

    Specify the source port value for the Test session.

    Default value—0

    Range—0 through 65535

  • Name—This text box is automatically populated based on the data you specified in the Reflector hostname text box.

Rate

Specify the rate at which the TWAMP sender will send test traffic.

The rate is calculated as the size of the request packet sent divided by the total request time.

Each Ethernet packet contains one frame.

Unit—Megabits per seconds (Mbit/s)

Range—0.0 Mbit/s through 10000.0 Mbit/s

Time sync

Select the time synchronization option.

Select Yes, if the clocks of Test Agent and the reflector are synchronized via Network Time Protocol (NTP) using external NTP servers.

Select No to disable the time synchronization option.

Select Inband to use the in-band synchronization algorithm.

Use hardware timestamping

Enable hardware timestamping, SO_TIMESTAMPING parameter, on TWAMP socket), if you want to use the network interface card (NIC) of Test Agents for delay and jitter measurements. 

If Test Agent NIC does not support it, an error message is displayed, and the measurement does not produce any delay metrics.

By default, the toggle button is disabled.

Thresholds for error seconds (ES)

Loss%

Specify the loss percentage value. If the loss percentage exceeds the configured value, an errored-second is raised.

The Loss percentage is calculated by comparing the total number of packets that were lost with the total number of packets that were sent from the Test Agent.

Unit—Percentage (%)

Default value—0.0 %

Range—0.0 % through 100.00 %

Delay

Specify the maximum tolerated value for delay.

If there is time synchronization, the threshold value applies only to one-way delay. If there is no time synchronization, the threshold applies to round-trip delay. If delay exceeds the defined value, an errored-second is raised.

Unit—Milliseconds (ms)

Range—0.001 ms through 1000.0 ms

Delay Variation

Specify the maximum tolerated value for delay variance.

If there is time synchronization, it applies to one-way delay. If there is no time synchronization, it applies to round-trip delay. If delay exceeds the defined value, an errored-second is raised.

Unit—Milliseconds (ms)

Range—0.001 ms through 1000.0 ms

Expected DSCP Value

Specify the expected DSCP or IP Precedence value on the IP packets received from the reflector device.

If the received DSCP value does not match the configured value, an errored-second will be raised.

Range—0 through 63

Thresholds for severely error seconds (SES)

Loss

Specify the loss percentage value. If the loss percentage exceeds the configured value during a one-second interval, a severely errored-second is raised.

The Loss percentage is calculated by comparing the total number of packets that were lost with the total number of packets that were sent from the Test Agent.

Unit—Percentage (%)

Minimum value—0.0 %

Delay

Specify the maximum acceptable delay. If there is time synchronization, it applies to one-way delay. If there is no time synchronization, it applies to round-trip delay. If delay exceeds the defined value, a severely errored-second is raised.

Unit—Milliseconds (ms)

Minimum value—0.001 ms

Delay variation

Specify the maximum tolerated value for delay variance (jitter). If there is time synchronization, it applies to one-way delay. If there is no time synchronization, it applies to round-trip delay. If delay exceeds the defined value, a severely errored-second is raised.

Unit—Milliseconds (ms)

Minimum value—0.001 ms

Advanced

Frame Size

Specify the size of Layer 2 Ethernet frame size for the TWAMP test traffic.

Frame Size indicates the total size of the data frame sent from the Test Agent to the remote endpoint. The size also includes the header size.

Unit—Bytes

Default value—1518

Range—87 through 9018

DSCP

Specify the Differentiated Services Code Point (DSCP) or IP Precedence value that is used in the IP packet headers.

Default value—0

Range—0 through 63

Use random padding

Enable this to use random numbers or zeroes as padding in a TWAMP packet.

By default, the toggle button is enabled.

Socket priority

Specify the value of SO_PRIORITY parameter of the TWAMP socket.

Default value—0

Range—0 through 7

Socket send buffer size

Specify the value of SO_PRIORITY parameter of the TWAMP socket.

Unit—Bytes

Range—2048 through 10000000 bytes

Socket receive buffer size

Specify the value of SO_PRIORITY parameter of the TWAMP socket.

Unit—Bytes

Range—2048 through 10000000 bytes

Don't fragment flag

Enable the Don’t Fragment Flag (DF Flag) to restrict the fragmentation of the packets that exceed the MTU. DF Flag is configured in an IP header. Router drops the packet if fragmentation is needed.

Enabling this option may cause performance degradation both in the network and in the sending or receiving Test Agents.

By default, the toggle button is enabled.

UAS period length

Specify the minimum value for the consecutive severely errored-seconds (SES) that causes a period of unavailability.

The Unavailable Seconds (UAS) metric determines the number of seconds at which the service can be considered to be unavailable.

Unit—Seconds (s)

Default value—10 s

Range—0 s through 300 s

Accept UDP checksum zero for IPv6

Enable Accept UDP Checksum Zero for IPv6  to accept the UDP Checksum as Zero for IPv6 in TWAMP Reflector packets.

By default, the toggle button is enabled.

Percentiles

First delay percentile

Specify the first delay percentile of the value of the TWAMP request packet. If the delay exceeds the configured value, the packet is included in the defined first delay percentile slot.

Unit—Percentage (%)

Range—0 % through 1 %

Second delay percentile

Specify the second delay percentile of the value of the TWAMP request packet. If the delay exceeds the configured value, the packet is included in the defined second delay percentile slot.

Unit—Percentage (%)

Range—0 % through 1 %

Threshold for first delay percentile

Specify the threshold for triggering an errored second based on the first delay percentile.

Unit—Milliseconds (ms).

Range—0.001 ms through 1000.00 ms

Threshold for second delay percentile

Specify the threshold for triggering an errored second based on the second delay percentile.

Unit—Milliseconds (ms).

Range—0.001 ms through 1000.00 ms

SES threshold for first delay percentile

Specify the threshold for triggering a severely errored second based on the first delay percentile.

Unit—Milliseconds (ms).

Range—0.001 ms through 1000.00 ms

SES threshold for second delay percentile

Specify the threshold for triggering a severely errored second based on the second delay percentile.

Unit—Milliseconds (ms).

Range—0.001 ms through 1000.00 ms

Periodic Streams

Active period duration

Specify the time duration of each cycle during which ethernet frames are sent.

Active period is followed by a silent period during which no ethernet frames are sent.

Unit—Milliseconds (ms)

Range—1 ms to 3600000 ms

Active cycle

Specify the time duration of the cycle starting with an active period and ending with a silent period. The Active cycle duration must be at least equal to the active period duration.

Unit—Milliseconds (ms)

Range—1 ms to 604800 ms

Report metrics during inactive period

Enable the toggle button to report metrics related to inactive periods of a periodic Test.

By default, the toggle button is enabled.

Table 11: TWAMP Reflector Parameters
Parameter Description

General

Clients

Select one or more Test Agent interfaces on which you want to run the Test.

To select one or more Test Agent interfaces:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Test session port

Specify the destination port on which the TWAMP reflector listens.

Default value—7000

Range—1 through 65535

Rate threshold for ES

Specify the rate threshold for the combined rate for all sessions. If rate is below the threshold value, an errored-second is raised.

Unit—Megabits per seconds (Mbit/s)

Range—0.001 (Mbit/s) through 10000 (Mbit/s)

Standalone mode

Enable Standalone mode to push the metrics data to Paragon Automation.

By default, the toggle button is disabled.

Table 12: RPM HTTP Parameters
Parameter Description
General
Clients

Select one or more interfaces of the network devices on which you want to run a Test.

To select one or more network devices as client values:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

    Note:

    The Test Agent filter is not functional as the RPM plugins directly interact with the devices.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

URLs

Specify the URL or host towards which the router sends HTTP Get requests.

Maximum length—255 characters

Time between requests

Specify the time taken between successive HTTP requests initiated by the router.

Unit—Seconds (s)

Default value—10 s

Range—1 s to 255 s

Advanced

Collection Interval

Specify the collection interval.

Collection interval is the frequency at which the results are collected from the device. Collection interval must be larger than the specified Time between requests.

Unit—Seconds (s)

Default value—15 s

Range—5 s through 300 s

Device response timeout

Specify the device response timeout value.

Device response timeout determines the time to wait for a response from the router. If the specified time exceeds, the connection to the device is considered to be failed.

Device response timeout must be larger than the specified Collection Interval.

Unit—Seconds (s)

Default value—200 s

Range—30 s through 300 s

Routing instance

Specify the name of routing instance on the router used by the probes.

TTL

Specify the number of times the packets hop before a device discards the packet.

Time to live (TTL) value indicates lifespan of a request packet. TTL prevents infinite loop in a network when the packet fails to reach the destination.

Default value—64.

Range—1 through 254.

Metadata get

Enable Metadata get for the Test to perform HTTP Get requests for metadata to a target URL.

By default, the toggle button is disabled.

IPv6 local link

Specify the router link-local logical interface name for the egress interface to be used. This applies only for Test sessions with IPv6 address as the target address.

Maximum length—64 characters

Hardware timestamp

Specify the router link-local logical interface name for the egress interface to be used. This applies only for Test sessions with IPv6 address as the target address.

By default, the toggle button is disabled.

Table 13: RPM PING Parameters
Parameter Description
General
Client

Select one or more interfaces of the network devices on which you want to run a Test.

To select one or more network devices as client values:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

    Note:

    The Test Agent filter is not functional as the RPM plugins directly interact with the devices.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Hosts

Specify the target hostname or IP address.

When you click the text box, the Select Host page appears where you can enter hostnames. To add more than one Hosts, click + Add Host and specify the following:

  • Host—The hostname or the IP address of the remote endpoint.

    Maximum length—255 characters.

  • Name—The text box is automatically populated based on the data you specified in the Host text box.

Time between requests

Specify the time taken between successive ping requests initiated by the router.

Unit—Seconds (s)

Default value—10 s

Range—1 s through 255 s

Advanced

Collection interval

Specify the collection interval.

Collection interval is the frequency at which the results are collected from the device. Collection interval must be larger than the specified Time between requests.

Unit—Seconds (s)

Default value—15 s

Range—5 s through 300 s

Device response timeout

Specify the device response timeout value.

Device response timeout determines the time to wait for a response from the router. If the specified time is exceeded, the connection to the device is considered failed. Device response timeout must be larger than the specified Collection Interval.

Unit—Seconds (s)

Default value—200 s

Range—30 s through 300 s

Routing instance

Specify the name of routing instance on the router used by the probes.

Data size

Specify the size of the data portion of the request packet sent from the router.

Default value—0

Range—0 through 65400

Data fill

Specify the contents of the data portion of the request packets sent from the router.

The value should be in hexadecimal format.

TTL

Specify the number of times the packets hop before a device discards the packet.

Time to live (TTL) value indicates lifespan of a request packet. TTL prevents infinite loop in a network when the packet fails to reach the destination.

For example, if you have entered the TTL value as 64, every time the packet passes a device, the value is reduced by one until the packet reaches the remote server. If the entered value reaches zero before reaching the remote endpoint, the packet is discarded.

Default value—64

Range—1 through 254

DSCP code points

Specify the Differentiated Services Code Point (DSCP) value that is used in the IP packet headers. 

Maximum length—64 characters

Hardware timestamp

Enable hardware timestamping of RPM probe messages in the Packet Forwarding Engine host processor on the router.

In case of ping plugin, you can enable timestamping of RPM messages in the Packet Forwarding Engine host processor.

By default, the toggle button is disabled.

Ping timestamp

Enable ping timestamp to perform ICMP timestamp requests instead of ICMP echo requests.

By default, the toggle button is disabled.

One way hardware timestamp

Enable the one-way hardware timestamping for one-way measurements (delay and jitter)

By default, the toggle button is disabled.

IPv6 local link

Specify the router link-local logical interface name for the egress interface to be used. This applies only for Test sessions with IPv6 address as the target address.

Maximum length—64 characters

Table 14: RPM TCP Parameters
Parameter Description
General
Client

Select one or more interfaces of the network devices on which you want to run a Test.

To select one or more network devices as client values:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

    Note:

    The Test Agent filter is not functional as the RPM plugins directly interact with the devices.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Servers

Specify the hostname or the IP address of the remote endpoint.

When you click the text box, the Select server page appears where you can enter details. To add more than one servers, click + Add Server and specify the following:

  • Remote IP or hostname—The hostname or the IP address of the remote endpoint.

    Maximum length—255 characters

  • Remote TCP port—Specify the port number of TCP.

    Default value—7

    Range—7 through 65535

Time between requests

Specify the time taken between successive TCP requests initiated by the router.

Unit—Seconds (s)

Default value—10 s

Range—1 s through 255 s

Advanced

Collection interval

Specify the collection interval. 

Collection interval is the frequency at which the results are collected from the device. Collection interval must be larger than the specified Time between requests.

Unit—Seconds (s)

Default value—15 s

Range—5 s through 300 s

Device response timeout

Specify the device response timeout value.

Device response timeout determines the time to wait for a response from the router. If the specified time is exceeded, the connection to the device is considered failed. Device response timeout must be larger than the specified Collection Interval.

Unit—Seconds (s)

Default value—200 s

Range—30 s through 300 s

Routing instance

Specify the name of routing instance on the router used by the request packets.

Maximum value—64

Data size

Specify the size of the data portion of the request packets sent from the router.

Default value—0

Range—0 through 65400

Data fill

Specify the contents of the data portion of the request packets sent from the router.

The value should be in hexadecimal format.

TTL

Specify the number of times the packets hop before a device discards the packet.

Time to live (TTL) value indicates lifespan of a request packet. TTL prevents infinite loop in a network when the packet fails to reach the destination.

For example, if you have entered the TTL value as 64, every time the packet passes a device, the value is reduced by one until the packet reaches the remote server. If the entered value reaches zero before reaching the remote endpoint, the packet is discarded.

Default value—64

Range—1 through 254

DSCP code points

Specify the Differentiated Services Code Point (DSCP) value that is used in the IP packet headers.

Maximum length—64 characters

IPv6 Local Link

Specify the router link-local logical interface name for the egress interface to be used. This applies only for Test sessions with IPv6 address as the target address.

Maximum length—64 characters

Table 15: RPM TWAMP Parameters
Parameter Description
General
Clients

Select one or more interfaces of the network devices on which you want to run a Test.

To select one or more network devices as client values:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

    Note:

    The Test Agent filter is not functional as the RPM plugins directly interact with the devices.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Host

Specify IPv4 or IPv6 Address of TWAMP reflector.

When you click the text box, the Select reflectors page appears where you can add reflectors. On this page:

  • Reflector hostname—Specify the hostname for the reflector.

    Maximum length—64 characters

  • Test session port—Specify IPv4 or IPv6 Address of TWAMP reflector.

    Range—0 through 65535

  • Control session port—Specify the port for the control session. If the port value is zero, it is for TWAMP Light, and if port value is in the range of 862-65535, it is for managed TWAMP.

    Default value—0

    Range—0 through 65535

  • Source port for Test session port—Specify the source port value for the Test session.

    Default value—0

    Range—0 through 65535

  • Name—The text box is automatically populated based on the data you specified in the Reflector hostname text box.

Time between requests

Specify the time taken between successive TWAMP requests initiated by the router.

Unit—Seconds (s)

Default value—10 s

Range—1 s through 255 s

Advanced

Collection interval

Specify the collection interval.

Collection interval is the frequency at which the results are collected from the device. Collection interval must be larger than the specified Time between requests.

Unit—Seconds (s)

Default value—15 s

Range—5 s through 300 s

Device response timeout

Specify the device response timeout value.

Device response timeout determines the time to wait for a response from the router. If the specified time is exceeded, the connection to the device is considered failed. Device response timeout must be larger than the specified Collection Interval.

Unit—Seconds (s)

Default value—200 s

Range—30 s through 300 s

Routing instance

Specify the name of routing instance on the router used by the request packets.

Maximum value—64

Zero fill

Enable Zero Fill to populate the content for the request packet with zeros.

Data size

Specify the size of the data portion of the request packets sent from the router.

Default value—60.

Range—60 to 1400.

TTL

Specify the number of times the packets hop before a device discards the packet.

Time to live (TTL) value indicates lifespan of a request packet. TTL prevents infinite loop in a network when the packet fails to reach the destination.

For example, if you have entered the TTL value as 64, every time the packet passes a device, the value is reduced by one until the packet reaches the remote server. If the entered value reaches zero before reaching the remote endpoint, the packet is discarded.

Default value—64

Range—1 to 254

DSCP Code Points

Specify the Differentiated Services Code Point (DSCP) value that is used in the IP packet headers.

Maximum length—64 characters

IPv6 Local Link

Specify the router link-local logical interface name for the egress interface to be used. This applies only for Test sessions with IPv6 address as the target address.

Maximum length—64 characters

PFE timestamping

Enable PFE timestamping to perform timestamping on Packet Forward Engine host.

By default, the toggle button is disabled.

Table 16: RPM UDP Parameters
Parameter Description
General
Clients

Select one or more interfaces of the network devices on which you want to run a Test.

To select one or more network devices as client values:

  1. Click the Clients text box.

    The Test Agent/Interfaces choices page appears.

  2. Select one or more Test Agent interfaces. For information on filtering Test Agent interfaces, see Search for Test Agent interfaces by using Filters.

  3. Click OK.

Note:

On the Test Agent/Interfaces choices page, you can filter the Test Agent interfaces based on the following criteria:

  • Interface name or the Test Agent name, or both.

    Based on your requirement, you can select or deselect Test Agents or Interfaces.

    Note:

    The Test Agent filter is not functional as the RPM plugins directly interact with the devices.

  • IPv4 address (with or without IPv4 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv4 or No IPv4 to view or hide the interfaces that are associated with the IPv4 family and the interfaces that are not associated with the IPv4 family.

  • IPv6 address (with or without IPv6 addresses) of a Test Agent.

    Based on your requirement, you can select or deselect IPv6 or No IPv6 to view or hide the interfaces that are associated with the IPv6 family and the interfaces that are not associated with the IPv6 family.

  • Deployment type of a Test Agent:

    • Application—Filter out the Test Agents deployed in a device as an application.

    • Device—Filter out the Test Agents associated with a device.

    Based on your requirement, you can select or deselect Application or Device to view or hide the Test Agents deployed in a device as an application or the Test Agents associated with a device.

  • Connection types between the interface and the router:

    • Link—Indicates that the status is Up and there is an active connection for the interface.

    • No Link—Indicates that the status is Down and there is no active connection for the interface.

    Based on your requirement, you can select or deselect Link or No Link.

  • Connection statuses of the Test Agent:

    • Online—The Test Agent is connected to Paragon Automation.

    • Offline—The Test Agent is not connected to Paragon Automation.

      When the interface supports RPM plugins, the interface contains (On device) at the end of its name indicating the Device Online status.

      When the interface supports only the normal plugins, the interface will not display (On device) at the end of its name, and the status refers to the Online status.

    Based on your requirement, you can select or deselect Online or Offline.

  • Interface types of the Test Agent:

    • Normal—Network interfaces that are used for testing traffic.

    • Management—Network interfaces used by the Test Agents to connect to Paragon Automation.

    • Unknown—Network interfaces that the Test Agent is unable to identify or that have been removed.

    Based on your requirement, you can select or deselect Normal, Management, or Unknown.

You can enable the Display Device Names toggle button to display the hostnames of the routers that are associated with the Test Agents.

You can also enable the Hide unsupported toggle button to hide devices that are not supported by the plugin you have selected.

To search for a specific interface or a Test Agent, enter one or more keywords in the search text box. You can search based on the name, description, IP and MAC address of the interfaces or the Test Agents. You can also search based on the device name, device model, and device MAC addresses if searching for a Test Agent associated with the device.

You can also hover over an interface name to view the details such as the Test Agent name, bind interface, bind family, and to check if the Test Agent is run on a device or not.

You can also remove the interface filters you have selected and reset the filters to the default mode by using the Reset filters button.

Servers

Specify the remote IP address or hostname of the server to which Test Agents send the requests.

When you click the text box, the Select server page appears where you can enter details. To add more than one servers, click + Add Server and specify the following:

  • Servers—Specify the hostname or the IP address of the remote endpoint.

    Maximum length—255 characters.

  • Remote TCP port—Specify the port number of UDP.

    Default value—7.

    Range—7 through 65535.

Time Between Requests

Specify the time taken between successive UDP requests initiated by the routers.

Unit—Seconds (s).

Default value—10 s.

Range—1 s through 255 s.

Remote port

Configure the remote port number for the Test sessions.

Default value—7.

Range—7 through 65535.

Advanced

Collection Interval

Specify the collection interval.

Collection interval is the frequency at which the results are collected from the remote endpoint or the device. Collection interval must be larger than the specified Time between requests.

Unit—Seconds (s).

Default value—15 s.

Range—5 s through 300 s.

Device Response Timeout

Specify the device response timeout value.

Device response timeout determines the time to wait for a response from the router. If the specified time is exceeded, the connection to the device is considered failed. Device response timeout must be larger than the specified Collection Interval.

Unit—Seconds (s).

Default value—200 s.

Range—30 s through 300 s.

Routing instance

Specify the name of routing instance on the router used by the probes.

Maximum value—64.

Data Size

Specify the size of the data portion of the request packets sent from the router.

Default value—0.

Range—0 through 65400.

Data fill

Specify the contents of the data portion of the request packets sent from the router. The value should be in hexadecimal format.

The value should be in hexadecimal format.

TTL

Specify the number of times the packets hop before a device discards the packet.

Time to live (TTL) value indicates lifespan of a request packet. TTL prevents infinite loop in a network when the packet fails to reach the destination.

For example, if you have entered the TTL value as 64, every time the packet passes a device, the value is reduced by one until the packet reaches the remote server. If the entered value reaches zero before reaching the remote endpoint, the packet is discarded.

Default value—64.

Range—1 through 254.

DSCP Code Points

Specify the Differentiated Services Code Point (DSCP) value that is used in the IP packet headers.

Maximum length—64 characters.

Hardware Timestamp

Enable hardware timestamping of RPM probe messages in the Packet Forwarding Engine host processor on the router.

By default, the toggle button is disabled.

Ping Timestamp

Enable ping timestamping to send UDP timestamp requests.

By default, the toggle button is disabled.

One Way Hardware Timestamp

Enable the one-way hardware timestamping for one-way delay and jitter measurements.

By default, the toggle button is disabled.

IPv6 Local Link

Specify the router link-local logical interface name for the egress interface to be used. This applies only for Test sessions with IPv6 address as the target address.

Maximum length—64 characters.

Table 17: Evaluation Criteria
Field Description

Field

Select the type of metric that you want to evaluate from the drop-down list.

The metrics listed in this drop-down depends on the Task you select.

The metrics will be displayed as stream graphs in the Stream-Name Details page.

Comparator

Select the type of comparator that you want to use for the evaluation.

You can choose among the following comparators—==(equal to), != (not equal to), < (less than), <= (less than or equal to), > (greater than), >= (greater than or equal to).

For example, if you have used > (greater than) comparator, and if you have specified 3000 ms in the Value text box, then an event is raised if the value exceeds 3000 ms.

Value

Specify the threshold value that you want to evaluate. On violation of any configured threshold value, an event is generated.

Severity

Select the severity level of the event that is raised when there is a threshold violation. The severity levels are:

Debug—Indicates that the event needs troubleshooting.

Info—Indicates that it is an informational event and does not require immediate attention.

Warning—Indicates that the event needs to be reviewed but does not require immediate attention.

Error—Indicates that the event needs to be reviewed and requires immediate attention.

Critical—Indicates that the event is major and needs immediate attention.

When an event is raised, the severity level you have selected will be displayed in the Events bar of the Test-Name page.

Name

Specify the name for the evaluation criteria.

Description

Specify the description to be displayed when there is a threshold violation. If you do not specify the description, the default description generated by Paragon Automation is displayed.

When an event is raised, the description you have specified here will be displayed in the Events bar of the Test-Name page.

Raise Delay

Specify the duration that the Paragon Automation waits before triggering an event.

If the number of seconds exceeds the configured Raise delay value, then an event is triggered. The triggered event is displayed in the Events bar of the Test-Name page.

Clear Delay

Specify the duration of time after which an event is cleared if the threshold is not violated.

If the threshold has not exceeded the configured Clear delay value, then the event is cleared.