Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

TechLibrary
Navigation
Table of Contents
Guide That Contains This Content
[+] Expand All
[-] Collapse All

    Distributed Service Resource Allocation with Containerized Contrail

    Starting with Contrail Release 4.0, the existing centralized Contrail discovery service is replaced with a distributed method of allocating service resources.

    Replacement of Centralized Discovery Service in Contrail 4.0

    In Contrail releases prior to Release 4.0, the Contrail discovery service is a centralized service resource allocation module with high availability, used primarily to automatically load-balance service resources in the system.

    In the previous centralized discovery method, new service resources are registered (published) directly to the Contrail discovery module and allocated to the requester (subscriber) of the service resource, without disrupting the running state of the subscribers.

    The centralized discovery method requires using a database to:

    • synchronize across Contrail discovery nodes.
    • maintain the list of publishers, subscribers, and the health of published services across reloads.
    • provide a centralized view of the service allocation and health of the services.

    This centralized discovery method resulted in unnecessary system churn when services were falsely marked as down, due to periodic health updates of services made to the database nodes, resulting in reallocation of healthy services.

    Starting with Contrail 4.0, the Contrail discovery services centralized resource allocation manager has been removed. Its replacement is a distributed resource allocation list of service nodes, maintained in each module of the system.

    New Distributed Resource Allocation Manager

    Starting with Contrail Release 4.0, service resources are managed with a distributed allocation manager, with the following features:

    • Each system module is provisioned with a list of service nodes (publishers).
    • Each system module randomizes the list of service nodes and uses the resources. The randomized list is expected to be fairly load-balanced.
    • When currently-used services are down, the system module detects the down immediately and reacts with no downtime by selecting another service from the list. This is distinctly different from the previous model, in which the module would need to contact the discovery service to check for available services, resulting in a finite time loss for allocation, distribution, and application of a new set of services.
    • When service nodes are added or deleted, the system administrator updates the configuration file of all daemons using the service type of the service node added or deleted, sending a SIGHUP to the respective daemons.
    • Each daemon randomizes the service list independently and reallocates the resources.

    Deprecation of IF-MAP

    In Contrail 4.0, the Interface for Metadata Access Points (IF-MAP) methodology has been deprecated. Contrail 4.0 uses CONFIGDB sections in configuration files instead of IF-MAP sections.

    Changes in Configuration Files

    Table 1 lists configuration files in the Contrail system that have changes to enable the distributed service resource allocation system, starting with Contrail 4.0. In general, the changes include removing (deprecating) discovery server sections and subsections, and adding parameters needed to identify service resources in all modules.

    Each daemon randomizes the published service list and uses the resources. Additionally, each daemon provides a SIGHUP handler to manage the addition or deletion of publishers.

    Table 1: Contrail 4.0 Changes in Configuration Files

    Configuration File

    Configuration Parameter

    Changes

    contrail-vrouter-agent.conf

    [DISCOVERY]

    Section deprecated

    [CONTROL-NODE].servers

    Provisioned list of control-node [role=control] service providers in the format:
    ip-address:port ip-address2:port
    Example: 10.1.1.1:5269 10.1.1.12:5269

    [DNS].servers

    Provisioned list of DNS [role=control] service providers in the format:

    ip-address:port ip-address2:port
    Example: 10.1.1.1:53 10.1.1.2:5

    [DEFAULT].collectors

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-control.conf

    [DISCOVERY]

    Section deprecated

     

    [DEFAULT].collectors

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:8086 10.1.1.2:8086

     

    [CONFIGDB].rabbitmq_server_list

    Provisioned list of config-node [role=cfgm] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:5672 10.1.1.2:5672

     

    [CONFIGDB].rabbitmq_user

    guest (default string)

     

    [CONFIGDB].rabbitmq_password

    guest (default string)

     

    [CONFIGDB].config_db_server_list

    Provisioned list of Config DB [role=database] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:9042 10.1.1.2:9042

    NOTE: Docker uses 9041 as port

    [CONFIGDB].certs_store

    Deprecated

    [CONFIGDB].password

    Deprecated

    [CONFIGDB].server_url

    Deprecated

    [CONFIGDB].user

    Deprecated

    [CONFIGDB].stale_entries_cleanup_timeout

    Deprecated

    [CONFIGDB].end_of_rib_timeout

    Deprecated

    contrail-dns.conf

    [DISCOVERY]

    Deprecated

    [DEFAULT].collectors

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:8086 10.1.1.2:8086

    [CONFIGDB].rabbitmq_server_list

    Provisioned list of config-node [role=cfgm] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:5672 10.1.1.2:5672

    [CONFIGDB].rabbitmq_user

    guest (default string)

    [CONFIGDB].rabbitmq_password

    guest (default string)

    [CONFIGDB].config_db_server_list

    Provisioned list of Config DB [role=database] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:9042 10.1.1.2:9042 NOTE: Dockers use 9041 as port

    [CONFIGDB].certs_store

    Deprecated

    [CONFIGDB].password

    Deprecated

    [CONFIGDB].server_url

    Deprecated

    [CONFIGDB].user

    Deprecated

    [CONFIGDB].stale_entries_cleanup_timeout

    Deprecated

    [CONFIGDB].end_of_rib_timeout

    Deprecated

    contrail-collector.conf

    [DISCOVERY]

    Deprecated

    [API_SERVER].api_server_list

    Provisioned list of api-servers [role=config] in the format:

    ip-address:port

    Example: 10.1.1.1:8082 10.1.1.2:8082

    contrail-alarm-gen.conf

    [DISCOVERY]

    Deprecated

    [DEFAULTS].collectors

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    [API_SERVER].api_server_list

    Provisioned list of api-servers [role=config] in the format:

    ip-address:port

    Example: 10.1.1.1:8082 10.1.1.2:8082

    [REDIS].redis_uve_list

    Provisioned list of redis instances [role=collector]

    Example: 192.168.0.29:6379 192.168.0.30:6379

    contrail-analytics-api.conf

    [DISCOVERY]

    Section deprecated

    [DEFAULTS].collectors

    Provisioned list of collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    [REDIS].redis_uve_list

    Provisioned list of redis instances [role=collector]

    Example: 192.168.0.29:6379 192.168.0.30:6379

    contrail-api.conf

    [DISCOVERY]

    Section deprecated

    [DEFAULTS].collectors

    Provisioned list of collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-schema.conf

    [DISCOVERY]

    Section deprecated

    [DEFAULTS].collectors

    Provisioned list of Collector [role=collector] service providers in ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-svc-monitor.conf

    [DISCOVERY]

    Section deprecated

    [DEFAULTS].collectors

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-device-manager.conf

    [DISCOVERY]

    Section deprecated

    [DEFAULTS].collectors

    Provisioned list of Collector [role=collector] service providers in ip-address:port ip-address2:port format

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-analytics-nodemgr.conf

    [DISCOVERY]

    Section deprecated

    [COLLECTOR].server_list

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-config-nodemgr.conf

    [DISCOVERY]

    Section deprecated

    [COLLECTOR].server_list

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-control-nodemgr.conf

    [DISCOVERY]

    Section deprecated

    [COLLECTOR].server_list

    Provisioned list of Collector [role=collector] service providers in ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-database-nodemgr.conf

    [DISCOVERY]

    Section deprecated

    [COLLECTOR].server_list

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-vrouter-nodemgr.conf

    [DISCOVERY]

    Section deprecated

    [COLLECTOR].server_list

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-query-engine.conf

    [DISCOVERY]

    Section deprecated

    [COLLECTOR].server_list

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    contrail-snmp-collector.conf

    [DISCOVERY]

    Section deprecated

    [DEFAULTS].collectors

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port

    Example: 10.1.1.1:8086 10.1.1.2:8086

    [API_SERVER].api_server_list

    Provisioned list of api-servers [role=config] in the format:

    ip-address:port

    Example: 10.1.1.1:8082 10.1.1.2:8082

    contrail-topology.conf

    [DISCOVERY]

    Section deprecated

    [DEFAULTS].collectors

    Provisioned list of Collector [role=collector] service providers in the format:

    ip-address:port ip-address2:port Example: 10.1.1.1:8086 10.1.1.2:8086

    [API_SERVER].api_server_list

    Provisioned list of api-servers [role=config] in ip-address:port

    Example: 10.1.1.1:8082 10.1.1.2:8082

    Contrail Web UI

    config.global.js

    config.discovery.server

    Discovery subsection deprecated

    config.discovery.port

    Discovery subsection deprecated

    config.cnfg.server_ip

    Provisioned list of Config [role=cfgm] service providers as list of ip-address

    Example: ['10.1.1.1 10.1.1.2']

    config.cnfg.server_port

    Server port as a string

    Example: '8082'

    config.analytics.server_ip

    Provisioned list of Collector [role=collector] service providers as a list of ip-address

    Example: ['10.1.1.1 10.1.1.2']

    config.analytics.server_port

    Server port as a string

    Example: '8081'

    config.dns.server_ip

    Provisioned list of Controller [role=control] service providers as a list of ip-address

    Example: ['10.1.1.1 10.1.1.2']

    config.dns.server_port

    Server port as a string

    Example: '8092'

    Modified: 2017-06-05

    Previous Page Next Page