Figure 7 shows a standard MPLS VPN network. Routers CE1 and CE2 are customer edge routers, PE1 and PE2 are provider edge routers, and P0 is a provider core router. Several Layer 3 VPNs are configured across this network, as well as one Layer 2 VPN. Interfaces are shown in the diagram and are not included in the configuration example that follows.
Figure 7: Layer 3 VPN Graceful Restart Topology

Router CE1
On Router CE1, configure the following protocols on the logical interfaces of t3-3/1/0: OSPF on unit 101, RIP on unit 102, BGP on unit 103, and IS-IS on unit 512. Also configure graceful restart, BGP, IS-IS, OSPF, and RIP on the main instance to be able to connect to the routing instances on Router PE1.
- [edit]
- interfaces {
-
- t3-3/1/0 {
- encapsulation frame-relay;
-
- unit 100 {
- dlci 100;
-
- family inet {
- address 10.96.100.2/30;
- }
- }
-
- unit 101 {
- dlci 101;
-
- family inet {
- address 10.96.101.2/30;
- }
- }
-
- unit 102 {
- dlci 102;
-
- family inet {
- address 10.96.102.2/30;
- }
- }
-
- unit 103 {
- dlci 103;
-
- family inet {
- address 10.96.103.2/30;
- }
- }
-
- unit 512 {
- dlci 512;
-
- family inet {
- address 10.96.252.1/30;
- }
- }
- }
-
- lo0 {
-
- unit 0 {
-
- family inet {
- address 10.245.14.172/32;
- primary;
- }
- address 10.96.110.1/32;
- address 10.96.111.1/32;
- address 10.96.112.1/32;
- address 10.96.113.1/32;
- address 10.96.116.1/32;
- }
-
- family iso {
- address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4172.00;
- }
- }
- }
- routing-options {
- graceful-restart;
- autonomous-system 65100;
- }
- protocols {
-
- bgp {
-
- group CE-PE-INET {
- type external;
- export BGP_INET_LB_DIRECT;
-
- neighbor 10.96.103.1 {
- local-address 10.96.103.2;
-
- family inet {
- unicast;
- }
- peer-as 65103;
- }
- }
- }
-
- isis {
- export ISIS_L2VPN_LB_DIRECT;
- interface t3-3/1/0.512;
- }
-
- ospf {
- export OSPF_LB_DIRECT;
-
- area 0.0.0.0 {
- interface t3-3/1/0.101;
- }
- }
-
- rip {
-
- group RIP {
- export RIP_LB_DIRECT;
- neighbor t3-3/1/0.102;
- }
- }
- }
- policy-options {
-
- policy-statement OSPF_LB_DIRECT {
-
- term direct {
-
- from {
- protocol direct;
- route-filter 10.96.101.0/30 exact;
- route-filter 10.96.111.1/32 exact;
- }
- then accept;
- }
-
- term final {
- then reject;
- }
- }
-
- policy-statement RIP_LB_DIRECT {
-
- term direct {
-
- from {
- protocol direct;
- route-filter 10.96.102.0/30 exact;
- route-filter 10.96.112.1/32 exact;
- }
- then accept;
- }
-
- term final {
- then reject;
- }
- }
-
- policy-statement BGP_INET_LB_DIRECT {
-
- term direct {
-
- from {
- protocol direct;
- route-filter 10.96.103.0/30 exact;
- route-filter 10.96.113.1/32 exact;
- }
- then accept;
- }
-
- term final {
- then reject;
- }
- }
-
- policy-statement ISIS_L2VPN_LB_DIRECT {
-
- term direct {
-
- from {
- protocol direct;
- route-filter 10.96.116.1/32 exact;
- }
- then accept;
- }
-
- term final {
- then reject;
- }
- }
- }
Router PE1
On Router PE1, configure graceful restart in the master instance, along with BGP, OSPF, MPLS, and LDP. Next, configure several protocol-specific instances of graceful restart. By including instances for BGP, OSPF, Layer 2 VPNs, RIP, and static routes, you can observe the wide range of options available when you implement graceful restart. Configure the following protocols in individual instances on the logical interfaces of t3-0/0/0: a static route on unit 100, OSPF on unit 101, RIP on unit 102, BGP on unit 103, and Frame Relay on unit 512 for the Layer 2 VPN instance.
- [edit]
- interfaces {
-
- t3-0/0/0 {
- dce;
- encapsulation frame-relay-ccc;
-
- unit 100 {
- dlci 100;
-
- family inet {
- address 10.96.100.1/30;
- }
- family mpls;
- }
-
- unit 101 {
- dlci 101;
-
- family inet {
- address 10.96.101.1/30;
- }
- family mpls;
- }
-
- unit 102 {
- dlci 102;
-
- family inet {
- address 10.96.102.1/30;
- }
- family mpls;
- }
-
- unit 103 {
- dlci 103;
-
- family inet {
- address 10.96.103.1/30;
- }
- family mpls;
- }
-
- unit 512 {
- encapsulation frame-relay-ccc;
- dlci 512;
- }
- }
-
- t1-0/1/0 {
-
- unit 0 {
-
- family inet {
- address 10.96.0.2/30;
- }
- family mpls;
- }
- }
-
- lo0 {
-
- unit 0 {
-
- family inet {
- address 10.245.14.176/32;
- }
-
- family iso {
- address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4176.00;
- }
- }
- }
- }
- routing-options {
- graceful-restart;
- router-id 10.245.14.176;
- autonomous-system 69;
- }
- protocols {
-
- mpls {
- interface all;
- }
-
- bgp {
-
- group PEPE {
- type internal;
-
- neighbor 10.245.14.182 {
- local-address 10.245.14.176;
-
- family inet-vpn {
- unicast;
- }
-
- family l2vpn {
- unicast;
- }
- }
- }
- }
-
- ospf {
-
- area 0.0.0.0 {
- interface t1-0/1/0.0;
-
- interface fxp0.0 {
- disable;
- }
-
- interface lo0.0 {
- passive;
- }
- }
- }
-
- ldp {
- interface all;
- }
- }
- policy-options {
-
- policy-statement STATIC-import {
- from community STATIC;
- then accept;
- }
-
- policy-statement STATIC-export {
-
- then {
- community add STATIC;
- accept;
- }
- }
-
- policy-statement OSPF-import {
- from community OSPF;
- then accept;
- }
-
- policy-statement OSPF-export {
-
- then {
- community add OSPF;
- accept;
- }
- }
-
- policy-statement RIP-import {
- from community RIP;
- then accept;
- }
-
- policy-statement RIP-export {
-
- then {
- community add RIP;
- accept;
- }
- }
-
- policy-statement BGP-INET-import {
- from community BGP-INET;
- then accept;
- }
-
- policy-statement BGP-INET-export {
-
- then {
- community add BGP-INET;
- accept;
- }
- }
-
- policy-statement L2VPN-import {
- from community L2VPN;
- then accept;
- }
-
- policy-statement L2VPN-export {
-
- then {
- community add L2VPN;
- accept;
- }
- }
- community BGP-INET members target:69:103;
- community L2VPN members target:69:512;
- community OSPF members target:69:101;
- community RIP members target:69:102;
- community STATIC members target:69:100;
- }
- routing-instances {
-
- BGP-INET {
- instance-type vrf;
- interface t3-0/0/0.103;
- route-distinguisher 10.245.14.176:103;
- vrf-import BGP-INET-import;
- vrf-export BGP-INET-export;
-
- routing-options {
- graceful-restart;
- autonomous-system 65103;
- }
-
- protocols {
-
- bgp {
-
- group BGP-INET {
- type external;
- export BGP-INET-import;
-
- neighbor 10.96.103.2 {
- local-address 10.96.103.1;
-
- family inet {
- unicast;
- }
- peer-as 65100;
- }
- }
- }
- }
- }
-
- L2VPN {
- instance-type l2vpn;
- interface t3-0/0/0.512;
- route-distinguisher 10.245.14.176:512;
- vrf-import L2VPN-import;
- vrf-export L2VPN-export;
-
- protocols {# There is no graceful-restart statement for Layer 2 VPN instances.
-
- l2vpn {
- encapsulation-type frame-relay;
-
- site CE1-ISIS {
- site-identifier 512;
-
- interface t3-0/0/0.512 {
- remote-site-id 612;
- }
- }
- }
- }
- }
-
- OSPF {
- instance-type vrf;
- interface t3-0/0/0.101;
- route-distinguisher 10.245.14.176:101;
- vrf-import OSPF-import;
- vrf-export OSPF-export;
-
- routing-options {
- graceful-restart;
- }
-
- protocols {
-
- ospf {
- export OSPF-import;
-
- area 0.0.0.0 {
- interface all;
- }
- }
- }
- }
-
- RIP {
- instance-type vrf;
- interface t3-0/0/0.102;
- route-distinguisher 10.245.14.176:102;
- vrf-import RIP-import;
- vrf-export RIP-export;
-
- routing-options {
- graceful-restart;
- }
-
- protocols {
-
- rip {
-
- group RIP {
- export RIP-import;
- neighbor t3-0/0/0.102;
- }
- }
- }
- }
-
- STATIC {
- instance-type vrf;
- interface t3-0/0/0.100;
- route-distinguisher 10.245.14.176:100;
- vrf-import STATIC-import;
- vrf-export STATIC-export;
-
- routing-options {
- graceful-restart;
-
- static {
- route 10.96.110.1/32 next-hop t3-0/0/0.100;
- }
- }
- }
- }
Router P0
On Router P0, configure graceful restart in the main instance, along with OSPF, MPLS, and LDP. This allows the protocols on the PE routers to reach each other.
- [edit]
- interfaces {
-
- t3-0/1/3 {
-
- unit 0 {
-
- family inet {
- address 10.96.0.5/30;
- }
- family mpls;
- }
- }
-
- t1-0/2/0 {
-
- unit 0 {
-
- family inet {
- address 10.96.0.1/30;
- }
- family mpls;
- }
- }
-
- lo0 {
-
- unit 0 {
-
- family inet {
- address 10.245.14.174/32;
- }
-
- family iso {
- address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4174.00;
- }
- }
- }
- }
- routing-options {
- graceful-restart;
- router-id 10.245.14.174;
- autonomous-system 69;
- }
- protocols {
-
- mpls {
- interface all;
- }
-
- ospf {
-
- area 0.0.0.0 {
- interface t1-0/2/0.0;
- interface t3-0/1/3.0;
-
- interface fxp0.0 {
- disable;
- }
-
- interface lo0.0 {
- passive;
- }
- }
- }
-
- ldp {
- interface all;
- }
- }
Router PE2
On Router PE2, configure BGP, OSPF, MPLS, LDP, and graceful restart in the master instance. Configure the following protocols in individual instances on the logical interfaces of t1-0/1/3: a static route on unit 200, OSPF on unit 201, RIP on unit 202, BGP on unit 203, and Frame Relay on unit 612 for the Layer 2 VPN instance. Also configure protocol-specific graceful restart in all routing instances, except the Layer 2 VPN instance.
- [edit]
- interfaces {
-
- t3-0/0/0 {
-
- unit 0 {
-
- family inet {
- address 10.96.0.6/30;
- }
- family mpls;
- }
- }
-
- t1-0/1/3 {
- dce;
- encapsulation frame-relay-ccc;
-
- unit 200 {
- dlci 200;
-
- family inet {
- address 10.96.200.1/30;
- }
- family mpls;
- }
-
- unit 201 {
- dlci 201;
-
- family inet {
- address 10.96.201.1/30;
- }
- family mpls;
- }
-
- unit 202 {
- dlci 202;
-
- family inet {
- address 10.96.202.1/30;
- }
- family mpls;
- }
-
- unit 203 {
- dlci 203;
-
- family inet {
- address 10.96.203.1/30;
- }
- family mpls;
- }
-
- unit 612 {
- encapsulation frame-relay-ccc;
- dlci 612;
- }
- }
-
- lo0 {
-
- unit 0 {
-
- family inet {
- address 10.245.14.182/32;
- }
-
- family iso {
- address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4182.00;
- }
- }
- }
- }
- routing-options {
- graceful-restart;
- router-id 10.245.14.182;
- autonomous-system 69;
- }
- protocols {
-
- mpls {
- interface all;
- }
-
- bgp {
-
- group PEPE {
- type internal;
-
- neighbor 10.245.14.176 {
- local-address 10.245.14.182;
-
- family inet-vpn {
- unicast;
- }
-
- family l2vpn {
- unicast;
- }
- }
- }
- }
-
- ospf {
-
- area 0.0.0.0 {
- interface t3-0/0/0.0;
-
- interface fxp0.0 {
- disable;
- }
-
- interface lo0.0 {
- passive;
- }
- }
- }
-
- ldp {
- interface all;
- }
-
- policy-options {
-
- policy-statement STATIC-import {
- from community STATIC;
- then accept;
- }
-
- policy-statement STATIC-export {
-
- then {
- community add STATIC;
- accept;
- }
- }
-
- policy-statement OSPF-import {
- from community OSPF;
- then accept;
- }
-
- policy-statement OSPF-export {
-
- then {
- community add OSPF;
- accept;
- }
- }
-
- policy-statement RIP-import {
- from community RIP;
- then accept;
- }
-
- policy-statement RIP-export {
-
- then {
- community add RIP;
- accept;
- }
- }
-
- policy-statement BGP-INET-import {
- from community BGP-INET;
- then accept;
- }
-
- policy-statement BGP-INET-export {
-
- then {
- community add BGP-INET;
- accept;
- }
- }
-
- policy-statement L2VPN-import {
- from community L2VPN;
- then accept;
- }
-
- policy-statement L2VPN-export {
-
- then {
- community add L2VPN;
- accept;
- }
- }
- community BGP-INET members target:69:103;
- community L2VPN members target:69:512;
- community OSPF members target:69:101;
- community RIP members target:69:102;
- community STATIC members target:69:100;
- }
-
- routing-instances {
-
- BGP-INET {
- instance-type vrf;
- interface t1-0/1/3.203;
- route-distinguisher 10.245.14.182:203;
- vrf-import BGP-INET-import;
- vrf-export BGP-INET-export;
-
- routing-options {
- graceful-restart;
- autonomous-system 65203;
- }
-
- protocols {
-
- bgp {
-
- group BGP-INET {
- type external;
- export BGP-INET-import;
-
- neighbor 10.96.203.2 {
- local-address 10.96.203.1;
-
- family inet {
- unicast;
- }
- peer-as 65200;
- }
- }
- }
- }
- }
-
- L2VPN {
- instance-type l2vpn;
- interface t1-0/1/3.612;
- route-distinguisher 10.245.14.182:612;
- vrf-import L2VPN-import;
- vrf-export L2VPN-export;
-
- protocols {# There is no graceful-restart statement for Layer 2 VPN instances.
-
- l2vpn {
- encapsulation-type frame-relay;
-
- site CE2-ISIS {
- site-identifier 612;
-
- interface t1-0/1/3.612 {
- remote-site-id 512;
- }
- }
- }
- }
- }
-
- OSPF {
- instance-type vrf;
- interface t1-0/1/3.201;
- route-distinguisher 10.245.14.182:201;
- vrf-import OSPF-import;
- vrf-export OSPF-export;
-
- routing-options {
- graceful-restart;
- }
-
- protocols {
-
- ospf {
- export OSPF-import;
-
- area 0.0.0.0 {
- interface all;
- }
- }
- }
- }
-
- RIP {
- instance-type vrf;
- interface t1-0/1/3.202;
- route-distinguisher 10.245.14.182:202;
- vrf-import RIP-import;
- vrf-export RIP-export;
-
- routing-options {
- graceful-restart;
- }
-
- protocols {
-
- rip {
-
- group RIP {
- export RIP-import;
- neighbor t1-0/1/3.202;
- }
- }
- }
- }
-
- STATIC {
- instance-type vrf;
- interface t1-0/1/3.200;
- route-distinguisher 10.245.14.182:200;
- vrf-import STATIC-import;
- vrf-export STATIC-export;
-
- routing-options {
- graceful-restart;
-
- static {
- route 10.96.210.1/32 next-hop t1-0/1/3.200;
- }
- }
- }
- }
- }
Router CE2
On Router CE2, complete the Layer 2 and Layer 3 VPN configuration by mirroring the protocols already set on PE2 and CE1. Specifically, configure the following on the logical interfaces of t1-0/0/3: OSPF on unit 201, RIP on unit 202, BGP on unit 203, and IS-IS on unit 612. Finally, configure graceful restart, BGP, IS-IS, OSPF, and RIP on the main instance to be able to connect to the routing instances on PE2.
- [edit]
- interfaces {
-
- t1-0/0/3 {
- encapsulation frame-relay;
-
- unit 200 {
- dlci 200;
-
- family inet {
- address 10.96.200.2/30;
- }
- }
-
- unit 201 {
- dlci 201;
-
- family inet {
- address 10.96.201.2/30;
- }
- }
-
- unit 202 {
- dlci 202;
-
- family inet {
- address 10.96.202.2/30;
- }
- }
-
- unit 203 {
- dlci 203;
-
- family inet {
- address 10.96.203.2/30;
- }
- }
-
- unit 512 {
- dlci 512;
-
- family inet {
- address 10.96.252.2/30;
- }
- }
- }
-
- lo0 {
-
- unit 0 {
-
- family inet {
-
- address 10.245.14.180/32 {
- primary;
- }
- address 10.96.210.1/32;
- address 10.96.111.1/32;
- address 10.96.212.1/32;
- address 10.96.213.1/32;
- address 10.96.216.1/32;
- }
-
- family iso {
- address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4180.00;
- }
- }
- }
- }
- routing-options {
- graceful-restart;
- autonomous-system 65200;
- }
- protocols {
-
- bgp {
-
- group CE-PE-INET {
- type external;
- export BGP_INET_LB_DIRECT;
-
- neighbor 10.96.203.1 {
- local-address 10.96.203.2;
-
- family inet {
- unicast;
- }
- peer-as 65203;
- }
- }
- }
-
- isis {
- export ISIS_L2VPN_LB_DIRECT;
- interface t1-0/0/3.612;
- }
-
- ospf {
- export OSPF_LB_DIRECT;
-
- area 0.0.0.0 {
- interface t1-0/0/3.201;
- }
- }
-
- rip {
-
- group RIP {
- export RIP_LB_DIRECT;
- neighbor t1-0/0/3.202;
- }
- }
- }
- policy-options {
-
- policy-statement OSPF_LB_DIRECT {
-
- term direct {
-
- from {
- protocol direct;
- route-filter 10.96.201.0/30 exact;
- route-filter 10.96.211.1/32 exact;
- }
- then accept;
- }
-
- term final {
- then reject;
- }
- }
-
- policy-statement RIP_LB_DIRECT {
-
- term direct {
-
- from {
- protocol direct;
- route-filter 10.96.202.0/30 exact;
- route-filter 10.96.212.1/32 exact;
- }
- then accept;
- }
-
- term final {
- then reject;
- }
- }
-
- policy-statement BGP_INET_LB_DIRECT {
-
- term direct {
-
- from {
- protocol direct;
- route-filter 10.96.203.0/30 exact;
- route-filter 10.96.213.1/32 exact;
- }
- then accept;
- }
-
- term final {
- then reject;
- }
- }
-
- policy-statement ISIS_L2VPN_LB_DIRECT {
-
- term direct {
-
- from {
- protocol direct;
- route-filter 10.96.216.1/32 exact;
- }
- then accept;
- }
-
- term final {
- then reject;
- }
- }
- }
Router PE1 Status Before a Restart
The following example displays neighbor relationships on Router PE1 before a restart happens:
user@PE1> show bgp neighbor
Peer: 10.96.103.2+3785 AS 65100 Local: 10.96.103.1+179 AS 65103
Type: External State: Established Flags: <>
Last State: OpenConfirm Last Event: RecvKeepAlive
Last Error: None
Export: [ BGP-INET-import ]
Options: <Preference LocalAddress HoldTime GracefulRestart AddressFamily PeerAS Refresh>
Address families configured: inet-unicast
Local Address: 10.96.103.1 Holdtime: 90 Preference: 170
Number of flaps: 0
Peer ID: 10.96.110.1 Local ID: 10.96.103.1 Active Holdtime: 90
Keepalive Interval: 30
Local Interface: t3-0/0/0.103
NLRI for restart configured on peer: inet-unicast
NLRI advertised by peer: inet-unicast
NLRI for this session: inet-unicast
Peer supports Refresh capability (2)
Restart time configured on the peer: 120
Stale routes from peer are kept for: 300
Restart time requested by this peer: 120
NLRI that peer supports restart for: inet-unicast
NLRI peer can save forwarding state: inet-unicast
NLRI that peer saved forwarding for: inet-unicast
NLRI that restart is negotiated for: inet-unicast
NLRI of all end-of-rib markers sent: inet-unicast
Table BGP-INET.inet.0 Bit: 30001
RIB State: BGP restart is complete
RIB State: VPN restart is complete
Send state: in sync
Active prefixes: 0
Received prefixes: 0
Suppressed due to damping: 0
Last traffic (seconds): Received 8 Sent 3 Checked 3
Input messages: Total 15 Updates 0 Refreshes 0 Octets 321
Output messages: Total 18 Updates 2 Refreshes 0 Octets 450
Output Queue[2]: 0
Peer: 10.245.14.182+4701 AS 69 Local: 10.245.14.176+179 AS 69
Type: Internal State: Established Flags: <>
Last State: OpenConfirm Last Event: RecvKeepAlive
Last Error: None
Options: <Preference LocalAddress HoldTime GracefulRestart AddressFamily
Rib-group Refresh>
Address families configured: inet-vpn-unicast l2vpn
Local Address: 10.245.14.176 Holdtime: 90 Preference: 170
Number of flaps: 1
Peer ID: 10.245.14.182 Local ID: 10.245.14.176 Active Holdtime: 90
Keepalive Interval: 30
NLRI for restart configured on peer: inet-vpn-unicast l2vpn
NLRI advertised by peer: inet-vpn-unicast l2vpn
NLRI for this session: inet-vpn-unicast l2vpn
Peer supports Refresh capability (2)
Restart time configured on the peer: 120
Stale routes from peer are kept for: 300
Restart time requested by this peer: 120
NLRI that peer supports restart for: inet-vpn-unicast l2vpn
NLRI peer can save forwarding state: inet-vpn-unicast l2vpn
NLRI that peer saved forwarding for: inet-vpn-unicast l2vpn
NLRI that restart is negotiated for: inet-vpn-unicast l2vpn
NLRI of all end-of-rib markers sent: inet-vpn-unicast l2vpn
Table bgp.l3vpn.0 Bit: 10000
RIB State: BGP restart is complete
RIB State: VPN restart is complete
Send state: in sync
Active prefixes: 0
Received prefixes: 0
Suppressed due to damping: 0
Table bgp.l2vpn.0 Bit: 20000
RIB State: BGP restart is complete
RIB State: VPN restart is complete
Send state: in sync
Active prefixes: 1
Received prefixes: 1
Suppressed due to damping: 0
Table BGP-INET.inet.0 Bit: 30000
RIB State: BGP restart is complete
RIB State: VPN restart is complete
Send state: in sync
Active prefixes: 0
Received prefixes: 0
Suppressed due to damping: 0
Table OSPF.inet.0 Bit: 60000
RIB State: BGP restart is complete
RIB State: VPN restart is complete
Send state: in sync
Active prefixes: 0
Received prefixes: 0
Suppressed due to damping: 0
Table RIP.inet.0 Bit: 70000
RIB State: BGP restart is complete
RIB State: VPN restart is complete
Send state: in sync
Active prefixes: 0
Received prefixes: 0
Suppressed due to damping: 0
Table STATIC.inet.0 Bit: 80000
RIB State: BGP restart is complete
RIB State: VPN restart is complete
Send state: in sync
Active prefixes: 0
Received prefixes: 0
Suppressed due to damping: 0
Table L2VPN.l2vpn.0 Bit: 90000
RIB State: BGP restart is complete
RIB State: VPN restart is complete
Send state: in sync
Active prefixes: 1
Received prefixes: 1
Suppressed due to damping: 0
Last traffic (seconds): Received 28 Sent 28 Checked 28
Input messages: Total 2 Updates 0 Refreshes 0 Octets 86
Output messages: Total 13 Updates 10 Refreshes 0 Octets 1073
Output Queue[0]: 0
Output Queue[1]: 0
Output Queue[2]: 0
Output Queue[3]: 0
Output Queue[4]: 0
Output Queue[5]: 0
Output Queue[6]: 0
Output Queue[7]: 0
Output Queue[8]: 0
user@PE1> show route instance detail
master:
Router ID: 10.245.14.176
Type: forwarding State: Active
Restart State: Complete Path selection timeout: 300
Tables:
inet.0 : 17 routes (15 active, 0 holddown, 1 hidden)
Restart Complete
inet.3 : 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
iso.0 : 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete
mpls.0 : 19 routes (19 active, 0 holddown, 0 hidden)
Restart Complete
bgp.l3vpn.0 : 10 routes (10 active, 0 holddown, 0 hidden)
Restart Complete
inet6.0 : 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
bgp.l2vpn.0 : 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete
BGP-INET:
Router ID: 10.96.103.1
Type: vrf State: Active
Restart State: Complete Path selection timeout: 300
Interfaces:
t3-0/0/0.103
Route-distinguisher: 10.245.14.176:103
Vrf-import: [ BGP-INET-import ]
Vrf-export: [ BGP-INET-export ]
Tables:
BGP-INET.inet.0 : 4 routes (4 active, 0 holddown, 0 hidden)
Restart Complete
L2VPN:
Router ID: 0.0.0.0
Type: l2vpn State: Active
Restart State: Complete Path selection timeout: 300
Interfaces:
t3-0/0/0.512
Route-distinguisher: 10.245.14.176:512
Vrf-import: [ L2VPN-import ]
Vrf-export: [ L2VPN-export ]
Tables:
L2VPN.l2vpn.0 : 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
OSPF:
Router ID: 10.96.101.1
Type: vrf State: Active
Restart State: Complete Path selection timeout: 300
Interfaces:
t3-0/0/0.101
Route-distinguisher: 10.245.14.176:101
Vrf-import: [ OSPF-import ]
Vrf-export: [ OSPF-export ]
Tables:
OSPF.inet.0 : 8 routes (7 active, 0 holddown, 0 hidden)
Restart Complete
RIP:
Router ID: 10.96.102.1
Type: vrf State: Active
Restart State: Complete Path selection timeout: 300
Interfaces:
t3-0/0/0.102
Route-distinguisher: 10.245.14.176:102
Vrf-import: [ RIP-import ]
Vrf-export: [ RIP-export ]
Tables:
RIP.inet.0 : 6 routes (6 active, 0 holddown, 0 hidden)
Restart Complete
STATIC:
Router ID: 10.96.100.1
Type: vrf State: Active
Restart State: Complete Path selection timeout: 300
Interfaces:
t3-0/0/0.100
Route-distinguisher: 10.245.14.176:100
Vrf-import: [ STATIC-import ]
Vrf-export: [ STATIC-export ]
Tables:
STATIC.inet.0 : 4 routes (4 active, 0 holddown, 0 hidden)
Restart Complete
__juniper_private1__:
Router ID: 0.0.0.0
Type: forwarding State: Active
user@PE1> show route protocol l2vpn
inet.0: 16 destinations, 17 routes (15 active, 0 holddown, 1 hidden)
Restart Complete
inet.3: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
BGP-INET.inet.0: 5 destinations, 6 routes (5 active, 0 holddown, 0 hidden)
Restart Complete
OSPF.inet.0: 7 destinations, 8 routes (7 active, 0 holddown, 0 hidden)
Restart Complete
RIP.inet.0: 6 destinations, 6 routes (6 active, 0 holddown, 0 hidden)
Restart Complete
STATIC.inet.0: 4 destinations, 4 routes (4 active, 0 holddown, 0 hidden)
Restart Complete
iso.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete
mpls.0: 20 destinations, 20 routes (20 active, 0 holddown, 0 hidden)
Restart Complete
+ = Active Route, - = Last Active, * = Both
800003 *[L2VPN/7] 00:06:00
> via t3-0/0/0.512, Pop Offset: 4
t3-0/0/0.512 *[L2VPN/7] 00:06:00
> via t1-0/1/0.0, Push 800003, Push 100004(top) Offset: -4
bgp.l3vpn.0: 10 destinations, 10 routes (10 active, 0 holddown, 0 hidden)
Restart Complete
inet6.0: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
L2VPN.l2vpn.0: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
+ = Active Route, - = Last Active, * = Both
10.245.14.176:512:512:611/96
*[L2VPN/7] 00:06:01
Discard
bgp.l2vpn.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete
Router PE1 Status During a Restart
Before you can verify that graceful restart is working, you must simulate a router restart. To cause the routing process to refresh and simulate a restart, use the restart routing operational mode command:
user@PE1> restart routing
Routing protocol daemon started, pid 3558
The following sample output is captured during the router restart:
user@PE1> show bgp neighbor
Peer: 10.96.103.2 AS 65100 Local: 10.96.103.1 AS 65103
Type: External State: Active Flags: <ImportEval>
Last State: Idle Last Event: Start
Last Error: None
Export: [ BGP-INET-import ]
Options: <Preference LocalAddress HoldTime GracefulRestart AddressFamily PeerAS Refresh>
Address families configured: inet-unicast
Local Address: 10.96.103.1 Holdtime: 90 Preference: 170
Number of flaps: 0
Peer: 10.245.14.182+179 AS 69 Local: 10.245.14.176+2131 AS 69
Type: Internal State: Established Flags: <ImportEval>
Last State: OpenConfirm Last Event: RecvKeepAlive
Last Error: None
Options: <Preference LocalAddress HoldTime GracefulRestart AddressFamily Rib-group Refresh>
Address families configured: inet-vpn-unicast l2vpn
Local Address: 10.245.14.176 Holdtime: 90 Preference: 170
Number of flaps: 0
Peer ID: 10.245.14.182 Local ID: 10.245.14.176 Active Holdtime: 90
Keepalive Interval: 30
NLRI for restart configured on peer: inet-vpn-unicast l2vpn
NLRI advertised by peer: inet-vpn-unicast l2vpn
NLRI for this session: inet-vpn-unicast l2vpn
Peer supports Refresh capability (2)
Restart time configured on the peer: 120
Stale routes from peer are kept for: 300
Restart time requested by this peer: 120
NLRI that peer supports restart for: inet-vpn-unicast l2vpn
NLRI peer can save forwarding state: inet-vpn-unicast l2vpn
NLRI that peer saved forwarding for: inet-vpn-unicast l2vpn
NLRI that restart is negotiated for: inet-vpn-unicast l2vpn
NLRI of received end-of-rib markers: inet-vpn-unicast l2vpn
Table bgp.l3vpn.0 Bit: 10000
RIB State: BGP restart in progress
RIB State: VPN restart in progress
Send state: in sync
Active prefixes: 10
Received prefixes: 10
Suppressed due to damping: 0
Table bgp.l2vpn.0 Bit: 20000
RIB State: BGP restart in progress
RIB State: VPN restart in progress
Send state: in sync
Active prefixes: 1
Received prefixes: 1
Suppressed due to damping: 0
Table BGP-INET.inet.0 Bit: 30000
RIB State: BGP restart in progress
RIB State: VPN restart in progress
Send state: in sync
Active prefixes: 2
Received prefixes: 2
Suppressed due to damping: 0
Table OSPF.inet.0 Bit: 60000
RIB State: BGP restart is complete
RIB State: VPN restart in progress
Send state: in sync
Active prefixes: 2
Received prefixes: 2
Suppressed due to damping: 0
Table RIP.inet.0 Bit: 70000
RIB State: BGP restart is complete
RIB State: VPN restart in progress
Send state: in sync
Active prefixes: 2
Received prefixes: 2
Suppressed due to damping: 0
Table STATIC.inet.0 Bit: 80000
RIB State: BGP restart is complete
RIB State: VPN restart in progress
Send state: in sync
Active prefixes: 1
Received prefixes: 1
Suppressed due to damping: 0
Table L2VPN.l2vpn.0 Bit: 90000
RIB State: BGP restart is complete
RIB State: VPN restart in progress
Send state: in sync
Active prefixes: 1
Received prefixes: 1
Suppressed due to damping: 0
Last traffic (seconds): Received 0 Sent 0 Checked 0
Input messages: Total 14 Updates 13 Refreshes 0 Octets 1053
Output messages: Total 3 Updates 0 Refreshes 0 Octets 105
Output Queue[0]: 0
Output Queue[1]: 0
Output Queue[2]: 0
Output Queue[3]: 0
Output Queue[4]: 0
Output Queue[5]: 0
Output Queue[6]: 0
Output Queue[7]: 0
Output Queue[8]: 0
user@PE1> show route instance detail
master:
Router ID: 10.245.14.176
Type: forwarding State: Active
Restart State: Pending Path selection timeout: 300
Tables:
inet.0 : 17 routes (15 active, 1 holddown, 1 hidden)
Restart Pending: OSPF LDP
inet.3 : 2 routes (2 active, 0 holddown, 0 hidden)
Restart Pending: OSPF LDP
iso.0 : 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete
mpls.0 : 23 routes (23 active, 0 holddown, 0 hidden)
Restart Pending: LDP VPN
bgp.l3vpn.0 : 10 routes (10 active, 0 holddown, 0 hidden)
Restart Pending: BGP VPN
inet6.0 : 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
bgp.l2vpn.0 : 1 routes (1 active, 0 holddown, 0 hidden)
Restart Pending: BGP VPN
BGP-INET:
Router ID: 10.96.103.1
Type: vrf State: Active
Restart State: Pending Path selection timeout: 300
Interfaces:
t3-0/0/0.103
Route-distinguisher: 10.245.14.176:103
Vrf-import: [ BGP-INET-import ]
Vrf-export: [ BGP-INET-export ]
Tables:
BGP-INET.inet.0 : 6 routes (5 active, 0 holddown, 0 hidden)
Restart Pending: VPN
L2VPN:
Router ID: 0.0.0.0
Type: l2vpn State: Active
Restart State: Pending Path selection timeout: 300
Interfaces:
t3-0/0/0.512
Route-distinguisher: 10.245.14.176:512
Vrf-import: [ L2VPN-import ]
Vrf-export: [ L2VPN-export ]
Tables:
L2VPN.l2vpn.0 : 2 routes (2 active, 0 holddown, 0 hidden)
Restart Pending: VPN L2VPN
OSPF:
Router ID: 10.96.101.1
Type: vrf State: Active
Restart State: Pending Path selection timeout: 300
Interfaces:
t3-0/0/0.101
Route-distinguisher: 10.245.14.176:101
Vrf-import: [ OSPF-import ]
Vrf-export: [ OSPF-export ]
Tables:
OSPF.inet.0 : 8 routes (7 active, 1 holddown, 0 hidden)
Restart Pending: OSPF VPN
RIP:
Router ID: 10.96.102.1
Type: vrf State: Active
Restart State: Pending Path selection timeout: 300
Interfaces:
t3-0/0/0.102
Route-distinguisher: 10.245.14.176:102
Vrf-import: [ RIP-import ]
Vrf-export: [ RIP-export ]
Tables:
RIP.inet.0 : 8 routes (6 active, 2 holddown, 0 hidden)
Restart Pending: RIP VPN
STATIC:
Router ID: 10.96.100.1
Type: vrf State: Active
Restart State: Pending Path selection timeout: 300
Interfaces:
t3-0/0/0.100
Route-distinguisher: 10.245.14.176:100
Vrf-import: [ STATIC-import ]
Vrf-export: [ STATIC-export ]
Tables:
STATIC.inet.0 : 4 routes (4 active, 0 holddown, 0 hidden)
Restart Pending: VPN
__juniper_private1__:
Router ID: 0.0.0.0
Type: forwarding State: Active
user@PE1> show route instance summary
Instance Type Primary rib Active/holddown/hidden
master forwarding
inet.0 15/0/1
iso.0 1/0/0
mpls.0 35/0/0
l3vpn.0 0/0/0
inet6.0 2/0/0
l2vpn.0 0/0/0
l2circuit.0 0/0/0
BGP-INET vrf
BGP-INET.inet.0 5/0/0
BGP-INET.iso.0 0/0/0
BGP-INET.inet6.0 0/0/0
L2VPN l2vpn
L2VPN.inet.0 0/0/0
L2VPN.iso.0 0/0/0
L2VPN.inet6.0 0/0/0
L2VPN.l2vpn.0 2/0/0
OSPF vrf
OSPF.inet.0 7/0/0
OSPF.iso.0 0/0/0
OSPF.inet6.0 0/0/0
RIP vrf
RIP.inet.0 6/0/0
RIP.iso.0 0/0/0
RIP.inet6.0 0/0/0
STATIC vrf
STATIC.inet.0 4/0/0
STATIC.iso.0 0/0/0
STATIC.inet6.0 0/0/0
__juniper_private1__ forwarding
__juniper_priva.inet.0 0/0/0
__juniper_privat.iso.0 0/0/0
__juniper_priv.inet6.0 0/0/0
user@PE1> show route protocol l2vpn
inet.0: 16 destinations, 17 routes (15 active, 1 holddown, 1 hidden)
Restart Pending: OSPF LDP
inet.3: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Pending: OSPF LDP
BGP-INET.inet.0: 5 destinations, 6 routes (5 active, 0 holddown, 0 hidden)
Restart Pending: VPN
OSPF.inet.0: 7 destinations, 8 routes (7 active, 1 holddown, 0 hidden)
Restart Pending: OSPF VPN
RIP.inet.0: 6 destinations, 8 routes (6 active, 2 holddown, 0 hidden)
Restart Pending: RIP VPN
STATIC.inet.0: 4 destinations, 4 routes (4 active, 0 holddown, 0 hidden)
Restart Pending: VPN
iso.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete
mpls.0: 24 destinations, 24 routes (24 active, 0 holddown, 0 hidden)
Restart Pending: LDP VPN
+ = Active Route, - = Last Active, * = Both
800001 *[L2VPN/7] 00:00:13
> via t3-0/0/0.512, Pop Offset: 4
t3-0/0/0.512 *[L2VPN/7] 00:00:13
> via t1-0/1/0.0, Push 800003, Push 100004(top) Offset: -4
bgp.l3vpn.0: 10 destinations, 10 routes (10 active, 0 holddown, 0 hidden)
Restart Pending: BGP VPN
inet6.0: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
L2VPN.l2vpn.0: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Pending: VPN L2VPN
+ = Active Route, - = Last Active, * = Both
10.245.14.176:512:512:611/96
*[L2VPN/7] 00:00:13
Discard
bgp.l2vpn.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
Restart Pending: BGP VPN