AboutNMCConsultingGroup
Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

2008년4월25일
NMC Consulting Group(tech@netmanias.com)

2
MPLS at TPS Backhaul Network
BRASDSLAM(C-VID: port to C-VID
Mapping)
(S-VID: DSLAN ID)
VoiceTVInternetRGC-VID=1C-VID=2C-VID=1C-VID=2C-VID=1C-VID=2C-VID=1C-VID=2S-VID=1S-VID=2S-VID=1S-VID=2BRAS(Internet)
DSLAM 1VoiceTVInternetRGVLAN=4 (Multicast VLAN)
VLAN=1
DSLAM 2DSLAM 3DSLAM 4VLAN=2VLAN=4S-VID=1S-VID=2S-VID=1001/C-VID=1S-VID=1002/C-VID=1S-VID=1003/C-VID=1S-VID=1004/C-VID=1VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4S-VID=1001/C-VID=2S-VID=1002/C-VID=2S-VID=1003/C-VID=2S-VID=1004/C-VID=2ER/PE(VoIP)
PIMRouterPort1Port3Port4
BRASDSLAM(C-VID: port to C-VID
Mapping)
(S-VID: DSLAN ID)
VoiceTVInternetRGC-VID=1C-VID=2C-VID=1C-VID=2C-VID=1C-VID=2C-VID=1C-VID=2S-VID=1S-VID=2S-VID=1S-VID=2BRAS(Internet)
DSLAM 1VoiceTVInternetRGVLAN=4 (Multicast VLAN)
VLAN=1
DSLAM 2DSLAM 3DSLAM 4VLAN=2VLAN=4S-VID=1S-VID=2S-VID=1001/C-VID=1S-VID=1002/C-VID=1S-VID=1003/C-VID=1S-VID=1004/C-VID=1VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4VLAN=1VLAN=2VLAN=4S-VID=1001/C-VID=2S-VID=1002/C-VID=2S-VID=1003/C-VID=2S-VID=1004/C-VID=2ER/PE(VoIP)
PIMRouterPort1Port3Port4TPS Backhaul Connectivity.Subscriber Isolation (Security/Hair-Pin)
.Service Separation.Broadcast Handling.Scalability: MAC Learning, VLAN ID
.DSL Line Identification and Traceability.Multicast.Configuration ConsistencyMPLS BackhaulMPLS Resiliency.EoMPLS (MPLS FRR)
.PW Redundancy.PW Redundancy + MC-LAG.H-VPLS/-Dual-homed H-VPLS1.Native Ethernet Backhaul에서는Link, Node Failure 발생시STP/RSTP/MSTP를통해망을복구함. (수초~수십초)
2.빠른망복구를위해EoMPLS를적용함.
3.PoPNode 장애시망복구를위해H-VPLS이제시되었으며최근에는이보다진보한PW Redundancy + MC-LAG 기술이상용망에구현됨. (BT)
4.현재표준PBT 기술은PBT Tunnel의End Point Failure에대한대책을언급하지않고있으나상용망에서는필수적으로요구되고있는Requirement임.
TPS Backhaul Connectivity.Subscriber Isolation (Security/Hair-Pin)
.Service Separation.Broadcast Handling.Scalability: MAC Learning, VLAN ID
.DSL Line Identification and Traceability.Multicast.Configuration ConsistencyPBT Resiliency.PBT Protection (50ms)
.Dual-homed PBT.Dual-homed PBT + MC-LAGPBT Backhaul

3
TPS Backhaul / Internet Access: BT Case
..EdgeWDMBPEPEEA&
EthernetL2PE(7750)
Ethernet(Enterprise)
..
P
..
Voice PEBroadbandPMetro Node (106)
Outer Core Node (12)Inner Core Node (8)
.
P
....
MSANPPEEdge WDMCore
DWDMCore DWDMCore DWDMCore DWDMCisco CRSCisco CRSTier-1
MSAN Node(1,100)
Tier-1MSAN Node (1,100)
Outer Core Node (12)
Metro Node (106)
VoiceEEA&
EthernetL2PE (7750)
BBB L2 SWRPEMGWVoice PEL2 SWEEA&
Ethernet L2PEPEVoice PEBEEA&
EthernetL2PEBBB L2 SWMGWL2 SWVoice PEEthernet Backhaul현재: QinQ=> PBT (2007)
=> MPLS (2008)
FMSAN NodeCCCFFCMSAN Node4,400VoiceBroadbandCCCMPLS BackboneEthernet BackhaulBT Internet Network(Colossus)
FMSAN NodeCMSAN NodeEOS (GFP)EOS (GFP)
FF
MSANBRASL2 PEL2 PEPPPW RedundancyMSANMPLS NetworkBRASMC-LAGBRASMC-LAGOuter Core Node #1Outer Core Node #2PW#1PW#2PW#3PW#4MPLS L2 PEMPLS L2 PEBackhaul Network ResilienceBroadbandPW Redundancy + MC-LAG

4
Market & System Requirement for TPS Backhaul Reliability

1. Residential Internet service (BRAS case)
(1) Link Failure: PBT 1:1 Protection
(2) Node (Tunnel End Point) Failure: Dual-homed PBT with MC-LAG

2. Residential VoIP/VoD service (ER case)
(1) Link Failure: PBT 1:1 Protection
(2) Node (Tunnel End Point) Failure: Dual-homed PBT with VRRP
Market Requirement
.TPS BH에서Link 장애및POP 노드(AGG-SW) 장애에대한Fast Recovery 기능을제공해야함
System Requirement
Short Stubby dark blue
Short Stubby dark blue
Short Stubby dark blue
뒤에서예시

5
TPS Backhaul Resiliency: BRAS Case
BRASERDSLAM/OLT
BRASERDSLAM/OLTMPLS FRRRFC4090 Fast Reroute Extensions to RSVP-TE for LSP Tunnels networksTunnel Failure
BRASERALU PW Redundancy with MC-LAGPseudowire (PW) Redundancy draft-muley-pwe3-redundancy-02.txtMulti-Chassis Link Aggregation Group Redundancy for Layer 2 Virtual Private NetworksTunnel End-Point Failure
BRASERBRAS-facing port Link FailureMC-LAGMPLS
BRASERPBT 1:1 ProtectionIEEE 802.1Qay/D4.5 Provider Backbone Bridge Traffic Engineering
BRASER
BRASERDual-homed PBT + MC-LAGMC-LAGPBTTunnel FailureTunnel End-Point FailureBRAS-facing port Link FailureDSLAM/OLTDSLAM/OLTDSLAM/OLTDSLAM/OLTDSLAM/OLT
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

6
(1) Dual-homed PBT with MC-LAG
1/1PBT
TunnelCPBT
TunnelAPBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/31/31/41/3PBT-tunnel-A : ActivePBT-tunnel-B : StandbyEFP100YBMC-
LAG1/4D1Normal Condition (upstream)
BRASPort 1 : ActivePort 2 : StandbyStandard LACP1/1PBT
TunnelCPBT
TunnelAPBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/41/3PBT-tunnel-A : ActivePBT-tunnel-B : StandbyEFP100Y1/42Normal Condition (downstream)
BRASPort 1 : ActivePort 2 : StandbyStandard LACPAGG-SW 2 signal out_of_syncwhich prevents link becoming
active in the LAGControl message used for
synchronization between partner
nodes and monitoring the state of
the partner nodesActiveActiveActiveActive.MC-LAG (Multi Chassis-Link Aggregation Group) 기능을통해BRAS는두대의AGG-SW가마치한대인것으로인식함.Normal Condition에서는Active 상태에있는PBT-tunnel-A와Port 1을통해패킷이전달됨EFP100MC-
LAGEFP100D1/31/3BMC-
LAGDEFP100MC-
LAGEFP100D
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

7
(1) Dual-homed PBT with MC-LAG (cont)
1/1PBT
TunnelCPBT
TunnelAPBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/41/3EFP100Y1/41Tunnel End Point Failure (upstream)
BRASPort 1 : StandbyPort 2 : ActiveStandard LACP1/1PBT
TunnelCPBT
TunnelAPBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/41/3EFP100Y1/42Tunnel End Point Failure (downstream)
BRASStandard LACPActiveActiveActiveActiveAGG-SW1 장애발생시에PBT-tunnel-B와Port 2가Active 상태가되며, CO-SW는CCM 또는link down event로이를인식하게되고, AGG-SW2는(1)
AGG-SW1과의keep alive failure로이를인식할수도있고, (2) CO-SW가알려줄수도있음(Vendor Proprietary 구현이슈)
PBT-tunnel-B : ActivePBT-tunnel-B : ActivePort 1 : StandbyPort 2 : Active1/31/3BMC-
LAGDEFP100MC-
LAGEFP100D1/31/3BMC-
LAGDEFP100MC-
LAGEFP100D
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

8
(1) Dual-homed PBT with MC-LAG (cont)
1/1PBT
TunnelCPBT
TunnelAPBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/41/3EFP100Y1/41LACP Link Failure (upstream)
BRASStandard LACP1/1PBT
TunnelCPBT
TunnelAPBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/41/3EFP100Y1/42LACP Link Failure (downstream)
BRASStandard LACPActiveActiveActiveActivePBT-tunnel-A : ActivePBT-tunnel-B : StandbyPBT-tunnel-A : ActivePBT-tunnel-B : StandbyPort 2 : ActivePort 2 : Active1/31/3BMC-
LAGDEFP100MC-
LAGEFP100D1/31/3BMC-
LAGDEFP100MC-
LAGEFP100DBRAS facing Port 장애발생시에는PBT tunnel 상태의변화는없으며, AGG-SW간에연결된링크를통해패킷을전달하도록함
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

9
TPS Backhaul Resiliency: ER/PE Case
MPLS FRRRFC4090 Fast Reroute Extensions to RSVP-TE for LSP Tunnels networksTunnel FailurePW Redundancy + VRRPPseudowire (PW) Redundancy draft-muley-pwe3-redundancy-02.txtTunnel End-Point FailureER/PE-facing port Link FailureVRRPMPLSPBT 1:1 ProtectionIEEE 802.1Qay/D4.5 Provider Backbone Bridge Traffic EngineeringDual-homed PBT + VRRPVRRPPBT
BRASERDSLAM/OLTTunnel FailureTunnel End-Point FailureER/PE-facing port Link Failure
BRASERDSLAM/OLT
BRASERDSLAM/OLT
BRASERDSLAM/OLT
BRASERDSLAM/OLT
BRASERDSLAM/OLT
BRASERDSLAM/OLT
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

10
(2) Dual-homed PBT with VRRP
1/1PBT
TunnelCPBT
TunnelA
PBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/31/31/41/3Router1: Active VRRP RouterRouter2: Backup VRRP RouterMACvMACuMAC2MAC3EFP100YBEFP1001/4DEFP100DA=BroadcastSA=MACuS-VLAN=10Bridge Table:EFP 100VID MAC Port10 MACu 1/3Bridge Table:EFP 100VID MAC Port10 MACu PBT-tunnel-aBridge Table:EFP 100VID MAC Port10 MACu 1/311/1PBT
TunnelCPBT
TunnelA
PBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/31/31/41/3Router1: Active VRRP RouterRouter2: Backup VRRP RouterMACvMACuMAC2MAC3EFP100YBEFP1001/4DEFP100Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv PBT-tunnel-aBridge Table:EFP 100VID MAC Port10MACu PBT-tunnel-a10 MACv 1/4Bridge Table:EFP 100VID MAC Port10 MACu 1/32DA=MACuSA=MACvS-VLAN=10Normal Condition (upstream)
-EFP has its own Bridge Table
-EFP is indexed by (Port, S-VLAN, C-VLAN) in attachment circuit
(Ingress PBT)
-EFP is indexed by I-SID in PBT tunnel (Egress PBT)
Control message used for
synchronization between partner
nodes and monitoring the state of
the partner nodesNormal Condition (downstream)
PBT-tunnel-A : ActivePBT-tunnel-B : StandbyPBT-tunnel-A : ActivePBT-tunnel-B : StandbyEFP(=SAP) 마다별도로존재하는Bridge Table과VRRP 프로토콜연동을통해패킷전달됨
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

11
(2) Dual-homed PBT with VRRP (cont)
1/1PBT
TunnelCPBT
TunnelA
PBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/31/31/41/3MACvMACuMAC2MAC3EFP100YBEFP1001/4DEFP100Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv PBT-tunnel-aBridge Table:EFP 100VID MAC Port10 MACu 1/310 MACv 1/31deletedeleteTunnel End Point Failure(3) AGG-SW 2 cannot receive keep-alive
from AGG-SW 1(4) AGG-SW 2 actives Protection Tunnel
and delete MAC entries
(1) CO-SW detects ‘AGG-SW 1 Node
Failure’ event by CCM or Link down event
and delete MAC entries
(2) CO-SW actives Protection tunnel(5) Backup VRRP Router changes state to
‘Active’PBT-tunnel-B : ActiveRouter2: Active VRRP RouterAGG-SW1 장애발생시에PBT-tunnel-B가Active 상태가되며, CO-SW는CCM 또는link down event로이를인식하게되고, AGG-SW2는(1) AGG-
SW1과의keep alive failure로이를인식할수도있고, (2) CO-SW가알려줄수도있음(Vendor Proprietary 구현이슈)
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

12
(2) Dual-homed PBT with VRRP (cont)
1/1PBT
TunnelCPBT
TunnelA
PBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/31/31/41/3MACvMACuMAC2MAC3EFP100YBEFP1001/4DEFP1003deleteBridge Table:EFP 100VID MAC Port10MACu 1/310 MACv PBT-tunnel-bBridge Table:EFP 100VID MAC Port10 MACv 1/4
10 MACu PBT-tunnel-bDA=MACvSA=MACuS-VLAN=10Tunnel End Point Failure (upstream)
1/1PBT
TunnelCPBT
TunnelA
PBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/31/31/41/3MACvMACuMAC2MAC3EFP100YBEFP1001/4DEFP100Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv PBT-tunnel-bBridge Table:EFP 100VID MAC Port10 MACv 1/4
2DA=BroadcastSA=MACvS-VLAN=10Tunnel End Point Failure (downstream)
PBT-tunnel-B : ActivePBT-tunnel-B : ActiveRouter2: Active VRRP RouterRouter2: Active VRRP Router
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

13
(2) Dual-homed PBT with VRRP (cont)
1/1PBT
TunnelCPBT
TunnelA
PBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 21/31/31/41/3MACvMACuMAC2MAC3EFP100YBEFP1001/4DEFP100Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv PBT-tunnel-aBridge Table:EFP 100VID MAC Port10 MACu PBT-tunnel-a10 MACv 1/4Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv 1/31AGG-SW 1VRRP Router Link FailureRouter2: Active VRRP RouterPBT-tunnel-A : ActivePBT-tunnel-B : StandbydeleteER/PE facing Port 장애발생시에는PBT tunnel 상태의변화는없으며, VRRP 프로토콜에의해서Active 라우터가변경되며, AGG-SW는MAC learning을통해이를인지하게됨
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

14
(2) Dual-homed PBT with VRRP (cont)
31/1PBT
TunnelCPBT
TunnelA
PBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/31/31/41/3MACvMACuMAC2MAC3EFP100YBEFP1001/4DEFP100Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv PBT-tunnel-aBridge Table:EFP 100VID MAC Port10 MACu PBT-tunnel-a10 MACv 1/3Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv 1/4DA=MACvSA=MACuS-VLAN=10VRRP Router Link Failure (upstream)
Router2: Active VRRP Router21/1PBT
TunnelCPBT
TunnelA
PBT
TunnelPBT
TunnelX1/21/11/2CO-SWAGG-SW 1AGG-SW 21/31/31/41/3MACvMACuMAC2MAC3EFP100YBEFP1001/4DEFP100Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv PBT-tunnel-aBridge Table:EFP 100VID MAC Port10 MACu PBT-tunnel-a10 MACv 1/3Bridge Table:EFP 100VID MAC Port10MACu 1/310 MACv 1/4DA=BroadcastSA=MACvS-VLAN=10overwriteVRRP Router Link Failure (downstream)
Router2: Active VRRP RouterPBT-tunnel-A : ActivePBT-tunnel-B : StandbyPBT-tunnel-A : ActivePBT-tunnel-B : Standby
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

15
(3) PBT Protection + Dual-homed PBT (예시)
PBT
TunnelCPBT
TunnelPBT
TunnelPBT
TunnelX1/1CO-SWAGG-SW 1AGG-SW 21/31/4Active PBT-tunnel-aEFP100Y1/4DEFP100PBT
TunnelPBT
Tunnel1/21/3A1/31/4BEFP1001/11/11/21/2Standby PBT-tunnel-bStandby PBT-tunnel-cCCM (3.3ms, 10ms)
1PBT 1:1 Protection + Dual-homed PBTPBT 1:1 Protection for
Link FailureDual-homed PBT for
Node FailureControl MessageTunnel (Link) 장애는PBT 1:1 Protection을지원하고, Tunnel End Point (node) 장애는Dual-homed PBT를지원하는통합구조
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

16
(3) PBT Protection + Dual-homed PBT (예시) (cont)
PBT
TunnelCPBT
TunnelPBT
TunnelPBT
TunnelX1/1CO-SWAGG-SW 1AGG-SW 21/31/4EFP100Y1/4DEFP100PBT
TunnelPBT
Tunnel1/21/3A1/31/4BEFP1001/11/11/21/2Active PBT-tunnel-cPBT
TunnelCPBT
TunnelPBT
TunnelPBT
TunnelX1/1CO-SWAGG-SW 1AGG-SW 21/31/4EFP100Y1/4DEFP100PBT
TunnelPBT
Tunnel1/21/3A1/31/4BEFP1001/11/11/21/2Active PBT-tunnel-bStandby PBT-tunnel-c2Tunnel Failure: PBT 1:1 Protection3Tunnel End Point Failure: Dual-homed PBT ProtectionTunnel Failure1. Detection: CCM2. Check if Protection Tunnel Available3. If Yes, PBT 1:1 Protection (W->P)
Tunnel End Point Failure1. Detection: CCM2. Check if Protection Path Available3. If No, Dual-homed PBT Protection
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

17
PBT-based TPS Backhaul Reliability: Summary

BRASERPBT 1:1 Protection
BRASERDual-homed PBT + MC-LAGTunnel FailureTunnel End-Point Failure
PBT
TunnelCPBT
TunnelPBT
TunnelPBT
TunnelX1/1CO-SWAGG-SW 1AGG-SW 21/31/4Active PBT-tunnel-aEFP100Y1/4DEFP100PBT
TunnelPBT
Tunnel1/21/3A1/31/4BEFP1001/11/11/21/2Standby PBT-tunnel-bStandby PBT-tunnel-cCCM (3.3ms, 10ms)PBT 1:1 Protection for
Link FailureDual-homed PBT for
Node FailureControl MessageDual-homed PBT + VRRPTunnel FailureTunnel End-Point Failure
BRASERDSLAM/OLT
BRASERDSLAM/OLTBRAS CasePBT 1:1 ProtectionER/PE Case
Copyright ⓒ 2002-2011 NMC Consulting Group. All rights reserved.

Netmanias 기술문서: Carrier Ethernet 기술.TPS Backhaul Reliability

18
End of Document