MBONED Working GroupInternet Engineering Task Force (IETF) P. Tarapore, Ed.Internet-DraftRequest for Comments: 8313 R. SaykoIntended status:BCP: 213 AT&T Category: Best Current PracticeAT&T Expires: May 3, 2018G. Shepherd ISSN: 2070-1721 Cisco T. Eckert, Ed. Huawei R. Krishnan SupportVectorsOctober 30, 2017January 2018 Use of MulticastAcross Inter-Domainacross Inter-domain Peering Pointsdraft-ietf-mboned-interdomain-peering-bcp-14Abstract This document examines the use ofSource SpecificSource-Specific Multicast (SSM) across inter-domain peering points for a specified set of deployment scenarios. Theobjective isobjectives are to (1) describe the setup process for multicast-based delivery across administrative domains for these scenarios and (2) document supporting functionality to enable this process. Status of This Memo ThisInternet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are workingmemo documents an Internet Best Current Practice. This document is a product of the Internet Engineering Task Force (IETF).Note that other groups may also distribute working documents as Internet-Drafts. The listIt represents the consensus ofcurrent Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents validthe IETF community. It has received public review and has been approved fora maximumpublication by the Internet Engineering Steering Group (IESG). Further information on BCPs is available in Section 2 of RFC 7841. Information about the current status ofsix monthsthis document, any errata, and how to provide feedback on it may beupdated, replaced, or obsoleted by other documentsobtained atany time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on May 3, 2018.https://www.rfc-editor.org/info/rfc8313. Copyright Notice Copyright (c)20172018 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License. Table of Contents 1. Introduction. . . . . . . . . . . . . . . . . . . . . . . . 3....................................................4 2. Overview of Inter-domain Multicast Application Transport. . 5........6 3. Inter-domain Peering Point Requirements for Multicast. . . . 6...........7 3.1. Native Multicast. . . . . . . . . . . . . . . . . . . . 7...........................................8 3.2. Peering Point Enabled with GRE Tunnel. . . . . . . . . . 8.....................10 3.3. Peering Point Enabled withanAMT - Both Domains Multicast Enabled. . . . . . . . . . . . . . . . . . . . 10.........................................12 3.4. Peering Point Enabled withanAMT - AD-2 Not Multicast Enabled. . . . . . . . . . . . . . . . . . . . . . . . . 12.........................................14 3.5. AD-2 Not Multicast Enabled - Multiple AMT TunnelsThroughthrough AD-2. . . . . . . . . . . . . . . . . . . . . . . . . . 14..............................................16 4. Functional Guidelines. . . . . . . . . . . . . . . . . . . . 16..........................................18 4.1. Network Interconnection Transport Guidelines. . . . . . 16..............18 4.1.1. Bandwidth Management. . . . . . . . . . . . . . . . 16...............................19 4.2. Routing Aspects and Related Guidelines. . . . . . . . . 18....................20 4.2.1. Native Multicast Routing Aspects. . . . . . . . . . 19...................21 4.2.2. GRE Tunnel over Interconnecting Peering Point. . . . 19......22 4.2.3. Routing Aspects with AMT Tunnels. . . . . . . . . . 20...................22 4.2.4. Public Peering Routing Aspects. . . . . . . . . . . 22.....................24 4.3.Back OfficeBack-Office Functions - Provisioning and Logging Guidelines. . . . . . . . . . . . . . . . . . . . . . . 23................................................26 4.3.1. Provisioning Guidelines. . . . . . . . . . . . . . . 24............................26 4.3.2.InterdomainInter-domain Authentication Guidelines. . . . . . . . 25.............28 4.3.3.Log ManagementLog-Management Guidelines. . . . . . . . . . . . . . 26..........................28 4.4. Operations - Service Performance and Monitoring Guidelines. . . . . . . . . . . . . . . . . . . . . . . 27................................................30 4.5. Client ReliabilityModels/ServiceModels / Service Assurance Guidelines. 29..32 4.6. Application Accounting Guidelines. . . . . . . . . . . . 29.........................32 5. Troubleshooting and Diagnostics. . . . . . . . . . . . . . . 29................................32 6. Security Considerations. . . . . . . . . . . . . . . . . . . 30........................................33 6.1. DoSattacksAttacks (againststateState andbandwidth) . . . . . . . . 30Bandwidth) .................33 6.2. Content Security. . . . . . . . . . . . . . . . . . . . 32..........................................35 6.3. Peering Encryption. . . . . . . . . . . . . . . . . . . 34........................................37 6.4. Operational Aspects. . . . . . . . . . . . . . . . . . . 34.......................................37 7. Privacy Considerations. . . . . . . . . . . . . . . . . . . 35.........................................39 8. IANA Considerations. . . . . . . . . . . . . . . . . . . . . 37............................................40 9.Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . 37 10. Change log [RFC Editor: Please remove] . . . . . . . . . . . 37 11.References. . . . . . . . . . . . . . . . . . . . . . . . . 39 11.1......................................................40 9.1. Normative References. . . . . . . . . . . . . . . . . . 39 11.2.......................................40 9.2. Informative References. . . . . . . . . . . . . . . . . 40....................................42 Acknowledgments ...................................................43 Authors' Addresses. . . . . . . . . . . . . . . . . . . . . . . 41................................................44 1. Introduction Content and data from several types of applications (e.g., live video streaming, software downloads) are well suited for delivery via multicast means. The use of multicast for delivering such content or other data offers significant savings in terms of utilization of resources in any given administrative domain. EnduserUser (EU) demand for such content or other data is growing. Often, this requires transporting the content or other data across administrative domains via inter-domain peering points. Theobjectiveobjectives of thisBest Current Practicesdocumentisare twofold: o Describe the technical process and establish guidelines for setting up multicast-based delivery of application content or other data across inter-domain peering points via a set of usecases.cases (where "Use Case 3.1" corresponds to Section 3.1, "Use Case 3.2" corresponds to Section 3.2, etc.). o Catalog all required exchanges of informationexchangebetween the administrative domains to support multicast-based delivery. This enables operators to initiate necessary processes to support inter-domain peering with multicast. The scope and assumptions for this document are as follows: o Administrative Domain 1 (AD-1) sources content to one or moreEnd Users (EUs)EUs in one or more Administrative Domain 2(AD-2).(AD-2) entities. AD-1 and AD-2 want to use IP multicast to allowsupportingsupport for large and growing EUpopulationspopulations, with a minimum amount of duplicated traffic to send across network links.o* This document does not detail the case where EUs are originating content. To support that additional service, it is recommendedto usethat some method (outside the scope of this document) be used by which the content from EUs is transmitted to the application in AD-1that this document refers to as the multicast sourceandlet itAD-1 can send out the traffic as IP multicast. From that point on, the descriptions in this document apply, except that they are not complete because they do not cover the transport or operational aspects of the leg from the EU to AD-1.o* This document does not detail the case where AD-1 and AD-2 are not directly connected to each otherbut onlyand are instead connected via one or moreAD-3 (transit providers).other ADs (as opposed to a peering point) that serve as transit providers. The cases described in this document where tunnels are used between AD-1 and AD-2 can be applied to such scenarios, but SLA ("Service Level Agreement")controlcontrol, forexampleexample, would be different.Other additionalAdditional issues will likely exist as well in such scenarios. This topic is left for further study. o For thepurposepurposes of this document, the term "peering point" refers to a network connection ("link") between two administrative network domains over which traffic is exchanged between them. This is also referred to as a Network-to-Network Interface (NNI). Unless otherwise noted, it is assumed that the peering point isassumed to bea private peering point, where the network connection is a physically or virtually isolated network connection solely between AD-1 and AD-2. The other case is that of a broadcast peeringpointpoint, which is a common option in public Internet Exchange Points(IXP).(IXPs). See Section4.2.24.2.4 for moredetails about that option.details. oAdministrative Domain 1 (AD-1)AD-1 is enabled with native multicast. A peering point exists between AD-1 and AD-2. o It is understood that several protocols are available for thispurposepurpose, includingPIM-SMProtocol-Independent Multicast - Sparse Mode (PIM-SM) andProtocol IndependentProtocol-Independent Multicast -Source SpecificSource-Specific Multicast (PIM-SSM) [RFC7761], the Internet Group Management Protocol (IGMP) [RFC3376], and Multicast Listener Discovery (MLD) [RFC3810]. o As described in Section 2, the source IP address of the (so-called "(S,G)") multicast stream in the originating AD (AD-1) is known. Under this condition, using PIM-SSMuseisbeneficialbeneficial, as it allows the receiver's upstream router todirectlysend aJOINjoin message directly to the source without the needof invokingto invoke an intermediate Rendezvous Point (RP).UseThe use of SSM also presents an improved threat mitigation profile against attack, as described in [RFC4609]. Hence, in the case of inter-domain peering, it is recommendedto usethat only SSMprotocols;protocols be used; the setup ofinter- domaininter-domain peering for ASM (Any-Source Multicast) isnot inout of scope for this document. o The rest ofthethis document assumes that PIM-SSM and BGP are used across the peeringpointpoint, plusAMTAutomatic Multicast Tunneling (AMT) [RFC7450] and/orGREGeneric Routing Encapsulation (GRE), according toscenario.the scenario in question. The use of other protocols is beyond the scope of this document. oAn Automatic Multicast Tunnel (AMT) [RFC7450]AMT issetupset up at the peering point if either the peering point or AD-2 is not multicast enabled. It is assumed that an AMTRelayrelay will be available to a client for multicast delivery. The selection of an optimal AMT relay by a client is out of scope for this document. Note that using AMTuseis necessary only when native multicast is unavailable in the peering point (Use Case 3.3) or in the downstream administrative domain (Use Cases3.4,3.4 and 3.5). oTheIt is assumed that the collection of billing data isassumed to bedone at the application level and is not considered to be a networking issue. The settlements process forend userEU billing and/or inter-provider billing is out of scope for this document. o Inter-domain network connectivity troubleshooting is only considered within the context of a cooperative process between the two domains. This document also attempts to identify ways by which the peering process can be improved. Development of new methods for improvement is beyond the scope of this document. 2. Overview of Inter-domain Multicast Application Transport A multicast-based application delivery scenario is as follows: o Two independent administrative domains are interconnected via a peering point. o The peering point is either multicast enabled (end-to-end native multicast across the two domains) orit isconnected by one of two possible tunnel types:o* AGeneric Routing Encapsulation (GRE) TunnelGRE tunnel [RFC2784] allowing multicast tunneling across the peering point, oro An Automatic Multicast Tunnel (AMT)* AMT [RFC7450]. o A service provider controls one or more application sources in AD-1whichthat will send multicast IP packets via one or more (S,G)s (multicast trafficflows,flows; see Section 4.2.1 if you are unfamiliar with IP multicast). It is assumed that the service being provided is suitable for delivery via multicast(e.g.(e.g., live video streaming of popular events, software downloads to manydevices, etc.),devices) and that the packet streams will be carried by a suitable multicast transport protocol. o AnEnd User (EU)EU controls a device connected to AD-2, which runs an application client compatible with the service provider's application source. o The application client joins appropriate (S,G)s in order to receive the data necessary to provide the service to the EU. The mechanisms by which the application client learns the appropriate (S,G)s are an implementation detail of theapplication,application and are out of scope for this document. The assumption here is that AD-1 has ultimate responsibility for delivering themulticast basedmulticast-based service on behalf of the content source(s). All relevant interactions between the two domains described in this document are based on this assumption. Note thatdomain 2AD-2 may be an independent network domain(e.g.:(e.g., a Tier 1 network operator domain). Alternately,domain 2AD-2 could also be anEnterpriseenterprise network domain operated by a single customer of AD-1. The peering point architecture and requirements may have some unique aspects associated withthe Enterprise case. The Use Cases describing various architectural configurations for the multicast distribution along with associated requirements is described in section 3. Unique aspects related to the Enterprise network possibility will be described in this section.enterprise networks; see Section4 contains a comprehensive list of pertinent information that needs to be exchanged between the two domains in order to support functions to enable the application transport. Note that domain 2 may be an independent network domain (e.g., Tier 1 network operator domain). Alternately, domain 2 could also be an Enterprise network domain operated by a single customer.3. TheUse Casesuse cases describing various architectural configurations forthemulticastdistributiondistribution, along with associatedrequirements is described in Section 3. The peering point architecture and requirements may have some unique aspects associated with the Enterprise case. These unique aspects will also berequirements, are described in Section 3. Section 4 contains a comprehensive list of pertinent information that needs to be exchanged between the two domains in order to support functions to enabletheapplication transport. 3. Inter-domain Peering Point Requirements for Multicast The transport of applications using multicast requires that the inter-domain peering pointisbe enabled to support such a process.There areThis section presents fiveUse Casesuse cases forconsideration in this document.consideration. 3.1. Native Multicast ThisUse Caseuse case involves end-to-endNative Multicastnative multicast between the two administrativedomainsdomains, and the peering point is also native multicastenabled - seeenabled. See Figure 1. ------------------- ------------------- / AD-1 \ / AD-2 \ / (Multicast Enabled) \ / (Multicast Enabled) \ / \ / \ | +----+ | | | | | | +------+ | | +------+ | +----+ | | AS |------>| BR |-|---------|->| BR |-------------|-->| EU | | | | +------+ | I1 | +------+ |I2 +----+ \ +----+ / \ / \ / \ / \ / \ / ------------------- ------------------- AD = Administrative Domain(Independent Autonomous System)(independent autonomous system) AS =Applicationmulticast (e.g.,Content) Multicastcontent) Application Source BR = Border Router I1 = AD-1 and AD-2Multicast Interconnectionmulticast interconnection (e.g.,MBGP)MP-BGP) I2 = AD-2 and EUMulticast Connectionmulticast connection Figure 1: Content Distribution viaEnd to EndEnd-to-End Native Multicast Advantages of thisconfiguration are:configuration: o Most efficient use of bandwidth in both domains. o Fewer devices in the path traversed by the multicast stream when compared to anAMT enabledAMT-enabled peering point. From the perspective of AD-1, the one disadvantage associated with native multicastintoto AD-2 instead of individual unicast to every EU in AD-2 is that it does not have the ability to count the number ofEnd UsersEUs as well as the transmitted bytes delivered to them. This information is relevant from the perspective of customer billing and operational logs. It is assumed that such data will be collected by the application layer. Theapplication layerapplication-layer mechanisms for generating this information need to be robust enoughsuchso that all pertinent requirements for the source provider and the AD operator are satisfactorily met. The specifics of these methods are beyond the scope of this document. Architectural guidelines for this configuration are as follows: a. Dual homing for peering points between domains is recommended as a way to ensure reliability with full BGP table visibility. b. If the peering point between AD-1 and AD-2 is a controlled network environment, then bandwidth can be allocated accordingly by the two domains to permit the transit ofnon- rate adaptivenon-rate-adaptive multicast traffic. If this is not the case, then the multicast traffic must supportrate-adaption (see [BCP145]).congestion control via any of the mechanisms described in Section 4.1 of [BCP145]. c. The sending and receiving of multicast traffic between two domains is typically determined by local policies associated with each domain. For example, if AD-1 is a service provider and AD-2 is an enterprise, then AD-1 may support local policies for traffic delivery to, but not traffic reception from, AD-2. Another example is the use of a policy by which AD-1 delivers specified content to AD-2 only if such delivery has been accepted by contract. d.RelevantIt is assumed that relevant information on multicast streams delivered toEnd UsersEUs in AD-2 isassumed to becollected by available capabilities in the application layer. The precise nature and formats of the collected information will be determined by directives from the source owner and the domain operators. 3.2. Peering Point Enabled with GRE Tunnel The peering point is not native multicast enabled in thisUse Case.use case. There is aGeneric Routing Encapsulation TunnelGRE tunnel provisioned over the peering point. See Figure 2. ------------------- ------------------- / AD-1 \ / AD-2 \ / (Multicast Enabled) \ / (Multicast Enabled) \ / \ / \ | +----+ +---+ | (I1) | +---+ | | | | +--+ |uBR|-|--------|-|uBR| +--+ | +----+ | | AS |-->|BR| +---+-| | +---+ |BR| -------->|-->| EU | | | |+--+ <.......|........|........>+--++--+<........|........|........>+--+ |I2 +----+ \ +----+ / I1 \ / \ / GRE \ / \ / Tunnel \ / ------------------- ------------------- AD = Administrative Domain(Independent Autonomous System)(independent autonomous system) AS =Applicationmulticast (e.g.,Content) Multicastcontent) Application Source uBR = unicast Border Router - not necessarily multicastenabledenabled; may be the same router as BR BR = Border Router - for multicast I1 = AD-1 and AD-2Multicast Interconnectionmulticast interconnection (e.g.,MBGP)MP-BGP) I2 = AD-2 and EUMulticast Connectionmulticast connection Figure 2: Content Distribution via GRE Tunnel In this case,theinterconnection I1 between AD-1 and AD-2 in Figure 2 is multicast enabled via aGeneric Routing Encapsulation Tunnel (GRE)GRE tunnel [RFC2784] between the twoBRBRs and encapsulating the multicast protocols across it. Normally, this approach ischoosenchosen if the uBRphysciallyphysically connected to the peering linkcancannot or should not be enabled for IP multicast. This approach may also be beneficial if the BR and uBR are the samedevice,device but the peering link is a broadcast domain(IXP),(IXP); seeFigure 6.Section 4.2.4. The routing configuration is basically unchanged:Insteadinstead of running BGP(SAFI2)(SAFI-2) ("SAFI" stands for "Subsequent Address Family Identifier") across the native IP multicast link between AD-1 and AD-2, BGP(SAFI2)(SAFI-2) is now run across the GRE tunnel. Advantages of this configuration: o Highly efficient use of bandwidth in both domains, although not as efficient as the fully native multicastUse Case.use case (Section 3.1). o Fewer devices in the path traversed by the multicast stream when compared to anAMT enabledAMT-enabled peering point. o Ability to support partial and/or incremental IP multicast deployments inAD- 1AD-1 and/or AD-2:Onlyonly thepath(s)path or paths between the AS/BR (AD-1) and the BR/EU (AD-2) need to be multicast enabled. The uBRs may not support IP multicast or enabling it could be seen as operationally risky on that important edgenodenode, whereas dedicated BR nodes for IP multicast may (at least initially) be moreacceptable at least initially.acceptable. The BR can also be located such that only parts of the domain may need to support native IP multicast(e.g.:(e.g., only the core in AD-1 but not edge networks towards the uBR). o GRE is an existing technology and is relatively simple to implement. Disadvantages of this configuration: o Per Use Case 3.1, current router technology cannot count the number ofend usersEUs or the number of bytes transmitted. o The GRE tunnel requires manual configuration. o The GRE tunnel must be established prior tostream starting.starting the stream. o The GRE tunnel is often left pinned up. Architectural guidelines for this configuration include the following: Guidelines (a) through (d) are the same as those described in Use Case 3.1. Two additional guidelines are as follows: e. GRE tunnels are typically configured manually between peering points to support multicast delivery between domains. f. It is recommended that the GRE tunnel (tunnel server) configuration in the source networkisbe such that it only advertises the routes to the application sources and not to the entire network. This practice will prevent unauthorized delivery of applications through the tunnel(e.g.,(for example, if the application- e.g., content -(e.g., content) is not part of anagreedagreed-upon inter-domain partnership). 3.3. Peering Point Enabled withanAMT - Both Domains Multicast EnabledBothIt is assumed that both administrative domains in thisUse Caseuse case areassumed to benative multicast enabled here; however, the peering point is not. The peering point is enabled withan Automatic Multicast Tunnel.AMT. The basic configuration is depicted in Figure2.3. ------------------- ------------------- / AD-1 \ / AD-2 \ / (Multicast Enabled) \ / (Multicast Enabled) \ / \ / \ | +----+ +---+ | I1 | +---+ | | | | +--+ |uBR|-|--------|-|uBR| +--+ | +----+ | | AS |-->|AR| +---+-| | +---+ |AG| -------->|-->| EU | | | |+--+ <.......|........|........>+--++--+<........|........|........>+--+ |I2 +----+ \ +----+ / AMT \ / \ / Tunnel \ / \ / \ / ------------------- ------------------- AD = Administrative Domain(Independent Autonomous System)(independent autonomous system) AS =Applicationmulticast (e.g.,Content) Multicastcontent) Application Source AR = AMT Relay AG = AMT Gateway uBR = unicast Border Router - not multicastenabled otherwise AR=uBR (AD-1), uBR=AGenabled; also, either AR = uBR (AD-1) or uBR = AG (AD-2) I1 = AMTInterconnectioninterconnection between AD-1 and AD-2 I2 = AD-2 and EUMulticast Connectionmulticast connection Figure 3:-AMT Interconnection between AD-1 and AD-2 Advantages of this configuration: o Highly efficient use of bandwidth in AD-1. o AMT is an existing technology and is relatively simple to implement. Attractive properties of AMT include the following:o* Dynamic interconnection betweenGateway-Relaythe gateway-relay pair across the peering point.o* Ability to serve clients and servers with differing policies. Disadvantages of this configuration: o Per Use Case 3.1 (AD-2 is native multicast), current router technology cannot count the number ofend usersEUs or the number of bytes transmitted to allend users.EUs. o Additional devices (AMTGatewaygateway andRelayrelay pairs) may be introduced into the path if these services are not incorporatedininto the existing routing nodes. o Currently undefined mechanisms for the AG to automatically select the optimal AR. Architectural guidelines for this configuration are as follows: Guidelines (a) through (d) are the same as those described in Use Case 3.1. In addition, e. It is recommended that AMTRelayrelay andGatewaygateway pairs be configured at the peering points to support multicast delivery between domains. AMT tunnels will then configure dynamically across the peering points once theGatewaygateway in AD-2 receives the(S, G)(S,G) information from the EU. 3.4. Peering Point Enabled withanAMT - AD-2 Not Multicast Enabled In this AMTUse Case, the second administrative domainuse case, AD-2 is not multicast enabled. Hence, the interconnection between AD-2 and theEnd UserEU is also not multicast enabled. ThisUse Caseuse case is depicted in Figure3.4. ------------------- ------------------- / AD-1 \ / AD-2 \ / (Multicast Enabled) \ /(Non(Not Multicast \ / \ / Enabled) \ N(large) | +----+ +---+ | | +---+ |#EU# EUs | | | +--+ |uBR|-|--------|-|uBR| | +----+ | | AS |-->|AR| +---+-| | +---+ ................>|EU/G| | | |+--+ <.......|........|...........+--+<........|........|........... |I2 +----+ \ +----+ / N x AMT\ / \ / Tunnel \ / \ / \ / ------------------- ------------------- AS = multicast (e.g., content) ApplicationMulticastSource uBR = unicast Border Router - not multicastenabled, otherwiseenabled; otherwise, AR = uBR (inAD-1).AD-1) AR = AMT Relay EU/G = Gateway client embedded in EU device I2 = AMTTunnel Connectingtunnel connecting EU/G to AR in AD-1 throughNon-Multicast Enabled AD-2.non-multicast-enabled AD-2 Figure 4: AMT Tunnel Connecting AD-1 AMT Relay and EU Gateway ThisUse Caseuse case is equivalent to having unicast distribution of the application through AD-2. The total number of AMT tunnels would be equal to the total number ofEnd UsersEUs requesting the application. The peering point thus needs to accommodate the total number of AMT tunnels between the two domains. Each AMT tunnel can provide the data usage associated with eachEnd User.EU. Advantages of this configuration: o Efficient use of bandwidth in AD-1(The(the closer the AR is to the uBR, the more efficient). o Abilityforof AD-1 to introduceIP multicast basedcontent delivery based on IP multicast, without any support by network devices in AD-2:Onlyonly the application side in the EU device needs to perform AMT gateway library functionality to receive traffic from the AMT relay. o AllowsforAD-2 to "upgrade" to Use Case 3.5 (seebelow)Section 3.5) at a latertimetime, without any change in AD-1 at that time. o AMT is an existing technology and is relatively simple to implement. Attractive properties of AMT include the following:o* Dynamic interconnection betweenGateway-Relaythe AMT gateway-relay pair across the peering point.o* Ability to serve clients and servers with differing policies. o Each AMT tunnel serves as a count for eachEnd UserEU and is also able to track data usage (bytes) delivered to the EU. Disadvantages of this configuration: o Additional devices (AMTGatewaygateway andRelayrelay pairs) are introduced into the transport path. o Assuming multiple peering points between the domains, the EUGatewaygateway needs to be able to find the "correct" AMTRelayrelay in AD-1. Architectural guidelines for this configuration are as follows: Guidelines (a) through (c) are the same as those described in Use Case 3.1. In addition, d. It is necessary that proper proceduresarebe implemented such that the AMTGatewaygateway at theEnd UserEU device is able to find the correct AMTRelayrelay for each (S,G) content stream. Standard mechanisms for that selection are still subject to ongoing work. This includes the use of anycast gateway addresses, anycast DNS names, or explicit configuration thatis mappingmaps (S,G) to a relayaddressaddress; or letting the application in the EU/G provide the relay address to the embedded AMT gateway function. e. The AMTtunneltunnel's capabilities are expected to be sufficient for the purpose of collecting relevant information on the multicast streams delivered toEnd UsersEUs in AD-2. 3.5. AD-2 Not Multicast Enabled - Multiple AMT TunnelsThroughthrough AD-2This isFigure 5 illustrates a variation of Use Case3.4 as follows:3.4: ------------------- ------------------- / AD-1 \ / AD-2 \ / (Multicast Enabled) \ /(Non(Not Multicast \ / +---+ \ (I1) / +---+ Enabled) \ | +----+ |uBR|-|--------|-|uBR| | | | | +--+ +---+ | | +---+ +---+ | +----+ | | AS |-->|AR|<........|.... | +---+ |AG/|....>|EU/G| | | | +--+ | ......|.|AG/|..........>|AR2| |I3 +----+ \ +----+ / I1 \ |AR1| I2 +---+ / \ /singleSingle \+---+ / \ / AMT Tunnel \ / ------------------- ------------------- uBR = unicast Border Router - not multicastenabled otherwise AR=uBRenabled; also, either AR = uBR (AD-1) orubr=AGAR1uBR = AGAR1 (AD-2) AS = multicast (e.g., content) Application Source AR = AMT Relay in AD-1 AGAR1 = AMT Gateway/Relay node in AD-2 acrossPeering Pointpeering point I1 = AMTTunnel Connectingtunnel connecting AR in AD-1 toGWgateway in AGAR1 in AD-2 AGAR2 = AMT Gateway/Relay node at AD-2Network Edgenetwork edge I2 = AMTTunnel Connecting Relaytunnel connecting relay in AGAR1 toGWgateway in AGAR2 EU/G = Gateway client embedded in EU device I3 = AMTTunnel Connectingtunnel connecting EU/G to AR in AGAR2 Figure 5: AMT Tunnel Connecting AMTRelayGateways and Relays Use Case 3.4 results in several long AMT tunnels crossing the entire network of AD-2 linking the EU device and the AMTRelayrelay in AD-1 through the peering point. Depending on the number ofEnd Users,EUs, there is a likelihood of an unacceptably high amount of traffic due to the large number of AMT tunnels--- and unicast streams--- through the peering point. This situation can be alleviated as follows: o Provisioning of strategically located AMT nodes inAD-2AD-2. An AMT node comprises co-location of an AMTGatewaygateway and an AMTRelay.relay. No change is required byAD-1AD-1, as compared to Use Case 3.4. This can be done whenever AD-2seemssees fit(too(e.g., too much traffic across the peeringpoint.point). o One such node isaton the AD-2 side of the peering point(node(AMT node AGAR1 inabove Figure).Figure 5). oSingleA single AMT tunnel established across the peering point linking the AMTRelayrelay in AD-1 to the AMTGatewaygateway intheAMT node AGAR1 in AD-2. o AMT tunnels linking AMT node AGAR1 at the peering point in AD-2 to other AMT nodes located at the edges of AD-2: e.g., AMT tunnel I2 linking the AMTRelayrelay in AGAR1 to the AMTGatewaygateway in AMT node AGAR2in Figure 4.(Figure 5). o AMT tunnels linking an EU device (viaGatewaya gateway client embedded in the device) and an AMTRelayrelay in an appropriate AMT node at the edge of AD-2: e.g., I3 linking the EUGatewaygateway in the device to the AMTRelayrelay in AMT node AGAR2. o In themost simplesimplest option (not shown), AD-2 only deploys a single AGAR1 node and lets the EU/G build AMT tunnels directly to it. This setup already solves the problem of replicated traffic across the peering point. As soon as there is a need to support more AMT tunnels to the EU/G, then additional AGAR2 nodes can be deployed by AD-2. The advantageforof such a chained set of AMT tunnels is that the total number of unicast streams across AD-2 is significantly reduced, thus freeing up bandwidth. Additionally, there will be a single unicast stream across the peering point insteadofof, possibly, an unacceptably large number of such streams per Use Case 3.4. However, this implies that several AMT tunnels will need to be dynamically configured by the various AMTGatewaysgateways, based solely on the (S,G) information received from the application client at the EU device. A suitable mechanism for such dynamic configurations is therefore critical. Architectural guidelines for this configuration are as follows: Guidelines (a) through (c) are the same as those described in Use Case 3.1. In addition, d. It is necessary that proper proceduresarebe implemented such that the various AMTGatewaysgateways (at theEnd UserEU devices and the AMT nodes in AD-2) are able to find the correct AMTRelayrelay in other AMT nodes as appropriate. Standard mechanisms for that selection are still subject to ongoing work. This includes the use of anycast gateway addresses, anycast DNS names, or explicit configuration thatis mappingmaps (S,G) to a relay address. On the EU/G, this mapping information may come from the application. e. The AMTtunneltunnel's capabilities are expected to be sufficient for the purpose of collecting relevant information on the multicast streams delivered toEnd UsersEUs in AD-2. 4. Functional Guidelines Supporting functions and related interfaces over the peering point that enable the multicast transport of the application are listed in this section. Critical information parameters that need to be exchanged in support of these functions are enumerated, along with guidelines as appropriate. Specific interface functions for consideration are as follows. 4.1. Network Interconnection Transport Guidelines The term"Network Interconnection Transport""network interconnection transport" refers to the interconnection points between the twoAdministrative Domains.administrative domains. The following is a representative set of attributes thatwill need to be agreed to betweenthe two administrative domains will need to agree on to support multicast delivery. o Number ofPeering Points.peering points. o PeeringPoint Addressespoint addresses andLocations.locations. o ConnectionTypetype - Dedicated forMulticastmulticast delivery or shared with other services. o ConnectionModemode - Direct connectivity between the twoAD'sADs or via another ISP. o PeeringPoint Protocol Supportpoint protocol support - Multicast protocols that will be used for multicast delivery will need to be supported at these points. Examples of such protocols includeeBGPExternal BGP (EBGP) [RFC4760]and MBGPpeering via MP-BGP (Multiprotocol BGP) SAFI-2 [RFC4760]. o BandwidthAllocationallocation - If shared with other services, then there needs to be a determination of the share of bandwidth reserved for multicast delivery. SeesectionSection 4.1.1 below for more details. o QoSRequirementsrequirements - Delay and/or latency specifications that need to be specified in an SLA. o ADRolesroles andResponsibilitiesresponsibilities -theThe role played by each AD for provisioning and maintaining the set of peering points to support multicast delivery. 4.1.1. Bandwidth Management Like IP unicast traffic, IP multicast traffic carried acrossnon- controllednon-controlled networks must complyto Congestion Control Principleswith congestion control principles as described in [BCP41] and as explained in detail for UDP IP multicast in [BCP145]. Non-controlled networks (such as the Internet) arethosenetworks where there is no policy for managing bandwidth other than best effort with a fair share of bandwidth under congestion. As a simplified rule of thumb, complyingtowith congestion control principles meansto reducereducing bandwidth under congestion in a way that is fair to competingcompeting(typically TCP)flowflows ("rate adaptive"). In many instances, multicast content delivery evolves fromintra- domainintra-domain deployments where it is handled as a controlled network service andofdoes notcomplyng tocomply with congestion control principles. It was given a reserved amount of bandwidth and admitted to the network so that congestion never occurs.ThereforeTherefore, the congestion control issue should be given specific attention when evolving to aninterdomaininter-domain peering deployment. In the case where end-to-end IP multicast traffic passes across the network of two ADs (and their subsidiaries/customers), both ADs must agree on a consistenttraffic managementtraffic-management policy.IfIf, forexampleexample, AD-1 sourcesnon congestion awarenon-congestion-aware IP multicast traffic and AD-2 carries it asbest effortbest-effort traffic across links shared with other Internet trafficand subject(subject tocongestion,congestion), this will not work:Underunder congestion, some amount of that traffic will be dropped, often rendering the remaining packetsoftenasundecodeableundecodable garbage clogging up the network inAD-2 andAD-2; because this traffic is not congestion aware, the loss does not reduce this rate. Competing traffic will not get their fair share under congestion, and EUs will befrustedfrustrated by the extremely bad quality of both their IP multicast traffic and other(e.g.:(e.g., TCP) traffic. Note that this is not an IP multicast technologyissue,issue but is solely atransport/application layertransport-layer / application-layer issue:Thethe problem wouldequallyjust as likely happen if AD-1wouldwere to sendnon-rate adaptivenon-rate-adaptive unicasttraffic,,traffic -- forexampleexample, legacy IPTV video-on-demandtraffictraffic, whichtypicallyis typically alsonon congestionnon-congestion aware.BecauseNote that because rateadaptionadaptation in IP unicast video is commonplace todaybecausedue to the availability of ABR (AdaptiveBitrate Video),Bitrate) video, it is very unlikelyforthat thistowill happenthoughin reality with IP unicast. While the rules for traffic management apply whetheror notIP multicast is tunneled or not, the one feature that can make AMT tunnels more difficult is the unpredictability of bandwidth requirements across underlying links because of the way they can be used:Withwith native IP multicast or GRE tunnels, the amount of bandwidth depends on the amount ofcontent,content -- not the number of EUs--- and is therefore easier to plan for. AMT tunnels terminating inEU/Gthe EU/G, on the otherhandhand, scale with the number of EUs. In the vicinity of the AMTrelayrelay, they can introduce a very large amount of replicatedtraffictraffic, and it is not always feasible to provision enough bandwidth for all possibleEUEUs to get the highest quality for all their content during peak utilization in such setups--- unless the AMT relays are very close to the EU edge.ThereforeTherefore, it is also recommendedto usethat IP multicast rate adaptation be used, even inside controllednetworksnetworks, when using AMT tunnels directly to the EU/G. Note that rate-adaptive IP multicast traffic in general does not mean that the sender is reducing thebitrate,bitrate but rather that the EUs that experience congestion are joining to alower bitratelower-bitrate (S,G) stream of the content, similar toadaptive bitrateABR streaming over TCP.MigrationTherefore, migration fromnon rate-adaptivea non-rate-adaptive bitrate torate adaptivea rate-adaptive bitrate in IP multicastdoes thereforewill also change the dynamic (S,G) join behavior in thenetworknetwork, resulting in potentially higher performancerequirementrequirements for IP multicast protocols (IGMP/PIM), especially on the last hops where dynamic changes occur (including AMTgateway/relays): In non rate-adaptivegateways/relays): in non-rate- adaptive IP multicast, only "channel change" causes state change, but in rate-adaptivealso themulticast, congestionsituationalso causes state change. Even though not fully specified in this document, peerings that rely on GRE/AMT tunnels may be across one or more transit ADs instead of an exclusive (non-shared, L1/L2) path. Unless those transit ADs are explicitly contracted to provide other than "best effort" transit for the tunneled traffic, the tunneled IP multicast traffictunneledmust be rate adaptive in order to not violateBCP41BCP 41 across those transit ADs. 4.2. Routing Aspects and Related Guidelines The main objective for multicast delivery routing is to ensure that theEnd UserEU receives the multicast stream from the "most optimal" source[INF_ATIS_10][INF_ATIS_10], which typically: o Maximizes the multicast portion of the transport and minimizes any unicast portion of the delivery, and o Minimizes the overall combinednetwork(s)routedistance.distance of the network(s). This routing objective applies to bothNativenative multicast and AMT; the actual methodology of the solution will be different for each. Regardless, the routing solution isexpected:expected to: oTo beBe scalable, oTo avoidAvoid or minimize new protocol development or modifications, and oTo beBe robust enough to achieve high reliability and to automatically adjust to changes and problems in the multicast infrastructure. For bothNativenative and AMT environments, having a source as close as possible to the EU network is most desirable; therefore, in some cases, an AD may prefer to have multiple sources near different peering points. However, that is entirely an implementation issue. 4.2.1. Native Multicast Routing Aspects Native multicast simply requires that theAdministrative Domainsadministrative domains coordinate and advertise the correct source address(es) at their network interconnection peeringpoints(i.e., border routers).points (i.e., BRs). An example of multicast delivery via aNative Multicastnative multicast process across twoAdministrative Domainsadministrative domains is asfollowsfollows, assuming that the interconnecting peering points are also multicast enabled: o Appropriate information is obtained by the EUclientclient, who is a subscriber to AD-2 (see Use Case 3.1). This information is in the form ofmetadatametadata, and it contains instructions directing the EU client to launch an appropriate application if necessary, as well as additional information for the application about the source location and the group (or stream)idID in the form ofthe "S,G"(S,G) data. The "S" portion provides the name or IP address of the source of the multicast stream. The metadata may also contain alternate deliveryinformationinformation, such as specifying the unicast address of the stream. o The client uses the join message withS,G(S,G) to join the multicast stream [RFC4604]. To facilitate this process, the twoAD'sADs need to do the following:o* Advertise the sourceid(s)ID(s) over thePeering Points. opeering points. * Exchange such relevantPeering Pointpeering point informationsuchasCapacitycapacity andUtilization. outilization. * Implement compatible multicast protocols to ensure proper multicast delivery across the peering points. 4.2.2. GRE Tunnel over Interconnecting Peering Point If the interconnecting peering point is not multicast enabled and bothAD'sADs are multicast enabled, then a simple solution is to provision a GRE tunnel between the twoAD's -ADs; see Use Case3.2.2.3.2 (Section 3.2). The termination points of the tunnel will usually be a network engineeringdecision,decision but generally will be between theborder routersBRs or even between theAD 2 border routerAD-2 BR and theAD 1AD-1 source (or source access router). The GRE tunnel would allow end-to-end native multicast or AMT multicast to traverse the interface. Coordination and advertisement of the source IPisare still required. The twoAD'sADs need to follow the same process as the process described in Section 4.2.1 to facilitate multicast delivery across thePeering Points.peering points. 4.2.3. Routing Aspects with AMT Tunnels UnlikeNative Multicastnative multicast (with or without GRE), an AMTMulticastmulticast environment is more complex. It presents adual layeredtwo-layered problembecausein that there are two criteria that should be simultaneously met: o Find the closest AMT relay to theend-userEU that also has multicast connectivity to the content source, and o Minimize the AMT unicast tunnel distance. There are essentially two componentstoin the AMTspecificationspecification: AMTRelays:relays: These serve the purpose of tunneling UDP multicast traffic to the receivers (i.e.,End-Points).endpoints). The AMTRelayrelay will receive the traffic natively from the multicast media source and will replicate the stream on behalf of the downstream AMTGateways,gateways, encapsulating the multicast packets into unicast packets and sending them over the tunnel toward the AMTGateway.gateways. In addition, the AMTRelayrelay mayperformcollect various usage and activitystatistics collection.statistics. This results in moving the replication point closer to theend user,EU and cuts down on traffic across the network. Thus, the linear costs of adding unicast subscribers can be avoided. However, unicast replication is still required for each requestingEnd-Pointendpoint within the unicast-only network. AMTGateway (GW):gateway: TheGatewaygateway will reside on anEnd-Point -endpoint; this could be any type of IPhosthost, such as a Personal Computer (PC), mobile phone,Set TopSet-Top Box(STB)(STB), or appliances. The AMTGatewaygateway receives join and leave requests from theApplicationapplication via an Application Programming Interface (API). In this manner, theGatewaygateway allows theEnd-Pointendpoint to conduct itself as a trueMulticast End-Point.multicast endpoint. The AMTGatewaygateway will encapsulate AMT messages into UDP packets and send them through a tunnel (across the unicast-only infrastructure) to the AMTRelay.relay. The simplest AMTUse Case (sectionuse case (Section 3.3) involves peering points that are not multicast enabled between twomulticast enabled AD's.multicast-enabled ADs. An AMT tunnel is deployed between an AMTRelayrelay on theAD 1AD-1 side of the peering point and an AMTGatewaygateway on theAD 2AD-2 side of the peering point. One advantagetoof this arrangement is that the tunnel is established on anas neededas-needed basis and need not be a provisioned element. The twoAD'sADs can coordinate and advertise special AMTRelay Anycastrelay anycast addresseswithwith, and to, each other. Alternately, they may decide to simply provisionRelayrelay addresses, though this would not be an optimal solution in terms of scalability. Use Cases 3.4 and 3.5 describemore complicatedAMT situations that are more complicated, as AD-2 is not multicastenabled. Forenabled in these two cases. For these cases, theEnd UserEU device needs to be able tosetupset up an AMT tunnel in the most optimal manner. There are many methods by which relay selection can bedonedone, including the use ofDNS basedDNS-based queries and static lookup tables [RFC7450]. The choice of the method is implementation dependent and is up to the network operators. Comparison of various methods is out of scope for thisdocument; itdocument and is left for further study. An illustrative example of a relay selection based on DNS queriesand Anycastas part of an anycast IPaddressesaddress process is described here for Use Cases 3.4 and 3.5is described here.(Sections 3.4 and 3.5). Using anAnycastanycast IP address for AMTRelaysrelays allowsforall AMTGatewaysgateways to find the "closest" AMTRelay -relay -- the nearest edge of the multicast topology of the source. Note that this is strictly illustrative; the choice of the method is up to the network operators. The basic process is as follows: o Appropriate metadata is obtained by the EU client application. The metadata contains instructions directing the EU client to an ordered list of particular destinations to seek the requested stream and, for multicast, specifies the source location and the group (or stream) ID in the form ofthe "S,G"(S,G) data. The "S" portion provides the URI (name or IP address) of the source of the multicaststreamstream, and the "G" identifies the particular stream originated by that source. The metadata may also contain alternate delivery information such as the address of the unicast form of the content to beused,used -- for example, if the multicast stream becomes unavailable. o Using the information from themetadata, and possiblymetadata and, possibly, information provisioned directly in the EU client, a DNS query is initiated in order to connect the EUclient/AMT Gatewayclient / AMT gateway to an AMTRelay.relay. o Query results areobtained,obtained and may return anAnycastanycast address or a specific unicast address of a relay. Multiple relays will typically exist. TheAnycastanycast address is a routable"pseudo- address""pseudo-address" shared among the relays that can gain multicast access to the source. o If a specific IP address unique to a relay was not obtained, the AMTGatewaygateway then sends a message (e.g., the discovery message) to theAnycastanycast address such that the network is making the routing choice of a particularrelay -relay, e.g.,closestthe relay that is closest to the EU. Details are outside the scopeforof this document. See [RFC4786]. o The contacted AMTRelayrelay then returns its specific unicast IP address (after which theAnycastanycast address is no longer required). Variations may exist as well. o The AMTGatewaygateway uses that unicast IP address to initiate athree- waythree-way handshake with the AMTRelay.relay. o The AMTGatewaygateway provides"S,G"the (S,G) information to the AMTRelayrelay (embedded in AMT protocol messages). o The AMTRelayrelay receives the"S,G"(S,G) information and usesthe S,Git to join the appropriate multicast stream, if it has not already subscribed to that stream. o The AMTRelayrelay encapsulates the multicast stream into the tunnel between theRelayrelay and theGateway,gateway, providing the requested content to the EU. 4.2.4. Public Peering Routing Aspects Figure 6 shows an example of a broadcast peering point. AD-1a AD-1b BR BR | | --+-+---------------+-+-- broadcast peering point LAN | | BR BR AD-2a AD-2b Figure 6: Broadcast Peering Point A broadcast peering point is an L2 subnet connecting3three or more ADs. It is common in IXPs and usually consists ofethernetEthernet switch(es) operated by the IXP connecting to BRs operated by the ADs. In an example setupdomaindomain, AD-2a peers with AD-1a and wants to receive IP multicast from it.LikewiseLikewise, AD-2b peers with AD-1b and wants to receive IP multicast from it. Assume that one or more IP multicast (S,G) traffic streams can be served by both AD-1a andAD-1b,AD-1b -- forexampleexample, because both AD-1a and AD-1bdo contractcontact this content from the same content source. In this case, AD-2a and AD-2b cannotno longer controlanymorewhich upstreamdomain,domain -- AD-1a or AD-1b -- will forward this (S,G) into the LAN. The AD-2a BR requests the (S,G) from the AD-1aBRBR, and the AD-2b BR requests the same (S,G) from the AD-1b BR. To avoid duplicate packets, an (S,G) can be forwarded by only one router onto theLAN, and PIM-SM/PIM-SSMLAN; PIM-SM / PIM-SSM detects requests for duplicatetransmissiontransmissions andresolve itresolves them via the so-called "assert" protocoloperationoperation, which results in only one BR forwarding the traffic. Assume that this is the AD-1a BR. AD-2b will then receivetheunexpected multicast trafficunexpectedlyfrom a provider with whom it does not have a mutual agreement forthethat traffic. Quality issues in EUs behind AD-2b caused by AD-1a will cause a lot ofresponsiblityissues related to responsibility andtroubleshooting issues.troubleshooting. Infacelight ofthisthese technical issues, wedescribedescribe, via the followingoptionsoptions, how IP multicast can be carried across broadcast peering point LANs: 1. IP multicast is tunneled across the LAN. Any of the GRE/AMT tunneling solutions mentioned in this document are applicable. This is the one case wherespecificallya GRE tunnel between the upstream BR(e.g.:(e.g., AD-1a) and downstream BR(e.g.:(e.g., AD-2a) isrecommendedspecifically recommended, as opposed to tunneling across uBRswhich(which are not the actualBRs.BRs). 2. The LAN has only one upstream AD that is sourcing IPmulticastmulticast, and native IP multicast is used. This is an efficient way to distribute the same IP multicast content to multiple downstream ADs. Misbehaving downstream BRs can still disrupt the delivery of IP multicast from the upstream BR to other downstreamBRs, thereforeBRs; therefore, strict rules must befollowfollowed to prohibitthatsuch a case. The downstream BRs must ensure that they will always consider only the upstream BR as a source for multicast traffic:e.g.:e.g., no BGP SAFI-2 peerings between the downstream ADs across the peering point LAN, so thatonlythe upstream BR is the only possiblenext-hopnext hop reachable across this LAN.AndAlso, routing policies can be configured to avoidfallfalling back tothe use ofusing SAFI-1 (unicast) routes for IP multicast if unicast BGP peering is not limited in the same way. 3. The LAN has multipleupstreams,upstream ADs, but they are federated and agree on a consistent policy for IP multicast traffic across the LAN. One policy is that each possible source is only announced by one upstream BR. Another policy is that sources are redundantly announced(problematic(the problematic case mentioned inabove example),the example in Figure 6 above), but the upstream domains also provide mutual operational insight to help with troubleshooting (outside the scope of this document). 4.3.Back OfficeBack-Office Functions - Provisioning and Logging GuidelinesBack Office"Back office" refers to the following: o Servers andContent Managementcontent-management systems that support the delivery of applications via multicast and interactions betweenAD's.ADs. o Functionality associated with logging, reporting, ordering, provisioning, maintenance, service assurance, settlement, etc. 4.3.1. Provisioning Guidelines Resources for basic connectivity betweenAD's ProvidersADs' providers need to be provisioned as follows: o Sufficient capacity must be provisioned to support multicast-based delivery acrossAD's.ADs. o Sufficient capacity must be provisioned for connectivity between all supportingback-officesback offices of theAD'sADs as appropriate. This includes activating proper security treatment for theseback- officeback-office connections (gateways, firewalls,etc)etc.) as appropriate.o Routing protocols as needed, e.g. configuring routers to support these.Provisioning aspects related toMulticast-Basedmulticast-based inter-domain delivery are as follows. The ability to receive a requested application via multicast is triggered via receipt of the necessary metadata. Hence, this metadata must be provided to the EU regarding the multicast URL--- and unicast fallback if applicable. AD-2 must enable the delivery of this metadata to the EU and provision appropriate resources for this purpose.NativeIt is assumed that native multicast functionality isassumed to beavailable across many ISP backbones, peering points, and access networks. If, however, native multicast is not an option (Use Cases 3.4 and 3.5), then: o The EU must have a multicast client to use AMT multicast obtainedeitherfromApplication Sourceeither (1) the application source (per agreement with AD-1) orfrom(2) AD-1 or AD-2 (if delegated by theApplication Source).application source). o If provided byAD-1/AD-2,AD-1 or AD-2, then the EU could be redirected to a client downloadsite (note: thissite. (Note: This could be anApplication Source site).application source site.) If provided by theApplication Source,application source, then thisSourcesource would have to coordinate with AD-1 to ensure that the proper client is provided (assuming multiple possible clients). o Where AMTGatewaysgateways support different application sets, all AD-2 AMTRelaysrelays need to be provisioned with all source&and group addresses for streams it is allowed to join. o DNS across each AD must be provisioned to enable a clientGWgateway to locate the optimal AMTRelay (i.e.relay (i.e., longest multicast path and shortest unicast tunnel) with connectivity to the content's multicast source. ProvisioningAspects Relatedaspects related toOperationsoperations andCustomer Carecustomer care arestatedas follows.Each AD providerIt is assumedtothat each AD provider will provision operations and customer care access to their own systems. AD-1's operations and customer care functions musthave visibilitybe able to see enough of what is happening in AD-2's network ortoin the service provided byAD- 2, sufficientAD-2 to verify their mutual goals and operations,e.g.e.g., to know how theEU'sEUs are being served. This can be done in two ways: o Automated interfaces are built between AD-1 and AD-2 such that operations and customer care continue using their own systems. This requires coordination between the twoAD'sADs, with appropriate provisioning of necessary resources. o AD-1's operations and customer care personnel are provided direct accessdirectlyto AD-2'ssystem.systems. In this scenario, additional provisioning in these systems will be needed to provide necessary access.Additional provisioning must be agreed to by theThe twoAD'sADs must agree on additional provisioning to support this option. 4.3.2.InterdomainInter-domain Authentication Guidelines All interactions between pairs ofAD'sADs can be discovered and/orbeassociated with the account(s) utilized for delivered applications. Supporting guidelines are as follows: o A unique identifier is recommended to designate each master account. o AD-2 is expected to set up "accounts"(logical(a logical facility generally protected by credentials such as login passwords) for use by AD-1. Multipleaccountsaccounts, and multiple types or partitions ofaccountsaccounts, can apply,e.g.e.g., customer accounts, securityaccounts, etc.accounts. The reason to specifically mention the need for AD-1 to initiate interactions with AD-2 (and use some account for that), as opposed to theopposite directionopposite, is based on the recommended workflow initiated by customers (see Section 4.4):Thethe customer contacts the contentsource (partsource, which is part ofAD-1), whenAD-1. Consequently, if AD-1 sees the need topropagateescalate theissue,issue to AD-2, it will interact with AD-2 using the aforementioned guidelines. 4.3.3.Log ManagementLog-Management Guidelines Successful delivery (in terms of user experience) of applications or content via multicast between pairs of interconnectingAD'sADs can be improved through the ability to exchange appropriate logs for various workflows--- troubleshooting, accounting and billing, optimization of traffic and contenttransmission optimization,transmission, optimization of content and applicationdevelopment optimizationdevelopment, and so on.The basic model as explained in before is that the content source and on its behalfSpecifically, AD-1 take over primary responsibility for customer experienceandon behalf of theAD-2'scontent source, with supportthis.from AD-2 as needed. The application/content owner is the only participant whohashas, andneedsneeds, full insight into the application level and can map the customer application experience to the network traffic flows- which it then-- which, with the help of AD-2 or logs fromAD-2AD-2, it can then analyze and interpret. The main difference between unicast delivery and multicast delivery is that the content source can infer a lot more about downstream network problems from aunicastedunicast stream than from amulticastedmulticast stream:The multicastedthe multicast stream is notper-EUper EU, except after the last replication, which is in most cases not in AD-1. Logs from the application, including the receiver side at the EU, can provideinsight,insight butcan notcannot help to fully isolate network problems because of the IP multicast per-application operational state built across AD-1 and AD-2(aka:(aka the (S,G) state and any otherfeature operational stateoperational-state features, such asDiffServDiffserv QoS). See Section 7 for morediscussions aboutdiscussion regarding the privacy considerations of the model described here. Differenttypetypes of logs are known to help support operations in AD-1 when provided by AD-2. This could be done as part of AD-1/AD-2 contracts. Note that except for impliedmulticast specificmulticast-specific elements, the options listed here are not unique or novel for IP multicast, but they are more important for services novel to the operators than for operationallywell establishedwell-established services (such as unicast).Therefore weWe therefore detail them as follows: o Usage information logs at an aggregate level. o Usage failure instances at an aggregate level. o Grouped or sequenced applicationaccess.access: performance,behaviorbehavior, and failure at an aggregate level to support potentialApplication Provider-drivenapplication-provider-driven strategies. Examples of aggregate levels include grouped video clips, web pages, andsets of software download.software- download sets. o Security logs, aggregated or summarized according to agreement (with additional detail potentially provided during security events, by agreement). o Access logs (EU), when needed for troubleshooting. o Application logs(what("What is the applicationdoing),doing?"), when needed for shared troubleshooting. o Syslogs (network management), when needed for shared troubleshooting. The twoAD'sADs may supply additional security logs to eachotherother, as agreedto byupon in contract(s). Examples include the following: o Information related to general security-relevantactivityactivity, which may be of use from aprotectiveprotection or responseperspective, such asperspective: types and counts of attacks detected, related source information, related target information, etc. o Aggregated or summarized logs according to agreement (with additional detail potentially provided during security events, by agreement). 4.4. Operations - Service Performance and Monitoring GuidelinesService Performance"Service performance" refers to monitoring metrics related to multicast delivery via probes. The focus is on the service provided by AD-2 to AD-1 on behalf of all multicast application sources (metrics may be specified for SLA use or otherwise). Associated guidelines are as follows: o BothAD'sADs are expected to monitor, collect, and analyze service performance metrics for multicast applications. AD-2 provides relevant performance information to AD-1; this enables AD-1 to create an end-to-end performance view on behalf of the multicast application source. o BothAD'sADs are expected to agree on thetypetypes of probes to be used to monitor multicast delivery performance. For example, AD-2 may permit AD-1's probes to be utilized in the AD-2 multicast service footprint. Alternately, AD-2 may deploy its own probes and relay performance information back to AD-1.Service Monitoring"Service monitoring" generally refers to a service (as a whole) provided on behalf of a particular multicast application source provider. It thus involves complaints fromEnd UsersEUs when service problems occur. EUs direct their complaints to the source provider;in turnthe source provider in turn submits these complaints to AD-1. The responsibility for service delivery lies with AD-1; assuchsuch, AD-1 will need to determine where the service problem is occurring--- in its own network or in AD-2. It is expected that each AD will have tools to monitor multicast service status in its own network. o BothAD'sADs will determine how best to deploy multicast service monitoring tools. Typically, each AD will deploy its own set of monitoringtools;tools, in whichcase,case bothAD'sADs are expected to inform each other when multicast delivery problems are detected. o AD-2 may experience some problems in its network. For example, for the AMTUse Cases,use cases (Sections 3.3, 3.4, and 3.5), one or more AMTRelaysrelays may be experiencing difficulties. AD-2 may be able to fix the problem by rerouting the multicast streams via alternate AMTRelays.relays. If the fix is not successful and multicast service delivery degrades, then AD-2 needs to report the issue to AD-1. o When a problem notification is received from a multicast application source, AD-1 determines whether the cause of the problem is within its own network or withinthe AD-2 domain.AD-2. If the cause is withinthe AD-2 domain,AD-2, then AD-1 supplies all necessary information to AD-2. Examples of supporting information include the following:o Kind* Kind(s) of problem(s).o* Starting point&and duration of problem(s).o* Conditions in whichproblem(s)one or more problems occur.o* IP address blocks of affected users.o* ISPs of affected users.o* Type ofaccessaccess, e.g., mobile versus desktop.o* Network locations of affected EUs. o BothAD'sADs conduct some form ofroot causeroot-cause analysis for multicast service delivery problems. Examples of various factors for consideration include:o* Verification that the service configuration matches the product features.o* Correlation and consolidation of the various customer problems and resource troubles into a singleroot serviceroot-service problem.o* Prioritization of currently open service problems, giving consideration to problemimpact, service level agreement,impacts, SLAs, etc.o Conduction of* Conducting service tests, includingone timetests performed once or a series of tests over a period of time.o* Analysis of test results.o* Analysis of relevant network fault or performance data.o* Analysis of the problem information provided by thecustomer (CP).customer. o Once the cause of the problem has been determined and the problem has been fixed, bothAD'sADs need to work jointly to verify and validate the success of the fix. 4.5. Client ReliabilityModels/ServiceModels / Service Assurance Guidelines There are multiple options for instituting reliabilityarchitectures, mostarchitectures. Most are at the application level. BothAD'sADs should workthosethese options outwithper their contract or agreement and also with the multicast application source providers. Network reliability can also be enhanced by the twoAD's by provisioningADs if they provision alternate delivery mechanisms via unicast means. 4.6. Application Accounting GuidelinesApplication levelApplication-level accounting needs to be handled differently in the application than in IPunicastunicast, because the source side does not directly deliver packets to individual receivers. Instead, this needs to besignalledsignaled back by the receiver to the source. For network transport diagnostics, AD-1 and AD-2 should have mechanisms in place to ensure proper accounting for the volume of bytes delivered through the peering pointand separatelyand, separately, the number of bytes delivered to EUs. 5. Troubleshooting and Diagnostics Any service provider supporting multicast delivery of content shouldhave the capabilitybe able to collect diagnostics as part of multicast troubleshooting practices and resolve network issues accordingly. Issues may become apparent oridentified eitheridentifiable through either (1) network monitoring functions orby customer reported(2) problems reported by customers, as described insectionSection 4.4. It is recommended that multicast diagnosticswillbeperformedperformed, leveraging established operational practices such as those documented in[MDH-04].[MDH-05]. However, given that inter-domain multicast creates a significant interdependence of proper networking functionality betweenprovidersproviders, theredoes existexists a need for providers to be able to signal (or otherwise alert) each other if there are any issues noted by either one.ServiceFor troubleshooting purposes, service providers may also wish to allow limited read-only administrative access to their routers to their ADpeers for troubleshooting. Of specific interest are accesspeers. Access to active troubleshooting tools -- especially [Traceroute] and[I-D.ietf-mboned-mtrace-v2].the tools discussed in [Mtrace-v2] -- is of specific interest. Another option is to include this functionalityintoin the IP multicast receiver application on the EU device and allowforthese diagnostics to be remotely used by support operations.Note thoughNote, though, that AMT does not allowto passthe passing of traceroute or mtracerequests, thereforerequests; therefore, troubleshooting in the presence of AMT does not work as wellend-to-end to end as it can with native (or evenGRE encapsulated)GRE-encapsulated) IP multicast, especiallywrt.with regard to traceroute and mtrace. Instead, troubleshooting directly on the actual network devices is then more likely necessary. The specifics ofthe notificationnotifications and alerts are beyond the scope of this document, but general guidelines are similar to those described insection 4.4 (Service Performance and Monitoring).Section 4.4. Some general communications issues arestatedas follows. o Appropriate communications channels will be established between the customer service and operations groups from bothAD'sADs to facilitateinformation sharinginformation-sharing related to diagnostic troubleshooting. o A default resolution period may be considered to resolve open issues. Alternately, mutually acceptable resolution periods could beestablishedestablished, depending on the severity of the identified trouble. 6. Security Considerations 6.1. DoSattacksAttacks (againststateState andbandwidth)Bandwidth) Reliableoperations ofIP multicastrequiresoperations require some basic protection against DoS (Denial of Service) attacks. SSM IP multicast isself protectingself-protecting against attacks from illicitsources. Theirsources; such traffic will not be forwarded beyond thefirst hop routerfirst-hop router, because that would require (S,G)memershipmembership reports from the receiver.TrafficOnly valid traffic from sources willonlybeforwarded from the valid sourceforwarded, because RPF ("Reverse Path Forwarding") is part of the protocols. One can say that[BCP38] styleprotection against spoofed source traffic performed in the style of [BCP38] is therefore built intoPIM-SM/PIM-SSM.PIM-SM / PIM-SSM. Receivers can attack SSM IP multicast by originating such (S,G) membership reports. This can result in a DoS attack against state through the creation of a large number of (S,G) states that create highcontrol planecontrol-plane load or even inhibit the later creation of a valid (S,G). In conjunction with collaborating illicitsourcessources, it can also result inillicit sourcesthe forwarding of trafficbeing forwarded.from illicit sources. Today, thesetypetypes of attacks are usually mitigated by explicitly defining the set of permissible (S,G)on e.g.:on, for example, thelast hoplast-hop routers in replicating IP multicast toEUs; For exampleEUs (e.g., via (S,G)Access Control Listsaccess control lists applied to IGMP/MLD membership statecreation.creation). Each AD (say, "ADi") is expected toprohibit (S,G) state creation for invalidknow what sourcesinsidelocated in ADi are permitted to send and what theirownvalid (S,G)s are. ADi can therefore also filter invalid (S,G)s for any "S" located inside ADi, but not sources located in another AD. In the peering case,AD-2 iswithout furtherinformationinformation, AD-2 is not aware of the set of valid (S,G) from AD-1, so this set needs to be communicated via operational procedures from AD-1 to AD-2 to provide protection against this type of DoSattacks.attack. Future work could signal this information in an automated way: BGP extensions, DNSResource Recordsresource records, or backend automation between AD-1 and AD-2. Backend automationisis, in the shorttermterm, the most viablesolution because itsolution: unlike BGP extensions or DNS resource records, backend automation does not require router softwareextensions like the other two.extensions. Observation of traffic flowing via (S,G) state could also be used to automate the recognition of invalid (S,G) state created by receivers in the absence of explicit information from AD-1. The second type of DoS attack through (S,G) membership reportsisexists whenreceivers createthe attacking receiver creates too much valid (S,G) stateto attackand the traffic carried by these (S,G)s congests bandwidthavailable toon links shared with otherEU.EUs. Consider the uplinkintoto alast-hop-routerlast-hop router connecting to 100EU.EUs. If one EU joins to more multicast content than what fits into this link, then this wouldimpactalso impact the quality of the same content for the other 99EU.EUs. If traffic is not rate adaptive, the effects are even worse. The mitigation technique is the same as what is often employed for unicast:Policingpolicing of the per-EU totalamontamount of traffic. Unlikeunicastunicast, though, thiscan notcannot be done anywhere along the path(e.g.:(e.g., on an arbitrary bottlenecklink), butlink); it has to happen at the point of last replication to the different EU. Simple solutions such as limiting the maximum number of joined(S,G)(S,G)s per EU are readilyavailable,available; solutions thatconsider bandwidthtake consumedexistbandwidth into account are available asvendor specific featurevendor-specific features in routers. Note that this is primarily a non-peering issue inAD-2,AD-2; it only becomes a peering issue if thepeering-linkpeering link itself is not big enough to carry all possible content from AD-1oror, as incase 3.4 whereUse Case 3.4, when the AMT relay in AD-1 is that last replication point. Limiting the amount of (S,G) state per EU is also a good first measure to prohibit too much undesired "empty" stateto befrom being built (state not carrying traffic), but it would not suffice in the case of DDoSattack -attacks, e.g., viruses that impact a large number of EU devices. 6.2. Content Security Content confidentiality, DRM (DigitalRestrictionsRights Management),authenticationauthentication, and authorization areoptionaloptional, based on the content delivered. For content that is "FTA" (Free To Air), the following considerations can beignoredignored, and content can be sent unencrypted and without EU authentication and authorization.Note thoughNote, though, that the mechanisms described here may also bedesireable bydesirable for the application source to better track users even if the content itself would not require it. Forinterdomaininter-domain content, there are at least two models for content confidentiality, including (1) DRM authentication and authorization andend-user(2) EU authentication and authorization: o In the classical (IP)TV model, responsibility isper-domainper domain, and content is and can be passed on unencrypted. AD-1 delivers content toAD-2,AD-2; AD-2 can further process thecontentcontent, including features likead-insertionad insertion, and AD-2 is the sole point of contact regarding the contact for its EUs. In this document, we do not consider this case because it typically involveshigher than network layerservice aspects operated by AD-2andthat are higher than the network layer; this documentfocussesfocuses on thenetwork layernetwork-layer AD-1/AD-2 peeringcase,case but not theapplication layerapplication-layer peering case. Nevertheless, this model can be derived through additional workfrombeyond what isdescribedescribed here. o The othercasemodel is the one in which content confidentiality, DRM,end- user authenticationEU authentication, and EU authorization areend-to-end:end to end: responsibilities of the multicast application source provider and receiver application. This is the model assumed here. It is also the model used in InternetOTT"Over the Top" (OTT) video delivery.WeBelow, we discuss thethreadsthreats incurred in this model due to the use of IP multicast inAD- 1/AD-2AD-1 or AD-2 and across thepeering.peering point. End-to-end encryption enables end-to-end EU authentication and authorization:Thethe EU may be able toIGMP/MLDjoin (via IGMP/MLD) and receive the content, but it can only decrypt it when it receives the decryption key from the content source in AD-1. The key is the authorization. Keeping that key to itself and prohibiting playout of the decrypted content to non-copy-protected interfaces are typical DRM features in that receiver application or EU device operating system. End-to-endecnryptionencryption is continuously attacked. Keys may be subject tobrute force attackbrute-force attacks so that content can potentially be decryptedpotentiallylater, or keys are extracted from the EU application/device and shared with other unauthenticated receivers. One important class of content is where the value is in live consumption, such as sports or other event(concert)(e.g., concert) streaming. Extraction of keying material from compromised authenticatedEUEUs and sharing with unauthenticatedEU isEUs are not sufficient. It is also necessary for those unauthenticated EUs to get a streaming copy of the content itself. In unicast streaming, theycan notcannot get such a copy from the content source (because theycan not authenticate) andcannot authenticate), and, because of asymmetric bandwidths, it is often impossible to get the content from compromised EUs to a large number of unauthenticated EUs. EUs behind classical16"16 Mbps down, 1 Mbpsupup" ADSL links are the best example. With increasing broadband accessspeedsspeeds, unicast peer-to-peer copying of content becomes easier, but it likely will always be easily detectable by the ADs because of its traffic patterns and volume. When IP multicast is being used withoutadditionalsadditional security, AD-2 is not aware of which EU is authenticated for which content. Any unauthenticated EU in AD-2 could therefore get a copy of the encrypted content without triggering suspicionbyon the part of AD-2 or AD-1 and then eitherlive- deode it(1) live-decode it, in the presence of the compromised authenticated EU andkey sharing,key-sharing orlater(2) decrypt it later, in the presence of federatedbrute force key cracking.brute-force key-cracking. To mitigate this issue, the last replication point that is creating (S,G) copies to EUs would need to permit those copies only after authentication of the EUs. This would establish the same authenticatedEU only"EU only" copydeliver thastthat is used in unicast. Schemes forper EUper-EU IP multicast authentication/authorization(and in result non-delivery/copying(and, as a result, non-delivery or copying of per-content IP multicast traffic) have been built in the past and are deployed in service providers forintradomainintra-domain IPTV services, but nostandardstandards exist for this. For example, there is no standardizedradiusRADIUS attribute for authenticating the IGMP/MLD filter set, but such implementationsof thisexist. The authors of this document are specifically also not aware of schemes where the same authentication credentials used to get the encryption key from the content source could also be used to authenticate and authorize thenetwork layernetwork-layer IP multicast replication for the content. Such schemes are technically not difficult to build and would avoid creating and maintaining a separate networkforwarding authentication/ authorizationtraffic-forwarding authentication/authorization scheme decoupled from the end-to-endauthentication/ authorizationauthentication/authorization system of the application. If delivery of suchhigh valuehigh-value content in conjunction with the peering described here is desired, theshort termshort-term recommendations are for sources to clearly isolate the source and group addresses used for different content bundles, communicate those (S,G) patterns from AD-1 tothe AD-2AD-2, and let AD-2 leverage existing per-EU authentication/ authorization mechanisms in network devices to establish filters for (S,G) sets to each EU. 6.3. Peering Encryption Encryption at peering points for multicast delivery may be used per agreement betweenAD-1/AD-2.AD-1 and AD-2. In the case of a private peering link, IP multicast does not have attack vectors on a peering link different from those of IP unicast, but the content owner may have definedhigh barsstrict constraints against unauthenticated copying of even the end-to-end encryptedcontent, andcontent; in thiscase AD-1/AD-2case, AD-1 and AD-2 can agree on additional transport encryption across that peering link. In the case of a broadcast peering connection(e.g.:(e.g., IXP), transport encryption isalsoagain the easiest way to prohibit unauthenticated copies by other ADs on the same peering point. If peering is across a tunnelgoing acrossthat spans intermittent transit ADs (notdiscuseddiscussed in detail in this document), then encryption of that tunnel traffic is recommended. It not only prohibits possible "leakage" ofcontent,content but alsotoprotects thetheinformation regarding what content is being consumed in AD-2 (aggregated privacy protection). Seethe following subsectionSection 6.4 for reasons why the peering point may also need to be encrypted for operational reasons. 6.4. Operational Aspects Section 4.3.3 discusses the exchange of log information,this section discussed exchange of (S,G) informationand Section 7 discussesexhangethe exchange of program information. All these operational pieces of data should by default be exchanged via authenticated and encryptedpeer- to-peerpeer-to-peer communication protocols between AD-1 and AD-2 so that only the intendedrecipientrecipients in thepeerspeers' AD have access to it. Even exposure of the least sensitive information to third parties opens up attack vectors. Puttingfor examplevalid (S,G)informationinformation, for example, into DNS (as opposed to passing it via secured channels from AD-1 to AD-2) to allow easier filtering of invalid (S,G) information would also allow attackers toeasiermore easily identify valid (S,G) information and change their attack vector. From the perspective of the ADs, security is most critical fortheloginformationinformation, as it provides operational insight into the originatingAD,AD butitalso contains sensitive userdata:data. Sensitive user data exported from AD-2 to AD-1 as part of logs could be as much as the equivalent of 5-tuple unicast traffic flow accounting (but not more,e.g.:e.g., noapplication levelapplication-level information). As mentioned in Section 7, in unicast, AD-1 could capture these traffic statistics itself because this is all aboutAD-1 originatedtraffic flows (originated by AD-1) to EU receivers in AD-2, and operationally passing it from AD-2 to AD-1 may be necessary when IP multicast is used because of the replicationhappeningtaking place in AD-2. Nevertheless, passing such traffic statistics inside AD-1 from a capturing router to a backend system is likely less subject tothird partythird-party attacksthenthan passing itinterdomain"inter-domain" from AD-2 to AD-1, so more diligence needs to be applied to secure it. If any protocols used for the operationalinformationexchange of information are not easily secured at the transport layer or higher (because of the use of legacy products or protocols in the network), then AD-1 and AD-2 can also considerto ensureensuring that all operational dataexchange goesexchanges go across the same peering point as the traffic and usenetwork layernetwork-layer encryption of the peering pointas(as discussedin beforepreviously) to protect it. End-to-end authentication and authorization ofEUEUs may involve some kind of token authentication andisare done at the applicationlayerlayer, independently of the twoAD's.ADs. If there are problems related to the failure of token authentication whenend-usersEUs are supported by AD-2, then some means of validating properworkingoperation of the token authentication process (e.g.,back-endvalidating that backend servers querying the multicast application source provider's token authentication server are communicating properly) should be considered. Implementation details are beyond the scope of this document.Security Breach Mitigation Plan -In the event of a security breach, the twoAD'sADs are expected to have a mitigation plan for shutting down the peering point and directing multicast traffic over alternative peering points. It is also expected that appropriate information will be shared for the purpose of securing the identified breach. 7. Privacy Considerations The described flow of information about content andthe end-userEUs as described in this document aims to maintain privacy: AD-1 is operating on behalf of (or owns) the content source and is therefore part of the content-consumption relationship with theend- user.EU. The privacy considerations between the EU and AD-1 are thereforein general (exception see below)generally the same (with one exception; see below) as they would be if no IP multicast was used, especially becausefor any privacy conscious content,end-to-end encryption can and should beused. Interdomainused for any privacy-conscious content. Information related to inter-domain multicast transport servicerelated informationis provided to AD-1 by the AD-2operators to AD-1.operators. AD-2 is not required to gain additional insight into theuseruser's behavior through this processthatother than what it wouldnotalready have withouttheservice collaboration withAD-1 -AD-1, unless AD-1 and AD-2 agree on it and get approval from the EU. For example, if it is deemed beneficial for the EU todirectlyget support directly fromAD-2AD-2, then it wouldin generalgenerally be necessary for AD-2 to be aware of the mapping between content and network (S,G) state so that AD-2 knows which (S,G) to troubleshoot when the EU complains about problems withaspecific content. The degree to which this dissemination is done by AD-1 explicitly to meet privacy expectations of EUs is typically easy to assess by AD-1. Two simpleexamples:examples are as follows: o For a sports content bundle, every EU will happily click on the"i"I approve that the content program information is shared with your service provider" button, to ensure best servicereliabilityreliability, becauseservice consciousservice-conscious AD-2 would likely also try to ensure thathigh valuehigh-value content, such as the (S,G) forSuperBowl like contentthe Super Bowl, would be the first to receive care in the case of network issues. o If the content in question wasone wherecontent for which the EU expected more privacy, the EU should prefer a content bundle that included this content in a large variety of other content, have all contentend-to- end encryptedend-to-end encrypted, andthenot share programming informationnot be sharedwithAD-2AD-2, to maximize privacy. Nevertheless, the privacy of the EU against AD-2 observing traffic would still be lower than in the equivalent setup using unicast, because in unicast, AD-2 could not correlate which EUs are watching the same content and use that to deduce the content. Note that even the setup in Section3.43.4, where AD-2 is not involved in IP multicast atallall, does not provide privacy against this level of analysis byAD-2AD-2, because there is notransport layertransport-layer encryption inAMT and thereforeAMT; therefore, AD-2 can correlate byonpathon-path traffic analysis who is consuming the same content from an AMT relay from both the (S,G) join messages in AMT and the identical content segments (thatwherewere replicated at the AMT relay). Insummary: Becausesummary, because only content to be consumed by multiple EUs is carried via IP multicasthere,here and all of that content can be end-to-end encrypted, the onlyIP multicast specificprivacy consideration specific to IP multicast is for AD-2 to know or reconstruct what content an EU is consuming. For content for which this is undesirable, some form of protections as explained above are possible, but ideally, the modelofdescribed in Section 3.4 could be used in conjunction with futureworkwork, e.g., addinge.g.: dTLS [RFC6347]Datagram Transport Layer Security (DTLS) encryption [RFC6347] between the AMT relay and the EU. Note that IP multicast by nature would permit theEUEU's privacy against thecountentcontent source operatorbecausebecause, unlike unicast, the content source does not natively know which EU is consuming which content:Inin all cases where AD-2 provides replication, only AD-2does knowknows this directly. This document does not attempt to describe a model thatdoes maintainmaintains such a level of privacy against the contentsource butsource; rather, we describe a model that only protects against exposure to intermediateparties,parties -- in thiscasecase, AD-2. 8. IANA ConsiderationsNo considerations identified in this document. 9. Acknowledgments The authors would like to thank the following individuals for their suggestions, comments, and corrections: Mikael Abrahamsson Hitoshi Asaeda Dale Carder Tim Chown Leonard Giuliano Jake Holland Joel Jaeggli Albert Manfredi Stig Venaas Henrik Levkowetz 10. Change log [RFC Editor: Please remove] Please see discussion on mailing list for changes before -11. -11: version in IESG review. -12: XML'ified version of -11, committed solely to make rfcdiff easier. XML versions hosted on https://www.github.com/toerless/ peering-bcp -13: o IESG feedback. Complete details in: https://raw.githubusercontent.com/toerless/peering-bcp/master/11- iesg-review-reply.txt o Ben Campbell: Location information about EU (End User) is Network Locatio information o Ben Campbell: Added explanation of assumption to introduction that traffic is sourced from AD-1 to (one or many) AD-2, mentioned that sourcing from EU is out of scope. o Introduction: moved up bullet points about exchanges and transit to clean up flow of assumptions. o Ben Campbell: Added picture for the GRE case, visualized tunnels in all pictures. o Ben Campbell: See 13-discus.txt on github for more details of changes for this review. o Alissia Cooper: Added more explanation for Log Management, explained privacy context. o Alissia Cooper: removed pre pre-RFC5378 disclaimer. o Alissia Cooper: removed mentioning of potential mutual compensation between domains if the other violates SLA. o Mirja Kuehlewind: created section 4.1.1 to discuss congestion control more detailled, adding reference to BCP145, removed stub CC paragraphs from section 3.1 (principle applies to every section 3.x, and did not want to duplicate text between 3.x and 4.x). o Mirja Kuehlewind: removed section 8 (conclusion). Text was not very good,This document does notimportant to hae conclusion, maybe bring back with better text if strong interest. o Introduced section about broadcast peering points because there where too many places already where references to that case existed (4.2.4). o Introduced section about privact considerations because of comment by Ben Campbell and Alissa Cooper. o Rewrote security considerations and structured it into key aspects: DoS attacks, content protection, peering point encryption and operational aspects. o Kathleen Moriarty: Added operational aspects to security section (also for Alissia), e.g.: covering securing the exchange of operational data between ADs. o Spencer Dawkins: Various editorial fixes. Removed BCP38 text from section 3, superceeded be explanation of PIM-SM RPF check to provide equvialent security to BCP38 in security section 7.1). o Eric Roscorla: (fixed from other reviews already). o Adam Roach: Fixed up text about MDH-04, added reference to RFC4786. -13: Fix for Mirja's review on must for congestion control. 11.require any IANA actions. 9. References11.1.9.1. Normative References [RFC2784] Farinacci, D., Li, T., Hanks, S., Meyer, D., and P. Traina, "Generic Routing Encapsulation (GRE)", RFC 2784, DOI 10.17487/RFC2784, March 2000, <https://www.rfc-editor.org/info/rfc2784>. [RFC3376] Cain, B., Deering, S., Kouvelas, I., Fenner, B., and A. Thyagarajan, "Internet Group Management Protocol, Version 3", RFC 3376, DOI 10.17487/RFC3376, October 2002, <https://www.rfc-editor.org/info/rfc3376>. [RFC3810] Vida, R.,Ed.Ed., and L. Costa, Ed., "Multicast Listener Discovery Version 2 (MLDv2) for IPv6", RFC 3810, DOI 10.17487/RFC3810, June 2004, <https://www.rfc-editor.org/info/rfc3810>. [RFC4760] Bates, T., Chandra, R., Katz, D., and Y. Rekhter, "Multiprotocol Extensions for BGP-4", RFC 4760, DOI 10.17487/RFC4760, January 2007, <https://www.rfc-editor.org/info/rfc4760>. [RFC4604] Holbrook, H., Cain, B., and B. Haberman, "Using Internet Group Management Protocol Version 3 (IGMPv3) and Multicast Listener Discovery Protocol Version 2 (MLDv2) forSource- SpecificSource-Specific Multicast", RFC 4604, DOI 10.17487/RFC4604, August 2006, <https://www.rfc-editor.org/info/rfc4604>. [RFC4609] Savola, P., Lehtonen, R., and D. Meyer, "Protocol Independent Multicast - Sparse Mode (PIM-SM) Multicast Routing Security Issues and Enhancements", RFC 4609, DOI 10.17487/RFC4609, October 2006, <https://www.rfc-editor.org/info/rfc4609>. [RFC7450] Bumgardner, G., "Automatic Multicast Tunneling", RFC 7450, DOI 10.17487/RFC7450, February 2015, <https://www.rfc-editor.org/info/rfc7450>. [RFC7761] Fenner, B., Handley, M., Holbrook, H., Kouvelas, I., Parekh, R., Zhang, Z., and L. Zheng, "Protocol Independent Multicast - Sparse Mode (PIM-SM): Protocol Specification (Revised)", STD 83, RFC 7761, DOI 10.17487/RFC7761, March 2016, <https://www.rfc-editor.org/info/rfc7761>. [BCP38] Ferguson, P. and D. Senie, "Network Ingress Filtering: Defeating Denial of Service Attacks which employ IP Source Address Spoofing", BCP 38, RFC 2827,DOI 10.17487/RFC2827,May 2000, <https://www.rfc-editor.org/info/rfc2827>. [BCP41] Floyd, S., "Congestion Control Principles", BCP 41, RFC 2914,DOI 10.17487/RFC2914,September 2000, <https://www.rfc-editor.org/info/rfc2914>. [BCP145] Eggert, L., Fairhurst, G., and G. Shepherd, "UDP Usage Guidelines", BCP 145, RFC 8085,DOI 10.17487/RFC8085,March 2017, <https://www.rfc-editor.org/info/rfc8085>.11.2.9.2. Informative References [RFC4786] Abley, J. and K. Lindqvist, "Operation of Anycast Services", BCP 126, RFC 4786, DOI 10.17487/RFC4786, December 2006, <https://www.rfc-editor.org/info/rfc4786>. [RFC6347] Rescorla, E. and N. Modadugu, "Datagram Transport Layer Security Version 1.2", RFC 6347, DOI 10.17487/RFC6347, January 2012, <https://www.rfc-editor.org/info/rfc6347>. [INF_ATIS_10] "CDN Interconnection Use Cases and Requirements in a Multi-Party Federation Environment", ATIS Standard A-0200010, December 2012.[MDH-04][MDH-05] Thaler, D. andothers,B. Aboba, "Multicast Debugging Handbook",IETF I-D draft-ietf-mboned-mdh-04.txt, MayWork in Progress, draft-ietf-mboned-mdh-05, November 2000. [Traceroute],"traceroute.org", <http://traceroute.org/#source%20code>.[I-D.ietf-mboned-mtrace-v2][Mtrace-v2] Asaeda, H., Meyer, K., and W. Lee, Ed., "Mtrace Version 2: Traceroute Facility for IP Multicast",draft-ietf-mboned- mtrace-v2-20 (workWork inprogress), OctoberProgress, draft-ietf-mboned-mtrace-v2-22, December 2017. Acknowledgments The authors would like to thank the following individuals for their suggestions, comments, and corrections: Mikael Abrahamsson Hitoshi Asaeda Dale Carder Tim Chown Leonard Giuliano Jake Holland Joel Jaeggli Henrik Levkowetz Albert Manfredi Stig Venaas Authors' Addresses Percy S. Tarapore (editor) AT&T Phone: 1-732-420-4172 Email: tarapore@att.com Robert Sayko AT&T Phone: 1-732-420-3292 Email: rs1983@att.com Greg Shepherd Cisco Email: shep@cisco.com Toerless Eckert (editor) Huawei USA - Futurewei Technologies Inc. Email:tte+ietf@cs.fau.dette+ietf@cs.fau.de, toerless.eckert@huawei.com Ram Krishnan SupportVectors Email: ramkri123@gmail.com