Network Working GroupInternet Engineering Task Force (IETF) B. DecraeneInternet-DraftRequest for Comments: 8405 OrangeIntended status:Category: Standards Track S. LitkowskiExpires: September 20, 2018ISSN: 2070-1721 Orange Business Service H. Gredler RtBrickIncInc. A. Lindem Cisco Systems P. Francois C. Bowers Juniper Networks, Inc.March 19,June 2018SPF Back-offShortest Path First (SPF) Back-Off DelayalgorithmAlgorithm forlink stateLink-State IGPsdraft-ietf-rtgwg-backoff-algo-10Abstract This document defines a standard algorithm to temporarily postpone or'back-off'"back off" link-state IGP Shortest Path First (SPF) computations. This reduces the computational load and churn on IGP nodes when multiple temporally close network events trigger multiple SPF computations. Having one standard algorithm improves interoperability by reducing the probability and/or duration of transient forwarding loops during the IGP convergence when the IGP reacts to multiple temporally close IGP events.Requirements Language The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in [BCP14] [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here.Status of This Memo ThisInternet-Draftissubmitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documentsan Internet Standards Track document. This document is a product of the Internet Engineering Task Force (IETF).Note that other groups may also distribute working documents as Internet-Drafts. The listIt represents the consensus ofcurrent Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents validthe IETF community. It has received public review and has been approved fora maximumpublication by the Internet Engineering Steering Group (IESG). Further information on Internet Standards is available in Section 2 ofsix monthsRFC 7841. Information about the current status of this document, any errata, and how to provide feedback on it may beupdated, replaced, or obsoleted by other documentsobtained atany time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on September 20, 2018.https://www.rfc-editor.org/info/rfc8405. Copyright Notice Copyright (c) 2018 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License. Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 1.1. Requirements Language . . . . . . . . . . . . . . . . . . 3 2.High level goalsHigh-Level Goals . . . . . . . . . . . . . . . . . . . . . . 3 3. Definitions andparametersParameters . . . . . . . . . . . . . . . . . 4 4. Principles of the SPFdelay algorithm . .Delay Algorithm . . . . . . . . . . . . 5 5. Specification of the SPFdelay state machineDelay State Machine . . . . . . . . 6 5.1. State Machine . . . . . . . . . . . . . . . . . . . . . . 6 5.2.State .States . . . . . . . . . . . . . . . . . . . . . . . . . 7 5.3. Timers . . . . . . . . . . . . . . . . . . . . . . . . .87 5.4. FSM Events . . . . . . . . . . . . . . . . . . . . . . .87 6. Parameters . . . . . . . . . . . . . . . . . . . . . . . . .109 7. Partial Deployment . . . . . . . . . . . . . . . . . . . . .1110 8. Impact onmicro-loopsMicro-loops . . . . . . . . . . . . . . . . . . . . 11 9. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 11 10. SecurityconsiderationsConsiderations . . . . . . . . . . . . . . . . . . .1211 11.AcknowledgementsReferences . . . . . . . . . . . . . . . . . . . . . .12 12. References. . . 11 11.1. Normative References . . . . . . . . . . . . . . . . . . 11 11.2. Informative References . . . . . .12 12.1. Normative References. . . . . . . . . . . 11 Acknowledgements . . . . . . .12 12.2. Informative References. . . . . . . . . . . . . . . . .1213 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 13 1. IntroductionLink stateLink-state IGPs, such as IS-IS[ISO10589-Second-Edition],[ISO10589], OSPF[RFC2328][RFC2328], and OSPFv3 [RFC5340], perform distributed route computation on all routers in the area/level. In order to have consistent routing tables across the network, such distributed computation requires that all routers have the same version of the network topology(Link State DataBase(Link-State Database (LSDB)) and perform their computation essentially at the same time. In general, when the network is stable, there is a desire to trigger a new Shortest Path First (SPF) computation as soon as a failure is detected in order to quickly route around the failure. However, when the network is experiencing multiple failures over a short period of time, there is a conflicting desire to limit the frequency of SPF computations, which would allow a reduction in control plane resources used by IGPs and all protocols/subsystems reactingonto the attendant route change, such as LDP [RFC5036], RSVP-TE [RFC3209], BGP [RFC4271], FastReRouteReroute computations (e.g.,Loop FreeLoop-Free Alternates(LFA)(LFAs) [RFC5286]), FIB updates, etc. This also reduces network churn and, in particular, reducestheside effectssuch(such as micro-loops[RFC5715][RFC5715]) that ensue during IGP convergence. To allow for this, IGPs usually implement an SPFBack-offBack-Off Delay algorithm that postpones orbacks-offbacks off the SPF computation. However, different implementationshave chosenchose different algorithms. Hence, in a multi-vendor network, it's not possible to ensure that all routers trigger their SPF computation after the same delay. This situation increases the average and maximum differential delay between routers completing their SPF computation. It also increases the probability that different routers compute their FIBs based on different LSDB versions. Both factors increase the probabilityand/ orand/or duration of micro-loops as discussed in Section 8.ToThis document specifies a standard algorithm to allow multi-vendor networks to have all routers delay their SPF computations for the sameduration,duration. 1.1. Requirements Language The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this documentspecifies a standard algorithm.are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here. 2.High level goalsHigh-Level Goals Thehigh levelhigh-level goals of this algorithm are the following: oVeryvery fast convergence for a single event (e.g., linkfailure).failure), oPacedpaced fast convergence for multiple temporally close IGP events while IGP stability is consideredacceptable.acceptable, oDelayeddelayed convergence when IGP stability isproblematic. Thisproblematic (this will allow the IGP and related processes to conserve resources during the period ofinstability.instability), and oAlways try to avoidavoidance of having different SPF_DELAYSection 3timer values (Section 3) across different routers in the area/level. This requires specific consideration as different routers may receive IGP messages at differentintervalintervals, or evenorder,in different orders, due to differences both in the distance from the originator of the IGP event and in flooding implementations. 3. Definitions andparametersParameters IGPevents:event: The reception or origination of an IGP LSDB change requiring a new routing table computation.ExamplesSome examples are a topology change, a prefixchangechange, and a metric change on a link or prefix. Note that locally triggering a routing table computation is not consideredasan IGP event since other IGP routers are unaware of this occurrence. Routing table computation, in this document, is scoped to theIGP. SoIGP; so, this is the computation of the IGP RIB, performed by the IGP, using the IGP LSDB. No distinction is made between the type of computationperformed.performed, e.g., full SPF, incremental SPF, or Partial Route Computation(PRC):(PRC); the type of computation is a local consideration. This document may interchangeably use the termsrouting"routing tablecomputationcomputation" andSPF computation."SPF computation". SPF_DELAY: The delay between the first IGP event triggering a new routing table computation and the start of that routing table computation. It can take the following values: INITIAL_SPF_DELAY: A very small delay to quickly handle a single isolated link failure, e.g., 0 milliseconds. SHORT_SPF_DELAY: A small delay to provide fast convergence in the case of a single component failure(node,(such as a node failure or Shared Risk Link Group(SRLG)..)(SRLG) failure) that leads to multiple IGP events, e.g., 50-100 milliseconds. LONG_SPF_DELAY: A long delay when the IGP is unstable, e.g., 2 seconds. Note that this allows the IGP network to stabilize. TIME_TO_LEARN_INTERVAL: This is the maximum duration typically needed to learn all the IGP events related to a single component failure(e.g.,(such as routerfailure,failure or SRLG failure), e.g., 1 second. It's mostly dependent on failure detection time variation between all routers that are adjacent to the failure. Additionally, it may depend on the different IGP implementations/parameters across thenetwork, relatednetwork and their relation to the origination and flooding oftheirlink state advertisements. HOLDDOWN_INTERVAL: The time required with no received IGPeventsevent before considering the IGP to be stable again and allowing the SPF_DELAY to be restored toINITIAL_SPF_DELAY. e.g.INITIAL_SPF_DELAY, e.g., a HOLDDOWN_INTERVAL of 3 seconds. The HOLDDOWN_INTERVAL MUST be defaultedandor configured to be longer than the TIME_TO_LEARN_INTERVAL. 4. Principles of the SPFdelay algorithmDelay Algorithm Forthisthe first IGP event, we assume that there has been a single simple change in thenetworknetwork, which can be taken into account using a single routing computation (e.g., link failure, prefix (metric)change)change), and we optimize for very fastconvergence,convergence by delaying the initial routing computationbyfor a small interval, INITIAL_SPF_DELAY. Under this assumption, there is no benefit in delaying the routing computation. In a typical network, this is the most common type of IGP event. Hence, it makes sense to optimize this case. If subsequent IGP events are received in a short period of time (TIME_TO_LEARN_INTERVAL), we then assume that a single component failed, but that this failure requires the knowledge of multiple IGP events in order for IGP routing to converge. Under this assumption, we want fast convergence since this is a normal network situation. However, there is a benefit in waiting for all IGP events related to this single componentfailure so thatfailure: the IGP can then compute the post- failure routing table in a single additional route computation. In this situation, we delay the routing computation by SHORT_SPF_DELAY. If IGP events are still received after TIME_TO_LEARN_INTERVAL from the initial IGP event received in QUIET state (see Section5.1,5.1), then the network is presumably experiencing multiple independent failures. In this case, while waiting for network stability, the computations are delayed for a longertimetime, which is represented by LONG_SPF_DELAY. This SPF delay iskeptused until no IGP events are received for HOLDDOWN_INTERVAL. Note that in order to increase the consistency network wide, the algorithm uses a delay (TIME_TO_LEARN_INTERVAL) from the initial IGPevent,event rather than the number of SPFcomputationcomputations performed. Indeed, as all routers may receive the IGP events at different times, we cannot assume that all routers will perform the same number of SPF computations. For example, assuming that the SPF delay is 50ms,milliseconds, router R1 may receive3three IGP events (E1, E2, E3) in those 50msmilliseconds and hence will perform a single routingcomputation. Whilecomputation, while another router R2 may only receive2two events (E1, E2) in those 50msmilliseconds and hence will schedule another routing computation when receiving E3. 5. Specification of the SPFdelay state machineDelay State Machine This section specifies thefinite state machineFinite State Machine (FSM) intended to control the timing of the execution of SPF calculations in response to IGP events. 5.1. State Machine The FSM is initialized to the QUIET state with all three timerstimers(SPF_TIMER, HOLDDOWN_TIMER, and LEARN_TIMER) deactivated. The eventswhichthat may change the FSM states are an IGP event or the expiration of one timer (SPF_TIMER, HOLDDOWN_TIMER, or LEARN_TIMER). The following diagram briefly describes the state transitions. +-------------------+ +---->| |<-------------------+ | | QUIET | | +-----| |<---------+ | 7: +-------------------+ | | SPF_TIMER | | | expiration | | | | 1: IGP event | | | | | v | | +-------------------+ | | +---->| | | | | | SHORT_WAIT |----->----+ | +-----| | | 2: +-------------------+ 6: HOLDDOWN_TIMER | IGP event | expiration | 8: SPF_TIMER | | expiration | | | 3: LEARN_TIMER | | expiration | | | v | +-------------------+ | +---->| | | | | LONG_WAIT |------------>-------+ +-----| | 4: +-------------------+ 5: HOLDDOWN_TIMER IGP event expiration 9: SPF_TIMER expiration Figure 1: State Machine 5.2.StateStates The naming and semantics of each state corresponds directly to the SPF delay used for IGP events received in that state. Three states are defined: QUIET: This is the initial state, when no IGP events have occurred for at least HOLDDOWN_INTERVAL since thepreviouslast routing table computation. The state is meant to handle link failures very quickly. SHORT_WAIT:StateThis is the state entered when an IGP event has been received in QUIET state. This state is meant to handle a single component failure requiring multiple IGP events (e.g., node, SRLG). LONG_WAIT:State reached after TIME_TO_LEARN_INTERVAL. In other words,This is the state reached after TIME_TO_LEARN_INTERVAL in state SHORT_WAIT. This state is meant to handle multiple independent component failures during periods of IGP instability. 5.3. Timers SPF_TIMER:TheThis is the FSM timer that uses the computed SPF delay. Upon expiration, theRoute Table Computationrouting table computation (as defined in Section 3) is performed. HOLDDOWN_TIMER:TheThis is the FSM timer that is (re)startedwhanwhen an IGP event is received and set to HOLDDOWN_INTERVAL. Upon expiration, the FSM is moved to the QUIET state. LEARN_TIMER:TheThis is the FSM timer that is started when an IGP event isreceviedreceived while the FSM is in the QUIET state. Upon expiration, the FSM is moved to the LONG_WAIT state. 5.4. FSM Events This section describes the events and the actions performed in response. Transition 1: IGPevent,event while in QUIETstate.state Actions on event 1: o If SPF_TIMER is not already running, start it with value INITIAL_SPF_DELAY. o Start LEARN_TIMER with TIME_TO_LEARN_INTERVAL. o Start HOLDDOWN_TIMER with HOLDDOWN_INTERVAL. o Transition to SHORT_WAIT state. Transition 2: IGPevent,event while inSHORT_WAIT.SHORT_WAIT Actions on event 2: o Reset HOLDDOWN_TIMER to HOLDDOWN_INTERVAL. o If SPF_TIMER is not already running, start it with value SHORT_SPF_DELAY. o Remain in current state. Transition 3: LEARN_TIMERexpiration.expiration Actions on event 3: o Transition to LONG_WAIT state. Transition 4: IGPevent,event while inLONG_WAIT.LONG_WAIT Actions on event 4: o Reset HOLDDOWN_TIMER to HOLDDOWN_INTERVAL. o If SPF_TIMER is not already running, start it with value LONG_SPF_DELAY. o Remain in current state. Transition 5: HOLDDOWN_TIMERexpiration,expiration while inLONG_WAIT.LONG_WAIT Actions on event 5: o Transition to QUIET state. Transition 6: HOLDDOWN_TIMERexpiration,expiration while inSHORT_WAIT.SHORT_WAIT Actions on event 6: o Deactivate LEARN_TIMER. o Transition to QUIET state. Transition 7: SPF_TIMERexpiration,expiration while inQUIET.QUIET Actions on event 7: o Compute SPF. o Remain in current state. Transition 8: SPF_TIMERexpiration,expiration while inSHORT_WAIT.SHORT_WAIT Actions on event 8: o Compute SPF. o Remain in current state. Transition 9: SPF_TIMERexpiration,expiration while inLONG_WAIT.LONG_WAIT Actions on event 9: o Compute SPF. o Remain in current state. 6. Parameters All the parameters MUST be configurable at the protocol instancegranularity.level. They MAY be configurableat the area/level granularity.on a per IGP LSDB basis (e.g., IS-IS level, OSPF area, or IS-IS Level 1 area). All the delays (INITIAL_SPF_DELAY, SHORT_SPF_DELAY, LONG_SPF_DELAY, TIME_TO_LEARN_INTERVAL, and HOLDDOWN_INTERVAL) SHOULD be configurableat the millisecond granularity.with a granularity of a millisecond. They MUST be configurable with a granularity of at leastat thea tenth ofsecond granularity.a second. The configurable range for all the parameters SHOULDat leastbe from 0 milliseconds to60 seconds.at least 6000 milliseconds. The HOLDDOWN_INTERVAL MUST be defaulted or configured to be longer than the TIME_TO_LEARN_INTERVAL. If this SPFbackoffBack-Off algorithm is enabled by default, then in order to have consistent SPF delays between implementations with default configuration, the following default values SHOULD be implemented: INITIAL_SPF_DELAY 50ms,ms SHORT_SPF_DELAY200ms, LONG_SPF_DELAY: 5 000ms,200 ms LONG_SPF_DELAY 5000 ms TIME_TO_LEARN_INTERVAL500ms,500 ms HOLDDOWN_INTERVAL10 000ms.10000 ms In order to satisfy the goals stated in Section 2, operators are RECOMMENDED to configure delay intervals such that INITIAL_SPF_DELAY <= SHORT_SPF_DELAY and SHORT_SPF_DELAY <= LONG_SPF_DELAY. When setting (default) values, one should consider the customers and their application requirements, the computational power of the routers, the size of thenetwork, and, in particular,network as determined primarily by the number of IP prefixes advertised in the IGP, the frequency and number of IGP events, and the number ofprotocolsprotocol reactions/computations triggered by IGP SPF computation (e.g., BGP,PCEP,Path Computation Element Communication Protocol (PCEP), Traffic EngineeringCSPF,Constrained SPF (CSPF), and FastReRouteReroute computations). Note that some or all of these factors may change over the life of the network. In case of doubt, it's RECOMMENDED that timer intervals should be chosen conservatively (i.e., longer timer values). For the standard algorithm to be effective in mitigating micro-loops, it is RECOMMENDED that all routers in the IGP domain, or at least all the routers in the same area/level, have exactly the same configured values. 7. Partial Deployment In general, the SPFBack-offBack-Off Delay algorithm is only effective in mitigating micro-loops if it isdeployed,deployed with the sameparameters,parameters on all routers in the IGP domain or, at least, all routers in an IGP area/level. The impact of partial deployment is dependent on the particular event, the topology, and the algorithm(s) used on other routers in the IGP area/level. In cases where the previous SPF Back-offOff Delay algorithm was implemented uniformly, partial deployment will increase the frequency and duration of micro-loops. Hence, it is RECOMMENDED that all routers in the IGPdomaindomain, or at least within the samearea/levelarea/level, be migrated to the SPF algorithm described herein at roughly the same time. Note that this is not a newconsideration asconsideration; overtimes,time, network operators have changed SPF delay parameters in order to accommodate new customer requirements for fast convergence, as permitted by new software and hardware. They may also have progressively replaced an implementationwithusing a given SPFBack-offBack-Off Delay algorithmbywith another implementationwithusing a different one. 8. Impact onmicro-loopsMicro-loops Micro-loops during IGP convergence are due to a non-synchronized or non-ordered update ofthe forwarding information tables (FIB)FIBs [RFC5715] [RFC6976][I-D.ietf-rtgwg-spf-uloop-pb-statement].[SPF-MICRO]. FIBs are installed after multiplestepssteps, such as flooding of the IGP event across the network, SPF wait time, SPF computation, FIB distribution across line cards, and FIB update. This document only addresses the contribution from the SPF wait time. This standardized procedure reduces the probability and/or duration of micro-loops when IGPs experience multiple temporally close events. It does not prevent allmicro-loops. However,micro-loops; however, it is beneficial and is less complex and costly to implement when compared to full solutions such as[RFC5715]Distributed Tunnels [RFC5715], Synchronized FIB Update [RFC5715], or the ordered FIB approach [RFC6976]. 9. IANA ConsiderationsNoThis document has no IANAactions required.actions. 10. SecurityconsiderationsConsiderations The algorithm presented in this document does not compromise IGP security. An attacker having the ability to generate IGP events would be able to delay the IGP convergence time. The LONG_SPF_DELAY state may help mitigate the effects of Denial-of-Service(DOS)(DoS) attacks generating many IGP events. 11.Acknowledgements We would like to acknowledge Les Ginsberg, Uma Chunduri, Mike Shand and Alexander Vainshtein for the discussions and comments related to this document. 12.References12.1.11.1. Normative References [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, <https://www.rfc-editor.org/info/rfc2119>. [RFC8174] Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174, May 2017, <https://www.rfc-editor.org/info/rfc8174>.12.2.11.2. Informative References[I-D.ietf-rtgwg-spf-uloop-pb-statement] Litkowski, S., Decraene, B., and M. Horneffer, "Link State protocols SPF trigger and delay algorithm impact on IGP micro-loops", draft-ietf-rtgwg-spf-uloop-pb-statement-06 (work in progress), January 2018. [ISO10589-Second-Edition][ISO10589] International Organization for Standardization,"Intermediate system"Information technology -- Telecommunications and information exchange between systems -- Intermediate System to IntermediatesystemSystem intra-domain routeing information exchange protocol for use in conjunction with the protocol for providing the connectionless-modeNetwork Servicenetwork service (ISO 8473)",ISO/ IECISO/IEC 10589:2002, Second Edition,NovNovember 2002. [RFC2328] Moy, J., "OSPF Version 2", STD 54, RFC 2328, DOI 10.17487/RFC2328, April 1998, <https://www.rfc-editor.org/info/rfc2328>. [RFC3209] Awduche, D., Berger, L., Gan, D., Li, T., Srinivasan, V., and G. Swallow, "RSVP-TE: Extensions to RSVP for LSP Tunnels", RFC 3209, DOI 10.17487/RFC3209, December 2001, <https://www.rfc-editor.org/info/rfc3209>. [RFC4271] Rekhter, Y., Ed., Li, T., Ed., and S. Hares, Ed., "A Border Gateway Protocol 4 (BGP-4)", RFC 4271, DOI 10.17487/RFC4271, January 2006, <https://www.rfc-editor.org/info/rfc4271>. [RFC5036] Andersson, L., Ed., Minei, I., Ed., and B. Thomas, Ed., "LDP Specification", RFC 5036, DOI 10.17487/RFC5036, October 2007, <https://www.rfc-editor.org/info/rfc5036>. [RFC5286] Atlas, A., Ed. and A. Zinin, Ed., "Basic Specification for IP Fast Reroute: Loop-Free Alternates", RFC 5286, DOI 10.17487/RFC5286, September 2008, <https://www.rfc-editor.org/info/rfc5286>. [RFC5340] Coltun, R., Ferguson, D., Moy, J., and A. Lindem, "OSPF for IPv6", RFC 5340, DOI 10.17487/RFC5340, July 2008, <https://www.rfc-editor.org/info/rfc5340>. [RFC5715] Shand, M. and S. Bryant, "A Framework for Loop-Free Convergence", RFC 5715, DOI 10.17487/RFC5715, January 2010, <https://www.rfc-editor.org/info/rfc5715>. [RFC6976] Shand, M., Bryant, S., Previdi, S., Filsfils, C., Francois, P., and O. Bonaventure, "Framework for Loop-Free Convergence Using the Ordered Forwarding Information Base (oFIB) Approach", RFC 6976, DOI 10.17487/RFC6976, July 2013, <https://www.rfc-editor.org/info/rfc6976>. [SPF-MICRO] Litkowski, S., Decraene, B., and M. Horneffer, "Link State protocols SPF trigger and delay algorithm impact on IGP micro-loops", Work in Progress, draft-ietf-rtgwg-spf- uloop-pb-statement-07, May 2018. Acknowledgements We would like to acknowledge Les Ginsberg, Uma Chunduri, Mike Shand, and Alexander Vainshtein for the discussions and comments related to this document. Authors' Addresses Bruno Decraene Orange Email: bruno.decraene@orange.com Stephane Litkowski Orange Business Service Email: stephane.litkowski@orange.com Hannes Gredler RtBrickIncInc. Email: hannes@rtbrick.com Acee Lindem Cisco Systems 301 Midenhall Way Cary, NC 27513USAUnited States of America Email: acee@cisco.com Pierre Francois Email: pfrpfr@gmail.com Chris Bowers Juniper Networks, Inc. 1194 N. Mathilda Ave. Sunnyvale, CA 94089USUnited States of America Email: cbowers@juniper.net