--- 1/draft-ietf-mpls-entropy-lsp-ping-04.txt 2016-09-05 18:15:53.624676229 -0700 +++ 2/draft-ietf-mpls-entropy-lsp-ping-05.txt 2016-09-05 18:15:53.668677103 -0700 @@ -1,45 +1,44 @@ MPLS Working Group N. Akiya Internet-Draft Big Switch Networks -Updates: 4379, 6424, 6790 (if approved) G. Swallow +Updates: 6790 (if approved) G. Swallow Intended status: Standards Track C. Pignataro -Expires: February 12, 2017 Cisco +Expires: March 9, 2017 Cisco A. Malis Huawei Technologies S. Aldrin Google - August 11, 2016 + September 5, 2016 Label Switched Path (LSP) and Pseudowire (PW) Ping/Trace over MPLS Network using Entropy Labels (EL) - draft-ietf-mpls-entropy-lsp-ping-04 + draft-ietf-mpls-entropy-lsp-ping-05 Abstract Multiprotocol Label Switching (MPLS) Label Switched Path (LSP) Ping and Traceroute are methods used to test Equal-Cost Multipath (ECMP) paths. Ping is known as a connectivity verification method and Traceroute as a fault isolation method, as described in RFC 4379. When an LSP is signaled using the Entropy Label (EL) described in RFC 6790, the ability for LSP Ping and Traceroute operations to discover - and exercise ECMP paths is lost for scenarios where LSRs apply - different load balancing techniques. One such scenario is when some - LSRs apply EL-based load balancing while other LSRs apply non-EL - based load balancing (e.g., IP). Another scenario is when an EL- - based LSP is stitched with another LSP which can be EL-based or non- - EL based. + and exercise ECMP paths is lost for scenarios where Label Switching + Routers (LSRs) apply different load balancing techniques. One such + scenario is when some LSRs apply EL-based load balancing while other + LSRs apply non-EL-based load balancing (e.g., IP). Another scenario + is when an EL-based LSP is stitched with another LSP which can be EL- + based or non-EL-based. This document extends the MPLS LSP Ping and Traceroute multipath mechanisms in RFC 6424 to allow the ability of exercising LSPs which - make use of the EL. This document updates RFC 4379, RFC 6424, and - RFC 6790. + make use of the EL. This document updates RFC 6790. Requirements Language The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119 [RFC2119]. Status of This Memo This Internet-Draft is submitted in full conformance with the @@ -48,21 +47,21 @@ Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at http://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." - This Internet-Draft will expire on February 12, 2017. + This Internet-Draft will expire on March 9, 2017. Copyright Notice Copyright (c) 2016 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (http://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents @@ -78,24 +77,24 @@ 1.1. Terminology . . . . . . . . . . . . . . . . . . . . . . . 3 1.2. Background . . . . . . . . . . . . . . . . . . . . . . . 4 2. Overview . . . . . . . . . . . . . . . . . . . . . . . . . . 5 3. Multipath Type 9 . . . . . . . . . . . . . . . . . . . . . . 7 4. Pseudowire Tracing . . . . . . . . . . . . . . . . . . . . . 7 5. Entropy Label FEC . . . . . . . . . . . . . . . . . . . . . . 8 6. DS Flags: L and E . . . . . . . . . . . . . . . . . . . . . . 9 7. New Multipath Information Type: TBD4 . . . . . . . . . . . . 10 8. Initiating LSR Procedures . . . . . . . . . . . . . . . . . . 11 9. Responder LSR Procedures . . . . . . . . . . . . . . . . . . 13 - 9.1. IP Based Load Balancer & Not Pushing ELI/EL . . . . . . . 14 + 9.1. IP-based Load Balancer & Not Pushing ELI/EL . . . . . . . 14 9.2. IP Based Load Balancer & Pushes ELI/EL . . . . . . . . . 14 - 9.3. Label Based Load Balancer & Not Pushing ELI/EL . . . . . 15 - 9.4. Label Based Load Balancer & Pushes ELI/EL . . . . . . . . 16 + 9.3. Label-based Load Balancer & Not Pushing ELI/EL . . . . . 15 + 9.4. Label-based Load Balancer & Pushes ELI/EL . . . . . . . . 16 9.5. Flow-Aware MS-PW Stitching LSR . . . . . . . . . . . . . 17 10. Supported and Unsupported Cases . . . . . . . . . . . . . . . 17 11. Security Considerations . . . . . . . . . . . . . . . . . . . 19 12. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 19 12.1. Entropy Label FEC . . . . . . . . . . . . . . . . . . . 19 12.2. DS Flags . . . . . . . . . . . . . . . . . . . . . . . . 19 12.3. Multipath Type . . . . . . . . . . . . . . . . . . . . . 20 13. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 20 14. Contributing Authors . . . . . . . . . . . . . . . . . . . . 20 15. References . . . . . . . . . . . . . . . . . . . . . . . . . 20 @@ -106,23 +105,27 @@ 1. Introduction 1.1. Terminology The following acronyms and terms are used in this document: o MPLS - Multiprotocol Label Switching. o LSP - Label Switched Path. + o Stitched LSP - Stitched Label Switched Paths combine several LSPs + such that a single end-to-end (e2e) LSP is realized. [RFC6424] + describes LSP Ping for Stitched LSPs. + o LSR - Label Switching Router. - o FEC - Forwarding Equivalent Class. + o FEC - Forwarding Equivalence Class. o ECMP - Equal-Cost Multipath. o EL - Entropy Label. o ELI - Entropy Label Indicator. o GAL - Generic Associated Channel Label. o MS-PW - Multi-Segment Pseudowire. @@ -152,202 +155,204 @@ MPLS implementations employ a wide variety of load balancing techniques in terms of fields used for hash "keys". The mechanisms in [RFC4379] and updated by [RFC6424] are designed to provide multipath support for a subset of techniques. The intent of this document is to provide multipath support for the supported techniques which are compromised by the use of ELs [RFC6790]. Section 10 describes supported and unsupported cases, and it may be useful for the reader to first review this section. The Downstream Detailed Mapping (DDMAP) TLV [RFC6424] provides - multipath information which can be used by an LSP Ping initiator to + Multipath Information which can be used by an LSP Ping initiator to trace and validate ECMP paths between an ingress and egress. The - multipath information encodings defined by [RFC6424] are sufficient + Multipath Information encodings defined by [RFC6424] are sufficient when all the LSRs along the path(s), between ingress and egress, consider the same set of "keys" as input for load balancing - algorithms, e.g. either all IP-based or all label-based. + algorithms, e.g., either all IP-based or all label-based. With the introduction of [RFC6790], some LSRs may perform load balancing based on labels while others may be IP-based. This results - in an LSP Ping initiator to not be able to trace and validate all the + in an LSP Ping initiator that is unable to trace and validate all the ECMP paths in the following scenarios: - o One or more transit LSRs along an LSP with ELI/EL in label stack - do not perform ECMP load balancing based on EL (hashes based on - "keys" including the IP destination address). This scenario is + o One or more transit LSRs along an LSP with ELI/EL in the label + stack do not perform ECMP load balancing based on EL (hashes based + on "keys" including the IP destination address). This scenario is not only possible but quite common due to transit LSRs not implementing [RFC6790] or transit LSRs implementing [RFC6790], but not implementing the suggested transit LSR behavior in Section 4.3 of [RFC6790]. o Two or more LSPs stitched together with at least one of these LSPs pushing ELI/EL into the label stack. These scenarios can be quite common because deployments of [RFC6790] typically have a mixture of nodes that support ELI/EL and nodes that do not. There will also typically be a mixture of areas that support ELI/EL and areas that do not. As pointed out in [RFC6790], the procedures of [RFC4379] (and - consequently of [RFC6424]) with respect to multipath information type + consequently of [RFC6424]) with respect to Multipath Information Type {9} are incomplete. However, [RFC6790] does not actually update [RFC4379]. Further, the specific EL location is not clearly defined, particularly in the case of Flow Aware Pseudowires [RFC6391]. This document defines a new FEC Stack sub-TLV for the entropy label. - Section 3 of this document updates the procedures for multipath - information type {9} described in [RFC4379] and applicable to + Section 3 of this document updates the procedures for Multipath + Information Type {9} described in [RFC4379] and applicable to [RFC6424]. The rest of this document describes extensions required to restore ECMP discovery and tracing capabilities for the scenarios described. [RFC4379], [RFC6424], and this document will support IP-based load balancers and label-based load balancers which limit their hash to the first (top-most) or only entropy label in the label stack. Other use cases (refer to Section 10) are out of scope. 2. Overview [RFC4379] describes LSP traceroute as an operation where the initiating LSR sends a series of MPLS echo requests towards the same destination. The first packet in the series has the TTL set to 1. When the echo reply is received from the LSR one hop away, the second echo request in the series is sent with the TTL set to 2. For each additional echo request the TLL is incremented by one until a response is received from the intended destination. The initiating - LSR discovers and exercises ECMP by obtaining multipath information + LSR discovers and exercises ECMP by obtaining Multipath Information from each transit LSR and using a specific destination IP address or specific entropy label. - From here on, the notation {x, y, z} refers to multipath information - types x, y or z. Multipath information types are defined in + From here on, the notation {x, y, z} refers to Multipath Information + Types x, y, or z. Multipath Information Types are defined in Section 3.3 of [RFC4379]. - The LSR initiating LSP Ping sends an MPLS echo request with multipath - information. This multipath information is described in the echo + The LSR initiating LSP Ping sends an MPLS echo request with Multipath + Information. This Multipath Information is described in the echo request's DDMAP TLV, and may contain a set of IP addresses or a set - of labels. Multipath information types {2, 4, 8} carry a set of IP - addresses, and multipath information type {9} carries a set of + of labels. Multipath Information Types {2, 4, 8} carry a set of IP + addresses, and Multipath Information Type {9} carries a set of labels. The responder LSR (the receiver of the MPLS echo request) - will determine the subset of initiator-specified multipath - information which load balances to each downstream (outgoing - interface). The responder LSR sends an MPLS echo reply with - resulting multipath information per downstream (outgoing interface) - back to the initiating LSR. The initiating LSR is then able to use a - specific IP destination address or a specific label to exercise a - specific ECMP path on the responder LSR. + will determine the subset of initiator-specified Multipath + Information which load balances to each downstream (outgoing) + interface. The responder LSR sends an MPLS echo reply with resulting + Multipath Information per downstream (outgoing interface) back to the + initiating LSR. The initiating LSR is then able to use a specific IP + destination address or a specific label to exercise a specific ECMP + path on the responder LSR. - Current behavior is problematic in following scenarios: + The current behavior is problematic in the following scenarios: - o The initiating LSR sends IP multipath information, but the + o The initiating LSR sends IP Multipath Information, but the responder LSR load balances on labels. - o The initiating LSR sends label multipath information, but the + o The initiating LSR sends Label Multipath Information, but the responder LSR load balances on IP addresses. - o The initiating LSR sends existing multipath information to an LSR + o The initiating LSR sends existing Multipath Information to an LSR which pushes ELI/EL in the label stack, but the initiating LSR can only continue to discover and exercise specific paths of the ECMP, if the LSR which pushes ELI/EL responds with both IP addresses and the associated EL corresponding to each IP address. This is because: - * An ELI/EL pushing LSR that is a stitching point will load + * An ELI/EL-pushing LSR that is a stitching point will load balance based on the IP address. - * Downstream LSR(s) of an ELI/EL pushing LSR may load balance + * Downstream LSR(s) of an ELI/EL-pushing LSR may load balance based on ELs. - o The initiating LSR sends existing multipath information to an ELI/ - EL pushing LSR, but the initiating LSR can only continue to - discover and exercise specific paths of ECMP, if the ELI/EL - pushing LSR responds with both labels and associated EL + o The initiating LSR sends existing Multipath Information to an ELI/ + EL-pushing LSR, but the initiating LSR can only continue to + discover and exercise specific paths of ECMP, if the ELI/EL- + pushing LSR responds with both labels and the associated EL corresponding to the label. This is because: - * An ELI/EL pushing LSR that is a stitching point will load - balance based on EL from the previous LSP and pushes a new EL. + * An ELI/EL-pushing LSR that is a stitching point will load + balance based on the EL from the previous LSP and pushes a new + EL. - * Downstream LSR(s) of ELI/EL pushing LSR may load balance based + * Downstream LSR(s) of ELI/EL-pushing LSR may load balance based on new ELs. - The above scenarios demonstrate the existing multipath information is + The above scenarios demonstrate the existing Multipath Information is insufficient when LSP traceroute is used on an LSP with entropy - labels [RFC6790]. This document defines a new multipath information - type to be used in the DDMAP of MPLS echo request/reply packets for + labels [RFC6790]. This document defines a new Multipath Information + Type to be used in the DDMAP of MPLS echo request/reply packets for [RFC6790] LSPs. - The responder LSR can reply with empty multipath information if no IP - address is set or label set is received with the multipath - information. An empty return is also possible if an initiating LSR - sends multipath information of one type, IP address or label, but the + The responder LSR can reply with empty Multipath Information if no IP + address is set or label set is received with the Multipath + Information. An empty return is also possible if an initiating LSR + sends Multipath Information of one type, IP Address or Label, but the responder LSR load balances on the other type. To disambiguate between the two results, this document introduces new flags in the DDMAP TLV to allow the responder LSR to describe the load balancing technique being used. - All LSRs along the LSP need to be able to understand the new flags - and the new multipath information type. It is also required that the - initiating LSR can select both the IP destination address and label - to use when transmitting MPLS echo request packets. Two additional - DS Flags are defined for the DDMAP TLV in Section 6. These two flags - are used by the responder LSR to describe its load balance behavior - on a received MPLS echo request. + To use this enhanced method end-to-end, all LSRs along the LSP need + to be able to understand the new flags and the new Multipath + Information Type. Mechanisms to verify this condition are outside of + the scope of this document. The rest of the requirements are + detailed in the initiating LSR and responder LSR procedures. Two + additional DS Flags are defined for the DDMAP TLV in Section 6. + These two flags are used by the responder LSR to describe its load + balance behavior on a received MPLS echo request. Note that the terms "IP-Based Load Balancer" and "Label-Based Load Balancer" are in context of how a received MPLS echo request is handled by the responder LSR. 3. Multipath Type 9 - [RFC4379] defined multipath type {9} for tracing of LSPs where label + [RFC4379] defined Multipath Type {9} for tracing of LSPs where label- based load balancing is used. However, as pointed out in [RFC6790], the procedures for using this type are incomplete as the specific location of the label was not defined. It was assumed that the - presence of multipath type {9} implied the value of the bottom-of- + presence of Multipath Type {9} implied the value of the bottom-of- stack label should be varied by the values indicated by multipath to determine the respective outgoing interfaces. Section 5 defines a new FEC-Stack sub-TLV to indicate an entropy label. These labels MAY appear anywhere in a label stack. - Multipath type {9} applies to the first label in the label stack that + Multipath Type {9} applies to the first label in the label stack that corresponds to an EL-FEC. If no such label is found, it applies to the label at the bottom of the label stack. 4. Pseudowire Tracing This section defines procedures for tracing pseudowires. These - procedures pertain to the use of multipath information type {9} as - well as type {TBD4}. In all cases below, when a control word is in + procedures pertain to the use of Multipath Information Type {9} as + well as Type {TBD4}. In all cases below, when a control word is in use, the N-flag in the DDMAP MUST be set. Note that when a control word is not in use, the returned DDMAPs may not be accurate. In order to trace a non-flow-aware Pseudowire, the initiator includes - an EL-FEC instead of the appropriate PW-FEC at the bottom of the FEC + an EL-FEC instead of the appropriate PW FEC at the bottom of the FEC stack. Tracing in this way will cause compliant routers to return the proper outgoing interface. Note that this procedure only traces to the end of the MPLS LSP that is under test and will not verify the PW FEC. To actually verify the PW FEC or in the case of a MS-PW, to determine the next pseudowire label value, the initiator MUST repeat that step of the trace (i.e., repeating the TTL value used) but with the FEC Stack modified to contain the appropriate PW FEC. Note that these procedures are applicable to scenarios where an initiator is able to vary the bottom label (i.e., Pseudowire label). Possible scenarios are tracing multiple non-flow-aware Pseudowires on the same endpoints or tracing a non-flow-aware Pseudowire provisioned with multiple Pseudowire labels. In order to trace a flow-aware Pseudowire [RFC6391], the initiator includes an EL FEC at the bottom of the FEC Stack and pushes the appropriate PW FEC onto the FEC Stack. In order to trace through non-compliant routers, the initiator forms - an MPLS echo request message and includes a DDMAP with multipath type + an MPLS echo request message and includes a DDMAP with Multipath Type {9}. For a non-flow-aware Pseudowire it includes the appropriate PW FEC in the FEC Stack. For a flow-aware Pseudowire, the initiator includes a Nil FEC at the bottom of the FEC Stack and pushes the appropriate PW FEC onto the FEC Stack. 5. Entropy Label FEC The entropy label indicator (ELI) is a reserved label that has no explicit FEC associated, and has label value 7 assigned from the reserved range. Use the Nil FEC as the Target FEC Stack sub-TLV to @@ -390,60 +395,60 @@ +-+-+-+-+-+-+-+-+ | MBZ |L|E|I|N| +-+-+-+-+-+-+-+-+ RFC-Editor-Note: Please update the above figure to place the flag E in the bit number TBD2 and the flag L in the bit number TBD3. Flag Name and Meaning ---- ---------------- L Label-based load balance indicator - This flag MUST be set to zero in the echo request. An LSR + This flag MUST be cleared in the echo request. An LSR which performs load balancing on a label MUST set this flag in the echo reply. An LSR which performs load balancing on IP MUST NOT set this flag in the echo reply. E ELI/EL push indicator - This flag MUST be set to zero in the echo request. An LSR + This flag MUST be cleared in the echo request. An LSR which pushes ELI/EL MUST set this flag in the echo reply. An LSR which does not push ELI/EL MUST NOT set this flag in the echo reply. The two flags result in four load balancing techniques which the echo reply generating LSR can indicate: o {L=0, E=0} LSR load balances based on IP and does not push ELI/EL. o {L=0, E=1} LSR load balances based on IP and pushes ELI/EL. o {L=1, E=0} LSR load balances based on labels and does not push ELI/EL. o {L=1, E=1} LSR load balances based on labels and pushes ELI/EL. 7. New Multipath Information Type: TBD4 - One new multipath information type is added to be used in DDMAP TLV. - This new multipath type has the value of TBD4. + One new Multipath Information Type is added to be used in DDMAP TLV. + This new Multipath Type has the value of TBD4. Key Type Multipath Information --- ---------------- --------------------- - TBD4 IP and label set IP addresses and label prefixes + TBD4 IP and Label set IP addresses and label prefixes - Multipath type TBD4 is comprised of three sections. The first + Multipath Type TBD4 is comprised of three sections. The first section describes the IP address set. The second section describes the label set. The third section describes another label set which associates to either the IP address set or the label set specified in the other sections. - Multipath information type TBD4 has following format: + Multipath Information Type TBD4 has following format: 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |IPMultipathType| IP Multipath Length | Reserved(MBZ) | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ ~ ~ | (IP Multipath Information) | ~ ~ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ @@ -458,301 +463,300 @@ ~ ~ | (Associated Label Multipath Information) | ~ ~ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Figure 2: Multipath Information Type TBD4 o IPMultipathType * 0 when "IP Multipath Information" is omitted. Otherwise, one - of the IP multipath information values: {2, 4, 8}. + of the IP Multipath Information values: {2, 4, 8}. o IP Multipath Information * This section is omitted when "IPMultipathType" is 0. - Otherwise, this section reuses IP multipath information from - [RFC4379]. Specifically, multipath information for values {2, + Otherwise, this section reuses IP Multipath Information from + [RFC4379]. Specifically, Multipath Information for values {2, 4, 8} can be used. o LbMultipathType * 0 when "Label Multipath Information" is omitted. Otherwise, - label multipath information value {9}. + Label Multipath Information value {9}. o Label Multipath Information * This section is omitted when "LbMultipathType" is 0. - Otherwise, this section reuses label multipath information from - [RFC4379]. Specifically, multipath information for value {9} + Otherwise, this section reuses Label Multipath Information from + [RFC4379]. Specifically, Multipath Information for value {9} can be used. o Associated Label Multipath Information - * "Assoc Label Multipath Length" is a 16 bit field of multipath - information which indicates the length in octets of the - associated label multipath information. + * "Assoc Label Multipath Length" is a 16-bit field of Multipath + Information which indicates the length in octets of the + Associated Label Multipath Information. * "Associated Label Multipath Information" is a list of labels with each label described in 24 bits. This section MUST be omitted in an MPLS echo request message. A midpoint which pushes ELI/EL labels SHOULD include "Assoc Label Multipath Information" in its MPLS echo reply message, along with either "IP Multipath Information" or "Label Multipath Information". Each specified associated label described in this section maps to a specific IP address OR label described in the "IP Multipath Information" section or "Label Multipath Information" section. For example, if three IP addresses are specified in the "IP Multipath Information" section, then there MUST be three labels described in this section. The first label maps to the first IP address specified, the second label maps to the second IP address specified, and the third label maps to the third IP address specified. - When a section is omitted, the length for that section MUST BE set to + When a section is omitted, the length for that section MUST be set to zero. 8. Initiating LSR Procedures The following procedure is described in terms of an EL_LSP boolean - maintained by the initiating LSR. This value controls the multipath - information type to be used in the transmitted echo request packets. + maintained by the initiating LSR. This value controls the Multipath + Information Type to be used in the transmitted echo request packets. When the initiating LSR is transmitting an echo request packet with - DDMAP with a non-zero multipath information type, then the EL_LSP - boolean MUST be consulted to determine the multipath information type + DDMAP with a non-zero Multipath Information Type, then the EL_LSP + boolean MUST be consulted to determine the Multipath Information Type to use. In addition to procedures described in [RFC4379], as updated by Section 3 and [RFC6424], the initiating LSR MUST operate with the following procedures: o When the initiating LSR pushes ELI/EL, initialize EL_LSP=True. Else set EL_LSP=False. - o When the initiating LSR is transmitting a non-zero multipath - information type: + o When the initiating LSR is transmitting a non-zero Multipath + Information Type: - * If (EL_LSP), the initiating LSR MUST use multipath information - type {TBD4} unless the responder LSR cannot handle type {TBD4}. - When the initiating LSR is transmitting multipath information - type {TBD4}, both "IP Multipath Information" and "Label - Multipath Information" MUST be included, and "IP Associated - Label Multipath Information" MUST be omitted (NULL). + * If (EL_LSP), the initiating LSR MUST use Multipath Information + Type {TBD4} unless the responder LSR cannot handle Type {TBD4}. + When the initiating LSR is transmitting Multipath Information + Type {TBD4}, both "IP Multipath Information" and "Label + Multipath Information" MUST be included, and "Associated Label + Multipath Information" MUST be omitted (NULL). - * Else the initiating LSR MAY use multipath information type {2, + * Else the initiating LSR MAY use Multipath Information Type {2, 4, 8, 9, TBD4}. When the initiating LSR is transmitting - multipath information type {TBD4} in this case, "IP Multipath + Multipath Information Type {TBD4} in this case, "IP Multipath Information" MUST be included, and "Label Multipath - Information" and "IP Associated Label Multipath Information" - MUST be omitted (NULL). + Information" and "Associated Label Multipath Information" MUST + be omitted (NULL). - o When the initiating LSR receives echo reply with {L=0, E=1} in DS - flags with valid contents, set EL_LSP=True. + o When the initiating LSR receives an echo reply with {L=0, E=1} in + the DS flags with valid contents, set EL_LSP=True. In the following conditions, the initiating LSR may have lost the ability to exercise specific ECMP paths. The initiating LSR MAY continue with "best effort" in the following cases: - o Received echo reply contains empty multipath information. + o Received echo reply contains empty Multipath Information. o Received echo reply contains {L=0, E=} DS flags, but does not - contain IP multipath information. + contain IP Multipath Information. o Received echo reply contains {L=1, E=} DS flags, but does not - contain label multipath information. + contain Label Multipath Information. o Received echo reply contains {L=, E=1} DS flags, but does not - contain associated label multipath information. + contain Associated Label Multipath Information. - o IP multipath information types {2, 4, 8} sent, and received echo + o IP Multipath Information Types {2, 4, 8} sent, and received echo reply with {L=1, E=0} in DS flags. - o Multipath information type {TBD4} sent, and received echo reply - with multipath information type other than {TBD4}. + o Multipath Information Type {TBD4} sent, and received echo reply + with Multipath Information Type other than {TBD4}. 9. Responder LSR Procedures Common Procedures: o The responder LSR receiving an MPLS echo request packet MUST first determine whether or not the initiating LSR supports this LSP Ping and Traceroute extension for Entropy Labels. If either of the following conditions are met, the responder LSR SHOULD determine that the initiating LSR supports this LSP Ping and Traceroute extension for entropy labels. - 1. Received MPLS echo request contains the multipath information - type {TBD4}. + 1. Received MPLS echo request contains the Multipath Information + Type {TBD4}. 2. Received MPLS echo request contains a Target FEC Stack TLV that includes the entropy label FEC. - If the initiating LSR is determined to not support this LSP Ping + If the initiating LSR is determined not to support this LSP Ping and Traceroute extension for entropy labels, then the responder LSR MUST NOT follow further procedures described in this section. Specifically, MPLS echo reply packets: - * MUST have following DS Flags cleared (i.e., not set): "ELI/EL - push indicator" and "Label-based load balance indicator". + * MUST have the following DS Flags cleared (i.e., not set): "ELI/ + EL push indicator" and "Label-based load balance indicator". - * MUST NOT use multipath information type {TBD4}. + * MUST NOT use Multipath Information Type {TBD4}. o The responder LSR receiving an MPLS echo request packet with - multipath information type {TBD4} MUST validate the following - contents. Any deviation MUST result in the responder LSR to - consider the packet as malformed and return code 1 ("Malformed - echo request received") in the MPLS echo reply packet. + Multipath Information Type {TBD4} MUST validate the following + contents. Any deviation MUST result in the responder LSR + considering the packet as malformed and returning code 1 + ("Malformed echo request received") in the MPLS echo reply packet. - * IP multipath information MUST be included. + * IP Multipath Information MUST be included. - * Label multipath information MAY be included. + * Label Multipath Information MAY be included. - * IP associated label multipath information MUST be omitted - (NULL). + * Associated Label Multipath Information MUST be omitted (NULL). The following subsections describe expected responder LSR procedures when the echo reply is to include DDMAP TLVs, based on the local load balance technique being employed. In case the responder LSR performs deviating load balance techniques on a per downstream basis, appropriate procedures matched to each downstream load balance technique MUST be followed. -9.1. IP Based Load Balancer & Not Pushing ELI/EL +9.1. IP-based Load Balancer & Not Pushing ELI/EL o The responder MUST set {L=0, E=0} in DS flags. - o If multipath information type {2, 4, 8} is received, the responder + o If Multipath Information Type {2, 4, 8} is received, the responder MUST comply with [RFC4379] and [RFC6424]. - o If multipath information type {9} is received, the responder MUST - reply with multipath type {0}. + o If Multipath Information Type {9} is received, the responder MUST + reply with Multipath Type {0}. - o If multipath information type {TBD4} is received, the following + o If Multipath Information Type {TBD4} is received, the following procedures are to be used: - * The responder MUST reply with multipath information type + * The responder MUST reply with Multipath Information Type {TBD4}. * The "Label Multipath Information" and "Associated Label Multipath Information" sections MUST be omitted (NULL). * If no matching IP address is found, then the "IPMultipathType" - field MUST be set to multipath information type {0} and the "IP + field MUST be set to Multipath Information Type {0} and the "IP Multipath Information" section MUST also be omitted (NULL). * If at least one matching IP address is found, then the - "IPMultipathType" field MUST be set to appropriate multipath - information type {2, 4, 8} and the "IP Multipath Information" + "IPMultipathType" field MUST be set to appropriate Multipath + Information Type {2, 4, 8} and the "IP Multipath Information" section MUST be included. 9.2. IP Based Load Balancer & Pushes ELI/EL o The responder MUST set {L=0, E=1} in DS flags. - o If multipath information type {9} is received, the responder MUST - reply with multipath type {0}. + o If Multipath Information Type {9} is received, the responder MUST + reply with Multipath Type {0}. - o If multipath type {2, 4, 8, TBD4} is received, the following + o If Multipath Type {2, 4, 8, TBD4} is received, the following procedures are to be used: - * The responder MUST respond with multipath type {TBD4}. See - Section 7 for details of multipath type {TBD4}. + * The responder MUST respond with Multipath Type {TBD4}. See + Section 7 for details of Multipath Type {TBD4}. * The "Label Multipath Information" section MUST be omitted (i.e., it is not there). - * The IP address set specified in the received IP multipath - information MUST be used to determine the returning IP/Label + * The IP address set specified in the received IP Multipath + Information MUST be used to determine the returned IP/Label pairs. - * If the received multipath information type was {TBD4}, the + * If the received Multipath Information Type was {TBD4}, the received "Label Multipath Information" sections MUST NOT be - used to determine the associated label portion of returning IP/ - Label pairs. + used to determine the associated label portion of the returned + IP/Label pairs. * If no matching IP address is found, then the "IPMultipathType" - field MUST be set to multipath information type {0} and the "IP + field MUST be set to Multipath Information Type {0} and the "IP Multipath Information" section MUST be omitted. In addition, the "Assoc Label Multipath Length" MUST be set to 0, and the "Associated Label Multipath Information" section MUST also be omitted. * If at least one matching IP address is found, then the - "IPMultipathType" field MUST be set to appropriate multipath - information type {2, 4, 8} and the "IP Multipath Information" + "IPMultipathType" field MUST be set to appropriate Multipath + Information Type {2, 4, 8} and the "IP Multipath Information" section MUST be included. In addition, the "Associated Label Multipath Information" section MUST be populated with a list of labels corresponding to each IP address specified in the "IP Multipath Information" section. "Assoc Label Multipath Length" MUST be set to a value representing the length in octets of the "Associated Label Multipath Information" field. -9.3. Label Based Load Balancer & Not Pushing ELI/EL +9.3. Label-based Load Balancer & Not Pushing ELI/EL o The responder MUST set {L=1, E=0} in DS flags. - o If multipath information type {2, 4, 8} is received, the responder - MUST reply with multipath type {0}. + o If Multipath Information Type {2, 4, 8} is received, the responder + MUST reply with Multipath Type {0}. - o If multipath information type {9} is received, the responder MUST + o If Multipath Information Type {9} is received, the responder MUST comply with [RFC4379] and [RFC6424] as updated by Section 3. - o If multipath information type {TBD4} is received, the following + o If Multipath Information Type {TBD4} is received, the following procedures are to be used: - * The responder MUST reply with multipath information type + * The responder MUST reply with Multipath Information Type {TBD4}. * The "IP Multipath Information" and "Associated Label Multipath Information" sections MUST be omitted (NULL). * If no matching label is found, then the "LbMultipathType" field - MUST be set to multipath information type {0} and the "Label + MUST be set to Multipath Information Type {0} and the "Label Multipath Information" section MUST also be omitted (NULL). * If at least one matching label is found, then the "LbMultipathType" field MUST be set to the appropriate - multipath information type {9} and the "Label Multipath + Multipath Information Type {9} and the "Label Multipath Information" section MUST be included. -9.4. Label Based Load Balancer & Pushes ELI/EL +9.4. Label-based Load Balancer & Pushes ELI/EL o The responder MUST set {L=1, E=1} in DS flags. - o If multipath information type {2, 4, 8} is received, the responder - MUST reply with multipath type {0}. + o If Multipath Information Type {2, 4, 8} is received, the responder + MUST reply with Multipath Type {0}. - o If multipath type {9, TBD4} is received, the following procedures + o If Multipath Type {9, TBD4} is received, the following procedures are to be used: - * The responder MUST respond with multipath type {TBD4}. + * The responder MUST respond with Multipath Type {TBD4}. * The "IP Multipath Information" section MUST be omitted. - * The label set specified in the received label multipath - information MUST be used to determine the returning Label/Label + * The label set specified in the received Label Multipath + Information MUST be used to determine the returned Label/Label pairs. - * If received multipath information type was {TBD4}, received + * If received Multipath Information Type was {TBD4}, received "Label Multipath Information" sections MUST NOT be used to - determine the associated label portion of returning Label/Label - pairs. + determine the associated label portion of the returned Label/ + Label pairs. * If no matching label is found, then the "LbMultipathType" field - MUST be set to multipath information type {0} and "Label + MUST be set to Multipath Information Type {0} and "Label Multipath Information" section MUST be omitted. In addition, "Assoc Label Multipath Length" MUST be set to 0, and the "Associated Label Multipath Information" section MUST also be omitted. * If at least one matching label is found, then the "LbMultipathType" field MUST be set to the appropriate - multipath information type {9} and the "Label Multipath + Multipath Information Type {9} and the "Label Multipath Information" section MUST be included. In addition, the "Associated Label Multipath Information" section MUST be populated with a list of labels corresponding to each label specified in the "Label Multipath Information" section. "Assoc Label Multipath Length" MUST be set to a value representing the length in octets of the "Associated Label Multipath Information" field. 9.5. Flow-Aware MS-PW Stitching LSR @@ -764,21 +768,21 @@ described in Section 9.3. o Load balances on the previous flow label, and replaces the flow label with a newly computed label. For this case, the stitching LSR is to behave as described in Section 9.4. 10. Supported and Unsupported Cases The MPLS architecture does not define strict rules on how implementations are to identify hash "keys" for load balancing - purpose. As a result, implementations may be of the following load + purposes. As a result, implementations may be of the following load balancer types: 1. IP-based load balancer. 2. Label-based load balancer. 3. Label- and IP-based load balancer. For cases (2) and (3), an implementation can include different sets of labels from the label stack for load balancing purpose. Thus the following sub-cases are possible: @@ -802,21 +806,21 @@ o Search for entropy stops at the first entropy label. o Search for entropy includes any entropy label found plus continues to search for entropy in the label stack. Furthermore, handling of reserved (i.e., special) labels varies among implementations: o Reserved labels are used in the hash as any other label would be - (not a recommended practice). + (not a recommended practice.) o Reserved labels are skipped over and, for implementations limited to N labels, the reserved labels do not count towards the limit of N. o Reserved labels are skipped over and, for implementations limited to N labels, the reserved labels count towards the limit of N. It is important to point this out since the presence of GAL will affect those implementations which include reserved labels for load balancing purposes. @@ -833,49 +837,56 @@ is expected that most implementations will be of types "IP-based load balancer" or "Label-based load balancer". o Section 2.4.5.1 of [RFC7325] recommends that searching for entropy labels in the label stack should terminate upon finding the first entropy label. Therefore, it is expected that implementations will only include the first (top-most) entropy label when there are multiple entropy labels in the label stack. o It is expected that, in most cases, the number of labels in the - label stack will not exceed number of labels (N) which + label stack will not exceed the number of labels (N) which implementations can include for load balancing purposes. o It is expected that labels in the label stack, besides the flow label and entropy label, are constant for the lifetime of a single LSP multipath traceroute operation. Therefore, deviating load balancing implementations with respect to reserved labels should not affect this tool. - Thus [RFC4379], [RFC6424], and this document supports cases (1) and + Thus [RFC4379], [RFC6424], and this document support cases (1) and (2a1), where only the first (top-most) entropy label is included when there are multiple entropy labels in the label stack. 11. Security Considerations - This document extends the LSP Ping and Traceroute mechanisms to - discover and exercise ECMP paths when an LSP uses ELI/EL in the label - stack. Additional processing is required for responder and initiator - nodes. The responder node that pushes ELI/EL will need to compute - and return multipath data including associated EL. The initiator - node will need to store and handle both IP multipath and label - multipath information, and include destination IP addresses and/or - ELs in MPLS echo request packets as well as in multipath information - sent to downstream nodes. This document does not itself introduce - any new security considerations. The security measures described in - [RFC4379], [RFC6424], and [RFC6790] are applicable. [RFC6424] - provides guidelines if a network operator wants to prevent tracing or - does not want to expose details of the tunnel and [RFC6790] provides - guidance on the use of the EL. + While [RFC4379] and [RFC6424] already allow for the discovery and + exercise of ECMP paths, this document extends the LSP Ping and + Traceroute mechanisms to more precisely discover and exercise ECMP + paths when an LSP uses ELI/EL in the label stack. Sourcing or + inspecting LSP Ping packets can be used for network reconnaissance. + + The extended capability defined in this document requires small + additional processing for the responder and initiator nodes. The + responder node that pushes ELI/EL will need to compute and return + multipath data including associated EL. The initiator node will need + to store and handle both IP Multipath and Label Multipath + Information, and include destination IP addresses and/or ELs in MPLS + echo request packets as well as in Multipath Information sent to + downstream nodes. The security considerations of [RFC4379] already + cover Denial-of-Service attacks by regulating LSP Ping traffic going + to the control plane. + + Finally, the security measures described in [RFC4379], [RFC6424], and + [RFC6790] are applicable. [RFC6424] provides guidelines if a network + operator wants to prevent tracing or does not want to expose details + of the tunnel and [RFC6790] provides guidance on the use of the EL. 12. IANA Considerations 12.1. Entropy Label FEC The IANA is requested to assign a new sub-TLV from the "Sub-TLVs for TLV Types 1, 16, and 21" section from the "Multi-Protocol Label Switching (MPLS) Label Switched Paths (LSPs) Ping Parameters - TLVs" registry ([IANA-MPLS-LSP-PING]). @@ -906,27 +917,34 @@ Note: The "Multipath Type" sub-registry is created by [RFC7537]. Value Meaning Reference ---------- ---------------------------------------- --------- TBD4 IP and label set this document 13. Acknowledgements The authors would like to thank Loa Andersson, Curtis Villamizar, - Daniel King, Sriganesh Kini, Victor Ji, and Acee Lindem for - performing thorough reviews and providing valuable comments. + Daniel King, Sriganesh Kini, Victor Ji, Acee Lindem, Deborah + Brungard, Shawn M Emery, Scott O. Bradner, and Peter Yee for + performing thorough reviews and providing most valuable comments. + + Carlos Pignataro would like to acknowledge his lifetime friend Martin + Rigueiro, with deep gratutide and esteem, for sharing his contagious + passion for engineering and sciences, and for selflessly teaching so + many lessons. 14. Contributing Authors Nagendra Kumar Cisco Systems, Inc. + Email: naikumar@cisco.com 15. References 15.1. Normative References [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, .