PRECISInternet Engineering Task Force (IETF) P. Saint-AndreInternet-DraftRequest for Comments: 7613 &yet Obsoletes: 4013(if approved)A. MelnikovIntended status:Category: Standards Track Isode LtdExpires: November 29, 2015 May 28,ISSN: 2070-1721 August 2015 Preparation, Enforcement, and Comparison of Internationalized Strings Representing Usernames and Passwordsdraft-ietf-precis-saslprepbis-18Abstract This document describes updated methods for handling Unicode strings representing usernames and passwords. The previous approach was known as SASLprep (RFC 4013) and was based onStringprepstringprep (RFC 3454). The methods specified in this document provide a more sustainable approach to the handling of internationalized usernames and passwords. ThePRECISpreparation, enforcement, and comparison of internationalized strings (PRECIS) framework, RFC 7564, obsoletes RFC 3454, and this document obsoletes RFC 4013. Status of This Memo ThisInternet-Draftissubmitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documentsan Internet Standards Track document. This document is a product of the Internet Engineering Task Force (IETF).Note that other groups may also distribute working documents as Internet-Drafts. The listIt represents the consensus ofcurrent Internet- Drafts is at http://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents validthe IETF community. It has received public review and has been approved fora maximumpublication by the Internet Engineering Steering Group (IESG). Further information on Internet Standards is available in Section 2 ofsix monthsRFC 5741. Information about the current status of this document, any errata, and how to provide feedback on it may beupdated, replaced, or obsoleted by other documentsobtained atany time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on November 29, 2015.http://www.rfc-editor.org/info/rfc7613. Copyright Notice Copyright (c) 2015 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (http://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License. Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3 2. Terminology . . . . . . . . . . . . . . . . . . . . . . . . . 4 3. Usernames . . . . . . . . . . . . . . . . . . . . . . . . . . 5 3.1. Definition . . . . . . . . . . . . . . . . . . . . . . . 5 3.2. UsernameCaseMapped Profile . . . . . . . . . . . . . . . 6 3.2.1. Preparation . . . . . . . . . . . . . . . . . . . . . 6 3.2.2. Enforcement . . . . . . . . . . . . . . . . . . . . . 6 3.2.3. Comparison . . . . . . . . . . . . . . . . . . . . . 7 3.3. UsernameCasePreserved Profile . . . . . . . . . . . . . . 7 3.3.1. Preparation . . . . . . . . . . . . . . . . . . . . . 7 3.3.2. Enforcement . . . . . . . . . . . . . . . . . . . . . 7 3.3.3. Comparison . . . . . . . . . . . . . . . . . . . . . 8 3.4. Case Mapping vs. Case Preservation . . . . . . . . . . . 8 3.5. Application-Layer Constructs . . . . . . . . . . . . . . 9 3.6. Examples . . . . . . . . . . . . . . . . . . . . . . . . 9 4. Passwords . . . . . . . . . . . . . . . . . . . . . . . . . . 11 4.1. Definition . . . . . . . . . . . . . . . . . . . . . . . 11 4.2. OpaqueString Profile . . . . . . . . . . . . . . . . . . 12 4.2.1. Preparation . . . . . . . . . . . . . . . . . . . . . 12 4.2.2. Enforcement . . . . . . . . . . . . . . . . . . . . .1213 4.2.3. Comparison . . . . . . . . . . . . . . . . . . . . . 13 4.3. Examples . . . . . . . . . . . . . . . . . . . . . . . .1314 5. Use in Application Protocols . . . . . . . . . . . . . . . . 14 6. Migration . . . . . . . . . . . . . . . . . . . . . . . . . . 15 6.1. Usernames . . . . . . . . . . . . . . . . . . . . . . . . 15 6.2. Passwords . . . . . . . . . . . . . . . . . . . . . . . .1617 7. IANA Considerations . . . . . . . . . . . . . . . . . . . . .1718 7.1. UsernameCaseMapped Profile . . . . . . . . . . . . . . .1718 7.2. UsernameCasePreserved Profile . . . . . . . . . . . . . . 18 7.3. OpaqueString Profile . . . . . . . . . . . . . . . . . . 19 7.4. Stringprep Profile . . . . . . . . . . . . . . . . . . . 19 8. Security Considerations . . . . . . . . . . . . . . . . . . .1920 8.1. Password/Passphrase Strength . . . . . . . . . . . . . .1920 8.2. Identifier Comparison . . . . . . . . . . . . . . . . . .1920 8.3. Reuse of PRECIS . . . . . . . . . . . . . . . . . . . . . 20 8.4. Reuse of Unicode . . . . . . . . . . . . . . . . . . . . 20 9. References . . . . . . . . . . . . . . . . . . . . . . . . . 20 9.1. Normative References . . . . . . . . . . . . . . . . . . 20 9.2. Informative References . . . . . . . . . . . . . . . . . 21 Appendix A. Differences from RFC 4013 . . . . . . . . . . . . .22 Appendix B.23 Acknowledgements . . . . . . . . . . . . . . . . . .23. . . . . . 24 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . .2324 1. Introduction Usernames and passwords are widely used for authentication and authorization on the Internet, either directly when provided in plaintext (as in theSASLPLAIN Simple Authentication and Security Layer (SASL) mechanism [RFC4616]orand the HTTP Basic scheme[I-D.ietf-httpauth-basicauth-update])[HTTP-BASIC-AUTH]) or indirectly when provided as the input to a cryptographic algorithm such as a hash function (as in the Salted Challenge Response Authentication Mechanism (SCRAM) SASLSCRAMmechanism [RFC5802]orand the HTTP Digest scheme[I-D.ietf-httpauth-digest]).[HTTP-DIGEST-AUTH]). To increase the likelihood that the input and comparison of usernames and passwords will work in ways that make sense for typical users throughout the world, this document defines rules for preparing, enforcing, and comparing internationalized strings that represent usernames and passwords. Such strings consist of characters from the Unicode character set [Unicode], with special attention to characters outside the ASCII range [RFC20]. The rules for handling such strings are specified through profiles of the string classes defined in thePRECISpreparation, enforcement, and comparison of internationalized strings (PRECIS) framework specification [RFC7564]. Profiles of the PRECIS framework enable software to handle Unicode characters outside the ASCII range in an automated way, so that such characters are treated carefully and consistently in application protocols. In large measure, these profiles are designed to protect application developers from the potentially negative consequences of supporting the full range of Unicode characters. For instance, in almost all application protocols it would be dangerous to treat the Unicode character SUPERSCRIPT ONE(U+0089)(U+00B9) as equivalent to DIGIT ONE (U+0031),sincebecause that would result in false positives during comparison, authentication, and authorization (e.g., an attacker could easy spoof an account "user1@example.com"). Whereas a naive use of Unicode would make such attacks trivially easy, the PRECIS profile defined here for usernames generally protects applications from inadvertently causing such problems. (Similar considerations apply to passwords, although here it is desirable to support a wider range of characters so as to maximize entropy for purposes of authentication.) The methods defined here might be applicable wherever usernames or passwords are used. However, the methods are not intended for use in preparing strings that are not usernames (e.g.,LDAPLightweight Directory Access Protocol (LDAP) distinguished names), nor in cases where identifiers or secrets are not strings (e.g., keys and certificates) or require specialized handling. This document obsoletes RFC 4013 (the"SASLprep"SASLprep profile ofStringprepstringprep [RFC3454]) but can be used by technologies other thanthe Simple Authentication and Security Layer (SASL)SASL [RFC4422], such as HTTP authentication as specified in[I-D.ietf-httpauth-basicauth-update][HTTP-BASIC-AUTH] and[I-D.ietf-httpauth-digest].[HTTP-DIGEST-AUTH]. This document does not modify the handling of internationalized strings in usernames and passwords as prescribed by existing application protocols that use SASLprep. If the community that uses such an application protocol wishes to modernize its handling of internationalized strings to use PRECIS instead ofStringprep,stringprep, it needs to explicitly update the existing application protocol definition (one example is[I-D.ietf-xmpp-6122bis],[XMPP-ADDR], whichobsoletesis intended to obsolete [RFC6122]). Non-coordinated updates to protocol implementations are discouraged because they can have a negative impact on interoperability and security. 2. Terminology Many important terms used in this document are defined in [RFC5890], [RFC6365], [RFC7564], and [Unicode]. The term "non-ASCII space" refers to any Unicode code point having a Unicode general category of "Zs", with the exception of U+0020 (here called "ASCII space"). As used here, the term "password" is not literally limited to a word; i.e., a password could be a passphrase consisting of more than one word, perhaps separated by spaces, punctuation, or other non- alphanumeric characters. Some SASL mechanisms (e.g., CRAM-MD5, DIGEST-MD5, and SCRAM) specify that the authentication identity used in the context of such mechanisms is a "simple user name" (see Section 2 of [RFC4422] as well as [RFC4013]). Various application technologies also assume that the identity of a user or account takes the form of a username (e.g., authentication for theHyperTextHypertext Transfer Protocol as specified in[I-D.ietf-httpauth-basicauth-update][HTTP-BASIC-AUTH] and[I-D.ietf-httpauth-digest]),[HTTP-DIGEST-AUTH]), whether or not they use SASL. Note well that the exact form of a username in any particular SASL mechanism or application technology is a matter for implementation and deployment, and that a username does not necessarily map to any particular application identifier (such as the localpart of an email address). The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in [RFC2119]. 3. Usernames 3.1. Definition This document specifies that a username is a string of Unicode code points [Unicode], encoded using UTF-8 [RFC3629], and structured as an ordered sequence of"userparts" (where"userparts". A userpart is allowed to contain only code points that are in turn allowed by thecompletePRECIS IdentifierClass defined in Section 4.2 of [RFC7564], and thus consists almost exclusively of letters and digits. A username can consist of a single userpart or a space-separated sequence ofuserparts).userparts. The syntax for a username is defined asfollowsfollows, using the Augmented Backus-Naur Form (ABNF) [RFC5234]. username = userpart *(1*SP userpart) userpart = 1*(idbyte) ; ; an "idbyte" is a byte used to represent a ; UTF-8 encoded Unicode code point that can be ; contained in a string that conforms to the ; PRECIS"IdentifierClass"IdentifierClass ; All code points and blocks not explicitly allowed in the PRECIS IdentifierClass are disallowed; this includes private use characters, surrogate code points, and the other code points and blocks that were defined as "Prohibited Output" in [RFC4013]. In addition, common constructions such as "user@example.com" (e.g., the Network Access Identifier from [RFC7542]) are allowed as usernames under this specification, as they were under [RFC4013]. Implementation Note: The username construct defined in this document does not necessarily match what all deployed applications might refer to as a "username" or"userid","userid" but instead provides a relatively safe subset of Unicode characters that can be used in existing SASL mechanisms andSASL-usingin applicationprotocols,protocols that use SASL, and even in most application protocols that do not currently use SASL. A username MUST NOT be zero bytes in length. This rule is to be enforced after any normalization and mapping of code points. In protocols that provide usernames as input to a cryptographic algorithm such as a hash function, the client will need to performproper preparationenforcement of theusernamerules for the UsernameCaseMapped or UsernameCasePreserved profile before applying the algorithm. This specification defines two profiles for usernames: one that performs case mapping and one that performs case preservation (see further discussion under Section 3.4). 3.2. UsernameCaseMapped Profile The definition of the UsernameCaseMapped profile of the IdentifierClass is provided in the following sections, including detailed information about preparation, enforcement, and comparison(on(for details on the distinction between these actions, refer to [RFC7564]). 3.2.1. Preparation An entity that prepares a string according to this profile MUSTensure thatfirst map fullwidth and halfwidth characters to their decomposition mappings (see Unicode Standard Annex #11 [UAX11]). This is necessary because the PRECIS "HasCompat" category specified in Section 9.17 of [RFC7564] would otherwise forbid fullwidth and halfwidth characters. After applying this width-mapping rule, the entity then MUST ensure that the string consists only of Unicode code points that conform to the"IdentifierClass" base string classPRECIS IdentifierClass defined in Section 4.2 of [RFC7564]. In addition, thestringentity then MUSTbe encodedencode the string as UTF-8 [RFC3629]. 3.2.2. Enforcement An entity that performs enforcement according to this profile MUST prepare a string as described inthe previous sectionSection 3.2.1 and MUST also apply the rules specified below for the UsernameCaseMapped profile (these rules MUST be applied in the ordershown).shown): 1.Width MappingWidth-Mapping Rule:Fullwidth and halfwidth characters MUST be mapped to their decomposition mappingsApplied as part of preparation (seeUnicode Standard Annex #11 [UAX11]).above). 2. Additional Mapping Rule: There is no additional mapping rule. 3.Case MappingCase-Mapping Rule: Uppercase and titlecase characters MUST be mapped to their lowercase equivalents, preferably using Unicode Default Case Folding as defined in the Unicode Standard [Unicode] (at the time of this writing, the algorithm is specified in Chapter 3 of [Unicode7.0], but the chapter number might change in a future version of the Unicode Standard); see further discussion in Section 3.4. 4. Normalization Rule: Unicode Normalization Form C (NFC) MUST be applied to all characters. 5. Directionality Rule: Applications MUST apply the "Bidi Rule" defined in [RFC5893] to strings that contain right-to-left characters (i.e., each of the six conditions of the Bidi Rule must be satisfied). 3.2.3. Comparison An entity that performs comparison of two strings according to this profile MUST prepare each string as specified in Section 3.2.1 and then enforce the rules specified inthe previous two sections.Section 3.2.2. The two strings are to be considered equivalent if they are an exact octet-for-octet match (sometimes called "bit-string identity"). 3.3. UsernameCasePreserved Profile The definition of the UsernameCasePreserved profile of the IdentifierClass is provided in the following sections, including detailed information about preparation, enforcement, and comparison(on(for details on the distinction between these actions, refer to [RFC7564]). 3.3.1. Preparation An entity that prepares a string according to this profile MUST first map fullwidth and halfwidth characters to their decomposition mappings (see Unicode Standard Annex #11 [UAX11]). This is necessary because the PRECIS "HasCompat" category specified in Section 9.17 of [RFC7564] would otherwise forbid fullwidth and halfwidth characters. After applying this width-mapping rule, the entity then MUST ensure that the string consists only of Unicode code points that conform to the"IdentifierClass" base string classPRECIS IdentifierClass defined in Section 4.2 of [RFC7564]. In addition, thestringentity then MUSTbe encodedencode the string as UTF-8 [RFC3629]. 3.3.2. Enforcement An entity that performs enforcement according to this profile MUST prepare a string as described inthe previous sectionSection 3.3.1 and MUST also apply the rules specified below for the UsernameCasePreserved profile (these rules MUST be applied in the ordershown).shown): 1.Width MappingWidth-Mapping Rule:Fullwidth and halfwidth characters MUST be mapped to their decomposition mappingsApplied as part of preparation (seeUnicode Standard Annex #11 [UAX11]).above). 2. Additional Mapping Rule: There is no additional mapping rule. 3.Case MappingCase-Mapping Rule: Uppercase and titlecase characters MUST NOT be mapped to their lowercase equivalents; see further discussion in Section 3.4. 4. Normalization Rule: Unicode Normalization Form C (NFC) MUST be applied to all characters. 5. Directionality Rule: Applications MUST apply the "Bidi Rule" defined in [RFC5893] to strings that contain right-to-left characters (i.e., each of the six conditions of the Bidi Rule must be satisfied). 3.3.3. Comparison An entity that performs comparison of two strings according to this profile MUST prepare each string as specified in Section 3.3.1 and then enforce the rules specified inthe previous two sections.Section 3.3.2. The two strings are to be considered equivalent if they are an exact octet-for-octet match (sometimes called "bit-string identity"). 3.4. Case Mapping vs. Case Preservation In order to accommodate the widest range of username constructs in applications, this document defines two username profiles: UsernameCaseMapped and UsernameCasePreserved. These two profiles differ only in theCase Mapping Rule,Case-Mapping Rule and are otherwise identical. Case mapping is a matter for the application protocol, protocol implementation, or end deployment. In general, this document suggests that it is preferable to apply the UsernameCaseMapped profile and therefore perform case mapping,sincebecause not doing so can lead to false positives during authentication and authorization (as described in [RFC6943]) and can result in confusion among endusersusers, given the prevalence of case mapping in many existing protocols and applications. However, there can be good reasons to apply the UsernameCasePreserved profile and thus not perform case mapping, such as backward compatibility with deployed infrastructure. In particular: o SASL mechanisms that follow the recommendations in this document MUST specify whether and when case mapping is to be applied to authentication identifiers. SASL mechanisms SHOULD delay any case mapping to the last possible moment, such as when doing a lookup by username, performing username comparisons, or generating a cryptographic salt from a username (if the last possible moment happens on the server, then decisions about case mapping can be a matter of deployment policy). In keeping with [RFC4422], SASL mechanisms are not to apply this or any other profile to authorization identifiers, only to authentication identifiers. o Application protocols that use SASL (such as IMAP [RFC3501] andXMPPthe Extensible Messaging and Presence Protocol (XMPP) [RFC6120]) and that directlyre-usereuse this profile MUST specify whether or not case mapping is to be applied to authorization identifiers. Such "SASL application protocols" SHOULD delay anycase mappingcase-mapping of authorization identifiers to the last possible moment, which happens to necessarily be on the server side (this enables decisions about case mapping to be a matter of deployment policy). In keeping with [RFC4422], SASL application protocols are not to apply this or any other profile to authentication identifiers, only to authorization identifiers. o Application protocols that do not use SASL (such as HTTP authentication with the HTTP Basic and Digest schemes as specified in[I-D.ietf-httpauth-basicauth-update][HTTP-BASIC-AUTH] and[I-D.ietf-httpauth-digest])[HTTP-DIGEST-AUTH]) but that directlyre-usereuse this profile MUST specify whether and when case mapping is to be applied to authentication identifiersandor authorizationidentifiers.identifiers, or both. Such "non-SASL application protocols" SHOULD delay any case mapping to the last possible moment, such as when doing a lookup by username, performing username comparisons, or generating a cryptographic salt from a username (if the last possible moment happens on the server, then decisions about case mapping can be a matter of deployment policy). If the specification for a SASL mechanism, SASL application protocol, or non-SASL application protocol uses the UsernameCaseMapped profile, it MUST clearly describe whether case mapping is to be applied at the level of the protocol itself, implementations thereof, or service deployments(all(each of these approaches can belegitimatelegitimate, depending on the application in question). 3.5. Application-Layer Constructs Both the UsernameCaseMapped and UsernameCasePreserved profiles enable an application protocol, implementation, or deployment to create application-layer constructs such as aspace-separatedusername that is a space- separated set ofnamesuserparts like "Firstname Middlename Lastname". Although such a construct is not aPRECISprofile(sinceof the PRECIS IdentifierClass (because U+0020 SPACE is not allowed in the IdentifierClass), it can be created at the application layer because U+0020 SPACE can be used as a separator between instances of the PRECIS IdentifierClass(or a profile thereof).(e.g., userparts as defined in this specification). 3.6. Examples The following examples illustrate a small number of userparts (not usernames) that are consistent with the format defined above (note that the characters<"<" and>">" are used here to delineate the actual userparts and are not part of the userpart strings).Table 1: A sample of legal userparts+--------------------------+---------------------------------+ | # | Userpart | Notes | +--------------------------+---------------------------------+ | 1 | <juliet@example.com> | The at-sign is allowed in the | | | | PRECIS IdentifierClass | +--------------------------+---------------------------------+ | 2 | <fussball> | | +--------------------------+---------------------------------+ | 3 | <fußball> | The third character is LATIN | | | | SMALL LETTER SHARP S (U+00DF) | +--------------------------+---------------------------------+ | 4 | <π> | A userpart of GREEK SMALL | | | | LETTER PI (U+03C0) | +--------------------------+---------------------------------+ | 5 | <Σ> | A userpart of GREEK CAPITAL | | | | LETTER SIGMA (U+03A3) | +--------------------------+---------------------------------+ | 6 | <σ> | A userpart of GREEK SMALL | | | | LETTER SIGMA (U+03C3) | +--------------------------+---------------------------------+ | 7 | <ς> | A userpart of GREEK SMALL | | | | LETTER FINAL SIGMA (U+03C2) | +--------------------------+---------------------------------+ Table 1: A Sample of Legal Userparts Several points are worth noting. Regarding examples 2 and 3: although in German the character eszett (LATIN SMALL LETTER SHARPS, U+00DF)S (U+00DF)) can mostly be used interchangeably with the two characters "ss", the userparts in these examples are different and (if desired) a server would need to enforce a registration policy that disallows one of them if the other is registered. Regarding examples 5, 6, and 7: optional case-mapping of GREEK CAPITAL LETTER SIGMA (U+03A3) to lowercase (i.e., to GREEK SMALL LETTERSIGMA, U+03C3)SIGMA (U+03C3)) during comparison would result in matching the userparts in examples 5 and 6; however, because the PRECIS mapping rules do not account for the special status of GREEK SMALL LETTER FINAL SIGMA (U+03C2), the userparts in examples 5 and 7 or examples 6 and 7 would not be matched during comparison. The following examples illustrate strings that are not valid userparts (not usernames) because they violate the format defined above.Table 2: A sample of strings that violate the userpart rule+--------------------------+---------------------------------+ | # | Non-UserpartstringString | Notes | +--------------------------+---------------------------------+ | 8 | <foo bar> | Space (U+0020) is disallowed in | | | | the userpart | +--------------------------+---------------------------------+ | 9 | <> | Zero-length userpart | +--------------------------+---------------------------------+ | 10| <henryⅣ> | The sixth character is ROMAN | | | | NUMERAL FOUR (U+2163) | +--------------------------+---------------------------------+ | 11| <♚> | A localpart of BLACK CHESS KING | | | | (U+265A) | +--------------------------+---------------------------------+ Table 2: A Sample of Strings That Violate the Userpart Rule Here again, several points are worth noting. Regarding example10,8: although this is not a valid userpart, it is a valid username because it is a space-separated sequence of userparts. Regarding example 10: the Unicode character ROMAN NUMERAL FOUR (U+2163) has a compatibility equivalent of the string formed of LATIN CAPITAL LETTER I (U+0049) and LATIN CAPITAL LETTER V (U+0056), but characters with compatibility equivalents are not allowed in the PRECISIdentiferClass.IdentifierClass. Regarding example 11: symbol characters such as BLACK CHESS KING (U+265A) are not allowed in the PRECIS IdentifierClass. 4. Passwords 4.1. Definition This document specifies that a password is a string of Unicode code points [Unicode], encoded using UTF-8 [RFC3629], and conformant to the OpaqueString profile (specified below) of the PRECIS FreeformClassspecified below.defined in Section 4.3 of [RFC7564]. The syntax for a password is defined asfollowsfollows, using the Augmented Backus-Naur Form (ABNF) [RFC5234]. password = 1*(freebyte) ; ; a "freebyte" is a byte used to represent a ; UTF-8 encoded Unicode code point that can be ; contained in a string that conforms to the ; PRECIS"FreeformClass"FreeformClass ; All code points and blocks not explicitly allowed in the PRECIS FreeformClass are disallowed; this includes private use characters, surrogate code points, and the other code points and blocks defined as "Prohibited Output" in Section 2.3 of RFC4013.4013 (when corrected per [Err1812]). A password MUST NOT be zero bytes in length. This rule is to be enforced after any normalization and mapping of code points. Note: Some existing systems allow an empty string in places where a password would be expected (e.g., command-line tools that might be called from an automated script, or servers that might need to be restarted without human intervention). From the perspective of this document (and RFC 4013 before it), these empty strings are not passwords but are workarounds for the practical difficulty of using passwords in certain scenarios. The prohibitiononof zero- length passwords is not a recommendation regarding password strength(since(because a password of only one byte is highlyinsecure),insecure) but is meant to prevent applications from mistakenly omitting a passwordentirely, sinceentirely; such an outcome is possible when internationalized characters areacceptedaccepted, because a non-empty sequence of characters can result in azero- lengthzero-length password after canonicalization. In protocols that provide passwords as input to a cryptographic algorithm such as a hash function, the client will need to performproper preparationenforcement of thepasswordrules for the OpaqueString profile before applying the algorithm,sincebecause the password is not available to the server in plaintext form. 4.2. OpaqueString Profile The definition of the OpaqueString profile is provided in the following sections, including detailed information about preparation, enforcement, and comparison(on(for details on the distinction between these actions, refer to [RFC7564]). 4.2.1. Preparation An entity that prepares a string according to this profile MUST ensure that the string consists only of Unicode code points that conform to the"FreeformClass"FreeformClass base string class defined in [RFC7564]. In addition, thestringentity MUSTbe encodedencode the string as UTF-8 [RFC3629]. 4.2.2. Enforcement An entity that performs enforcement according to this profile MUST prepare a string as described inthe previous sectionSection 4.2.1 and MUST also apply the rules specified below for the OpaqueString profile (these rules MUST be applied in the ordershown).shown): 1.Width MappingWidth-Mapping Rule: Fullwidth and halfwidth characters MUST NOT be mapped to their decomposition mappings (see Unicode Standard Annex #11 [UAX11]). 2. Additional Mapping Rule: Any instances of non-ASCII space MUST be mapped to ASCII space (U+0020); a non-ASCII space is any Unicode code point having a Unicode general category of"Zs", naturally with"Zs" (with the exception ofU+0020.U+0020). 3.Case MappingCase-Mapping Rule: Uppercase and titlecase characters MUST NOT be mapped to their lowercase equivalents. 4. Normalization Rule: Unicode Normalization Form C (NFC) MUST be applied to all characters. 5. Directionality Rule: There is no directionality rule. The "Bidi Rule" (defined in [RFC5893]) and similar rules are unnecessary and inapplicable to passwords,sincebecause they can reduce the range of characters that are allowed in a string and therefore reduce the amount of entropy that is possible in a password. Such rules are intended to minimize the possibility that the same string will be displayed differently on a layout system set forright-to-leftright- to-left display and a layout system set for left-to-right display; however, passwords are typically not displayed at all and are rarely meant to be interoperable across different layout systems in the way that non-secret strings like domain names and usernames are. Furthermore, it is perfectly acceptable for opaque strings other than passwords to be presented differently in different layout systems, as long as the presentation is consistent in any given layout system. 4.2.3. Comparison An entity that performs comparison of two strings according to this profile MUST prepare each string as specified in Section 4.2.1 and then enforce the rules specified inthe previous two sections.Section 4.2.2. The two strings are to be considered equivalent if they are an exact octet-for-octet match (sometimes called "bit-string identity"). 4.3. Examples The following examples illustrate a small number of passwords that are consistent with the format defined above (note that the characters<"<" and>">" are used here to delineate the actual passwords and are not part of the password strings).Table 3: A sample of legal passwords+------------------------------------+------------------------------+ | # | Password | Notes | +------------------------------------+------------------------------+ | 12| <correct horse battery staple> | ASCII space is allowed | +------------------------------------+------------------------------+ | 13| <Correct Horse Battery Staple> |DifferentDiffers by case from | | | | example 12 | +------------------------------------+------------------------------+ | 14| <πßå> | Non-ASCII letters are OK | | | | (e.g., GREEK SMALL LETTER | | | |PI, U+03C0)PI (U+03C0)) | +------------------------------------+------------------------------+ | 15| <Jack of ♦s> | Symbols are OK (e.g., BLACK | | | | DIAMONDSUIT, U+2666)SUIT (U+2666)) | +------------------------------------+------------------------------+ | 16| <foo bar> | OGHAM SPACEMARK, U+1680,MARK (U+1680) is | | | | mapped toU+0020U+0020, and thus | | | | the full string is mapped to | | | | <foo bar> | +------------------------------------+------------------------------+ Table 3: A Sample of Legal Passwords The following example illustrates a string that is not a valid password because it violates the format defined above.Table 4: A string that violates the password rules+------------------------------------+------------------------------+ | # | Password | Notes | +------------------------------------+------------------------------+ | 17| <my cat is a 	by> | Controls are disallowed | +------------------------------------+------------------------------+ Table 4: A String That Violates the Password Rules 5. Use in Application Protocols This specification defines only the PRECIS-based rules for the handling of strings conforming to the UsernameCaseMapped and UsernameCasePreserved profiles of the PRECIS IdentifierClass, and strings conforming to the OpaqueString profile of the PRECIS FreeformClass. It is the responsibility of an application protocol to specify the protocol slots in which such strings can appear, the entities that are expected to enforce the rules governing such strings, andwhen inat what points during protocol processing or interface handling the rules need to be enforced. See Section 6 of [RFC7564] for guidelinesabouton using PRECIS profiles in applications. Above and beyond the PRECIS-based rules specified here, application protocols can also define application-specific rules governing such strings (rules regarding minimum or maximum length, further restrictions on allowable characters or character ranges, safeguards to mitigate the effects of visually similar characters, etc.), application-layer constructs (see Section 3.5), and related matters. Some PRECIS profile definitions encourage entities that enforce the rules to be liberal in what they accept. However, for usernames and passwords such a policy can beproblematic sinceproblematic, because it can lead to false positives. An in-depth discussion can be found in"Issues in Identifier Comparison for Security Purposes"[RFC6943]. 6. Migration The rules defined in this specification differ slightly from those defined by the SASLprep specification [RFC4013]. The following sections describe these differences, along with their implications for migration, in more detail. 6.1. Usernames Deployments that currently use SASLprep for handling usernames might need to scrub existing data whenmigratingthey migrate touse ofthe rules defined in this specification. In particular: o SASLprep specified the use of Unicode Normalization Form KC (NFKC), whereas the UsernameCaseMapped and UsernameCasePreserved profiles employ Unicode Normalization Form C (NFC). Inpracticepractice, this change is unlikely to cause significant problems, because NFKC provides methods for mapping Unicode code points with compatibility equivalents to those equivalents, whereas the PRECIS IdentifierClass entirely disallows Unicode code points with compatibility equivalents (i.e., duringcomparisoncomparison, NFKC is more "aggressive" about finding matches than NFC). A few examples might suffice to indicate the nature of the problem: 1.U+017FLATIN SMALL LETTER LONG S (U+017F) is compatibility equivalent toU+0073LATIN SMALL LETTER S (U+0073). 2.U+2163ROMAN NUMERAL FOUR (U+2163) is compatibility equivalent toU+0049LATIN CAPITAL LETTER I (U+0049) andU+0056LATIN CAPITAL LETTER V (U+0056). 3.U+FB01LATIN SMALL LIGATURE FI (U+FB01) is compatibility equivalent toU+0066LATIN SMALL LETTER F (U+0066) andU+0069LATIN SMALL LETTER I (U+0069). Under SASLprep, the use of NFKC also handled the mapping of fullwidth and halfwidth code points to their decomposition mappings. For migrationpurposespurposes, operators might want to search their database of usernames for names containing Unicode code points with compatibility equivalents and, where there is no conflict, map those code points to their equivalents. Naturally, it is possible that during this process the operator will discover conflicting usernames (e.g., HENRYIV with the last two characters beingU+0049LATIN CAPITAL LETTER I (U+0049) andU+0056LATIN CAPITAL LETTER V (U+0056) vs. "HENRYIV" with the last character beingU+2163ROMAN NUMERALFOUR,FOUR (U+2163), which is compatibility equivalent to U+0049 and U+0056); in thesecasescases, the operator will need to determine how toproceed,proceed -- forinstanceinstance, by disabling the account whose name contains a Unicode code point with a compatibility equivalent. Such cases are probably rare, but it is important for operators to be aware of them. o SASLprep mapped the "characters commonly mapped to nothing" from Appendix B.1 of [RFC3454]) to nothing, whereas the PRECIS IdentifierClass entirely disallows most of these characters, which correspond to the code points from the PRECIS "M" category defined under Section 9.13 of [RFC7564] (with the exception ofU+1806MONGOLIAN TODO SOFTHYPHEN,HYPHEN (U+1806), which was "commonly mapped to nothing" in Unicode 3.2 but at the time of this writing does not have a derived property of Default_Ignorable_Code_Point in Unicode 7.0). For migration purposes, the operator might want to remove from usernames any code points contained in the PRECIS "M" category (e.g.,U+00ADSOFTHYPHEN).HYPHEN (U+00AD)). Because these code points would have been "mapped to nothing" inStringprep,stringprep, in practice a user would not notice the differenceifif, upon migration toPRECISPRECIS, the code points are removed. o SASLprep allowed uppercase and titlecase characters, whereas the UsernameCaseMapped profile maps uppercase and titlecase characters to their lowercase equivalents (by contrast, the UsernameCasePreserved profile matches SASLprep in this regard). For migration purposes, the operator caneitheruse either the UsernameCaseMapped profile (thus losing the case information) orusethe UsernameCasePreserved profile (thus ignoring case difference when comparing usernames). 6.2. Passwords Depending on local service policy, migration from RFC 4013 to this specification might not involve any scrubbing of data(since(because passwords might not be stored in the clear anyway); however, service providers need to be aware of possible issues that might arise during migration. In particular: o SASLprep specified the use of Unicode Normalization Form KC (NFKC), whereas the OpaqueString profile employs Unicode Normalization Form C (NFC). Because NFKC is more aggressive about finding matches than NFC, in practice this change is unlikely to cause significant problems and indeed has the security benefit of probably resulting in fewer false positives when comparing passwords. A few examples might suffice to indicate the nature of the problem: 1.U+017FLATIN SMALL LETTER LONG S (U+017F) is compatibility equivalent toU+0073LATIN SMALL LETTER S (U+0073). 2.U+2163ROMAN NUMERAL FOUR (U+2163) is compatibility equivalent toU+0049LATIN CAPITAL LETTER I (U+0049) andU+0056LATIN CAPITAL LETTER V (U+0056). 3.U+FB01LATIN SMALL LIGATURE FI (U+FB01) is compatibility equivalent toU+0066LATIN SMALL LETTER F (U+0066) andU+0069LATIN SMALL LETTER I (U+0069). Under SASLprep, the use of NFKC also handled the mapping of fullwidth and halfwidth code points to their decomposition mappings. Although it is expected that code points with compatibility equivalents are rare in existing passwords, some passwords that matched when SASLprep was used might no longer work when the rules in this specification are applied. o SASLprep mapped the "characters commonly mapped to nothing" from Appendix B.1 of [RFC3454]) to nothing, whereas the PRECIS FreeformClass entirely disallows such characters, which correspond to the code points from the PRECIS "M" category defined under Section 9.13 of [RFC7564] (with the exception ofU+1806MONGOLIAN TODO SOFTHYPHEN,HYPHEN (U+1806), which was commonly mapped to nothing in Unicode 3.2 but at the time of this writing is allowed by Unicode 7.0). In practice, this change will probably have no effect on comparison, but user-oriented software might reject such code points instead of ignoring them during password preparation. 7. IANA ConsiderationsTheIANAshall add the following entries tohas made thePRECIS Profiles Registry.updates described below. 7.1. UsernameCaseMapped Profile IANA has added the following entry to the "PRECIS Profiles" registry. Name: UsernameCaseMapped. Base Class: IdentifierClass. Applicability: Usernames in security and application protocols. Replaces: The SASLprep profile ofStringprep. Width Mappingstringprep. Width-Mapping Rule: Map fullwidth and halfwidth characters to their decomposition mappings. Additional Mapping Rule: None.Case MappingCase-Mapping Rule: Map uppercase and titlecase characters to lowercase. Normalization Rule: NFC. Directionality Rule: The "Bidi Rule" defined in RFC 5893 applies. Enforcement: To be defined by security or application protocols that use this profile. Specification: RFCXXXX,7613 (this document), Section 3.2.[Note to RFC Editor: please change XXXX to the number issued for this specification.]7.2. UsernameCasePreserved Profile IANA has added the following entry to the "PRECIS Profiles" registry. Name: UsernameCasePreserved. Base Class: IdentifierClass. Applicability: Usernames in security and application protocols. Replaces: The SASLprep profile ofStringprep. Width Mappingstringprep. Width-Mapping Rule: Map fullwidth and halfwidth characters to their decomposition mappings. Additional Mapping Rule: None.Case MappingCase-Mapping Rule: None. Normalization Rule: NFC. Directionality Rule: The "Bidi Rule" defined in RFC 5893 applies. Enforcement: To be defined by security or application protocols that use this profile. Specification: RFCXXXX,7613 (this document), Section 3.3.[Note to RFC Editor: please change XXXX to the number issued for this specification.]7.3. OpaqueString Profile IANA has added the following entry to the "PRECIS Profiles" registry. Name: OpaqueString. Base Class: FreeformClass. Applicability: Passwords and other opaque strings in security and application protocols. Replaces: The SASLprep profile ofStringprep. Width Mappingstringprep. Width-Mapping Rule: None. Additional Mapping Rule: Map non-ASCII space characters to ASCII space.Case MappingCase-Mapping Rule: None. Normalization Rule: NFC. Directionality Rule: None. Enforcement: To be defined by security or application protocols that use this profile. Specification: RFCXXXX,7613 (this document), Section 4.2.[Note7.4. Stringprep Profile The stringprep specification [RFC3454] did not provide for entries in the "Stringprep Profiles" registry to have any state except "Current" or "Not Current". Because this document obsoletes RFCEditor: please change XXXX to4013, which registered thenumber issued forSASLprep profile of stringprep, IANA has marked that profile as "Not Current" and cited thisspecification.]document as an additional reference. 8. Security Considerations 8.1. Password/Passphrase Strength The ability to include a wide range of characters in passwords and passphrases can increase the potential for creating a strong password with high entropy. However, in practice, the ability to include such characters ought to be weighed against the possible need to reproduce them on various devices using various input methods. 8.2. Identifier Comparison The process of comparing identifiers (such as SASL simple user names, authentication identifiers, and authorization identifiers) can lead to either false negatives or false positives, both of which have security implications. A more detailed discussion can be found in [RFC6943]. 8.3. Reuse of PRECIS The security considerations described in [RFC7564] apply to the"IdentifierClass"IdentifierClass and"FreeformClass"FreeformClass base string classes used in this document for usernames and passwords, respectively. 8.4. Reuse of Unicode The security considerations described in [UTS39] apply to the use of Unicode characters in usernames and passwords. 9. References 9.1. Normative References [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/ RFC2119, March1997.1997, <http://www.rfc-editor.org/info/rfc2119>. [RFC3629] Yergeau, F., "UTF-8, a transformation format of ISO 10646", STD 63, RFC 3629, DOI 10.17487/RFC3629, November2003.2003, <http://www.rfc-editor.org/info/rfc3629>. [RFC5234] Crocker,D.D., Ed. and P. Overell, "Augmented BNF for Syntax Specifications: ABNF", STD 68, RFC 5234, DOI 10.17487/ RFC5234, January2008.2008, <http://www.rfc-editor.org/info/rfc5234>. [RFC5890] Klensin, J., "Internationalized Domain Names for Applications (IDNA): Definitions and Document Framework", RFC 5890, DOI 10.17487/RFC5890, August2010.2010, <http://www.rfc-editor.org/info/rfc5890>. [RFC6365] Hoffman, P. and J. Klensin, "Terminology Used in Internationalization in the IETF", BCP 166, RFC 6365, DOI 10.17487/RFC6365, September2011.2011, <http://www.rfc-editor.org/info/rfc6365>. [RFC7564] Saint-Andre, P. and M. Blanchet, "PRECIS Framework: Preparation, Enforcement, and Comparison of Internationalized Strings in Application Protocols", RFC 7564, DOI 10.17487/RFC7564, May2015.2015, <http://www.rfc-editor.org/info/rfc7564>. [UAX11]TheUnicodeConsortium, "UnicodeStandard Annex#11: East#11, "East Asian Width",September 2012,edited by Ken Lunde. An integral part of The Unicode Standard, <http://unicode.org/reports/tr11/>. [Unicode] The Unicode Consortium, "The Unicode Standard", <http://www.unicode.org/versions/latest/>. [Unicode7.0] The Unicode Consortium, "The Unicode Standard, Version 7.0.0",2014, <http://www.unicode.org/versions/Unicode7.0.0/>. [Unicode](Mountain View, CA: The Unicode Consortium,"The Unicode Standard", 2015-present, <http://www.unicode.org/versions/latest/>.2014 ISBN 978-1-936213-09-2), <http://www.unicode.org/versions/Unicode7.0.0/>. 9.2. Informative References[I-D.ietf-httpauth-basicauth-update][Err1812] RFC Errata, Erratum ID 1812, RFC 4013, <http://www.rfc-editor.org>. [HTTP-BASIC-AUTH] Reschke, J., "The 'Basic' HTTP Authentication Scheme",draft-ietf-httpauth-basicauth-update-07 (workWork inprogress),Progress, draft-ietf-httpauth-basicauth-update-07, February 2015.[I-D.ietf-httpauth-digest][HTTP-DIGEST-AUTH] Shekh-Yusef, R., Ed., Ahrens, D., and S. Bremer, "HTTP Digest Access Authentication",draft-ietf-httpauth-digest-19 (workWork inprogress),Progress, draft- ietf-httpauth-digest-19, April 2015.[I-D.ietf-xmpp-6122bis] Saint-Andre, P., "Extensible Messaging and Presence Protocol (XMPP): Address Format", draft-ietf-xmpp- 6122bis-22 (work in progress), May 2015.[RFC20] Cerf, V., "ASCII format for network interchange", STD 80, RFC 20, DOI 10.17487/RFC0020, October1969.1969, <http://www.rfc-editor.org/info/rfc20>. [RFC3454] Hoffman, P. and M. Blanchet, "Preparation of Internationalized Strings ("stringprep")", RFC 3454, DOI 10.17487/RFC3454, December2002.2002, <http://www.rfc-editor.org/info/rfc3454>. [RFC3501] Crispin, M., "INTERNET MESSAGE ACCESS PROTOCOL - VERSION 4rev1", RFC 3501, DOI 10.17487/RFC3501, March2003.2003, <http://www.rfc-editor.org/info/rfc3501>. [RFC4013] Zeilenga, K., "SASLprep: Stringprep Profile for User Names and Passwords", RFC 4013, DOI 10.17487/RFC4013, February2005.2005, <http://www.rfc-editor.org/info/rfc4013>. [RFC4422] Melnikov, A., Ed. and K. Zeilenga, Ed., "Simple Authentication and Security Layer (SASL)", RFC 4422, DOI 10.17487/RFC4422, June2006.2006, <http://www.rfc-editor.org/info/rfc4422>. [RFC4616] Zeilenga, K., Ed., "The PLAIN Simple Authentication and Security Layer (SASL) Mechanism", RFC 4616, DOI 10.17487/ RFC4616, August2006.2006, <http://www.rfc-editor.org/info/rfc4616>. [RFC5802] Newman, C., Menon-Sen, A., Melnikov, A., and N. Williams, "Salted Challenge Response Authentication Mechanism (SCRAM) SASL and GSS-API Mechanisms", RFC 5802, DOI 10.17487/RFC5802, July2010.2010, <http://www.rfc-editor.org/info/rfc5802>. [RFC5891] Klensin, J., "Internationalized Domain Names in Applications (IDNA): Protocol", RFC 5891, DOI 10.17487/ RFC5891, August2010.2010, <http://www.rfc-editor.org/info/rfc5891>. [RFC5893] Alvestrand,H.H., Ed. and C. Karp, "Right-to-Left Scripts for Internationalized Domain Names for Applications (IDNA)", RFC 5893, DOI 10.17487/RFC5893, August2010.2010, <http://www.rfc-editor.org/info/rfc5893>. [RFC5894] Klensin, J., "Internationalized Domain Names for Applications (IDNA): Background, Explanation, and Rationale", RFC 5894, DOI 10.17487/RFC5894, August2010.2010, <http://www.rfc-editor.org/info/rfc5894>. [RFC6120] Saint-Andre, P., "Extensible Messaging and Presence Protocol (XMPP): Core", RFC 6120, DOI 10.17487/RFC6120, March2011.2011, <http://www.rfc-editor.org/info/rfc6120>. [RFC6122] Saint-Andre, P., "Extensible Messaging and Presence Protocol (XMPP): Address Format", RFC 6122, DOI 10.17487/ RFC6122, March2011.2011, <http://www.rfc-editor.org/info/rfc6122>. [RFC6943] Thaler, D., Ed., "Issues in Identifier Comparison for Security Purposes", RFC 6943, DOI 10.17487/RFC6943, May2013.2013, <http://www.rfc-editor.org/info/rfc6943>. [RFC7542] DeKok, A., "The Network Access Identifier", RFC 7542, DOI 10.17487/RFC7542, May2015.2015, <http://www.rfc-editor.org/info/rfc7542>. [UTS39]TheUnicodeConsortium, "UnicodeTechnical Standard#39: Unicode#39, "Unicode Security Mechanisms",July 2012,edited by Mark Davis and Michel Suignard, <http://unicode.org/reports/tr39/>. [XMPP-ADDR] Saint-Andre, P., "Extensible Messaging and Presence Protocol (XMPP): Address Format", Work in Progress, June 2015. Appendix A. Differences from RFC 4013 This document builds upon the PRECIS framework defined in [RFC7564], which differs fundamentally from theStringprepstringprep technology [RFC3454] used in SASLprep [RFC4013]. The primary difference is thatStringprepstringprep profiles allowed all characters except thosewhichcharacters that were explicitly disallowed, whereas PRECIS profiles disallow all characters except thosewhichcharacters that are explicitly allowed (this "inclusion model" was originally used for internationalized domain names in [RFC5891]; see [RFC5894] for further discussion). It is important to keep this distinction in mind when comparing the technology defined in this document to SASLprep [RFC4013]. The following substantive modifications were made from RFC 4013. o A single SASLprep algorithm was replaced by three separate algorithms: one for usernames with case mapping, one for usernames with case preservation, and one for passwords. o The new preparation algorithms use PRECIS instead of aStringprepstringprep profile. The new algorithms workindependenctlyindependently of Unicode versions. o As recommended in the PRECIS framework, changed the Unicode normalization form from NFKC to NFC. o Some Unicode code points that were mapped to nothing in RFC 4013 are simply disallowed by PRECIS.Appendix B.Acknowledgements This document borrows some text from [RFC4013] and [RFC6120]. The following individuals provided helpful feedback on this document: Marc Blanchet, Ben Campbell, Alan DeKok, Joe Hildebrand, Jeffrey Hutzelman, Simon Josefsson, Jonathan Lennox, James Manger, Matt Miller, Chris Newman, Yutaka OIWA, Pete Resnick, Andrew Sullivan, Nico Williams, and Yoshiro YONEYA. Nico Williams in particular deserves special recognition for providing text that was used in Section 3.4. Thanks also to Takahiro NEMOTO and Yoshiro YONEYA for implementation feedback. Robert Sparks and Derek Atkins reviewed the document on behalf of the General Area Review Team and the Security Directorate, respectively. Benoit Claise and Stephen Farrell provided helpful input during IESG review. Thanks to Matt Miller as document shepherd, Marc Blanchet and Yoshiro YONEYA as working group chairs, and Pete Resnick and Barry Leiba as area directors. Peter Saint-Andre wishes to acknowledge Cisco Systems, Inc., for employing him during his work on earlier draft versions of this document. Authors' Addresses Peter Saint-Andre &yet Email: peter@andyet.com URI: https://andyet.com/ Alexey Melnikov Isode Ltd 5 Castle Business Village 36 Station Road Hampton, Middlesex TW12 2BXUKUnited Kingdom Email: Alexey.Melnikov@isode.com