Internet Architecture Board (IAB) A. Sullivan
Request for Comments: 6912 Dyn, Inc.
Category: Informational D. Thaler
ISSN: 2070-1721 Microsoft
J. Klensin
O. Kolkman
NLnet Labs
March 2013
Principles for Unicode Code Point Inclusion in Labels in the DNS
Abstract
Internationalized Domain Names in Applications (IDNA) makes available
to DNS zone administrators a very wide range of Unicode code points.
Most operators of zones should probably not permit registration of
U-labels using the entire range. This is especially true of zones
that accept registrations across organizational boundaries, such as
top-level domains and, most importantly, the root. It is
unfortunately not possible to generate algorithms to determine
whether permitting a code point presents a low risk. This memo
presents a set of principles that can be used to guide the decision
of whether a Unicode code point may be wisely included in the
repertoire of permissible code points in a U-label in a zone.
Status of This Memo
This document is not an Internet Standards Track specification; it is
published for informational purposes.
This document is a product of the Internet Architecture Board (IAB)
and represents information that the IAB has deemed valuable to
provide for permanent record. It represents the consensus of the
Internet Architecture Board (IAB). Documents approved for
publication by the IAB are not a candidate for any level of Internet
Standard; see Section 2 of RFC 5741.
Information about the current status of this document, any errata,
and how to provide feedback on it may be obtained at
http://www.rfc-editor.org/info/rfc6912.
Copyright Notice
Copyright (c) 2013 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(http://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
to this document.
Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2
1.1. Terminology . . . . . . . . . . . . . . . . . . . . . . . 3
2. Background . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.1. More-Restrictive Rules Going Up the DNS Tree . . . . . . 5
3. Principles Applicable to All Zones . . . . . . . . . . . . . 5
3.1. Longevity Principle . . . . . . . . . . . . . . . . . . . 5
3.2. Least Astonishment Principle . . . . . . . . . . . . . . 6
3.3. Contextual Safety Principle . . . . . . . . . . . . . . . 6
4. Principles Applicable to All Public Zones . . . . . . . . . . 6
4.1. Conservatism Principle . . . . . . . . . . . . . . . . . 6
4.2. Inclusion Principle . . . . . . . . . . . . . . . . . . . 6
4.3. Simplicity Principle . . . . . . . . . . . . . . . . . . 7
4.4. Predictability Principle . . . . . . . . . . . . . . . . 7
4.5. Stability Principle . . . . . . . . . . . . . . . . . . . 7
5. Principle Specific to the Root Zone . . . . . . . . . . . . . 8
5.1. Letter Principle . . . . . . . . . . . . . . . . . . . . 8
6. Confusion and Context . . . . . . . . . . . . . . . . . . . . 8
7. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . 9
8. Security Considerations . . . . . . . . . . . . . . . . . . . 9
9. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 9
10. IAB Members at the Time of Approval . . . . . . . . . . . . . 9
11. Informative References . . . . . . . . . . . . . . . . . . . 10
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 11
1. Introduction
Operators of a DNS zone need to set policies around what Unicode code
points are allowed in labels in that zone. Typically there are a
number of important goals to consider when constructing such
policies. These include, for instance, avoiding possible visual
confusability between two labels, avoiding possible confusion between
Fully Qualified Domain Names (FQDNs) and IP address literals,
accessibility to the disabled (see "Web Content Accessibility
Guidelines (WCAG) 2.0" [WCAG20] for some discussion in a web
context), and other usability issues.
This document provides a set of principles that zone operators can
use to construct their code point policies in order to improve
usability and clarity and thereby reduce confusion.
1.1. Terminology
This document uses the following terms.
A-label: an LDH label that starts with "xn--" and meets all the
IDNA requirements, with additional restrictions as explained in
Section 2.3.2.1 of the IDNA Definitions document [RFC5890].
Character: a member of a set of elements used for the
organization, control, or representation of data. See Section 2
of the Internationalization Terminology document [RFC6365] for
more details.
Language: a way that humans communicate. The use of language
occurs in many forms, the most common of which are speech,
writing, and signing. See Section 2 of RFC 6365 for more details.
LDH label: a string consisting of ASCII letters, digits, and the
hyphen, with additional restrictions as explained in Section 2.3.1
of RFC 5890.
Public zone: in this document, a DNS zone that accepts
registration requests from organizations outside the zone
administrator's own organization. (Whether the zone performs
delegation is a separate question. What is important is the
diversity of the registration-requesting community.) Note that
under this definition, the root zone is a public zone, though one
that has a unique function in the DNS.
Rendering: the display of a string of text. See Section 5 of RFC
6365 for more details.
Script: a set of graphic characters used for the written form of
one or more languages. See Section 2 of RFC 6365 for more
details.
U-label: a string of Unicode characters that meets all the IDNA
requirements and includes at least one non-ASCII character, with
additional restrictions as explained in Section 2.3.2.1 of RFC
5890.
Writing system: a set of rules for using one or more scripts to
write a particular language. See Section 2 of RFC 6365 for more
details.
This memo does not propose a protocol standard, and the use of words
such as "should" follow the ordinary English meaning, and not that
laid out in [RFC2119].
2. Background
In recent communications [IABCOMM1] [IABCOMM2], the IAB has
emphasized the importance of conservatism in allocating labels
conforming to IDNA2008 [RFC5890] [RFC5891] [RFC5892] [RFC5893]
[RFC5894] [RFC5895] in DNS zones, and especially in the root zone.
Traditional LDH labels in the root zone used only alphabetic
characters (i.e., ASCII a-z (which under the DNS also match A-Z)).
Matters are more complicated with U-labels, however. The IAB
communications recommended that U-labels permit only code points with
a General_Category (gc) of Ll (Lowercase_Letter), Lo (Other_Letter),
or Lm (Modifier_Letter), but noted that for practical considerations
other code points might be permitted on a case-by-case basis.
The IAB recommendations do, however, leave some issues open that need
to be addressed. It is not clear that all code points permitted
under IDNA2008 that have a General_Category of Lo or Lm are
appropriate for a zone such as the root zone. To take but one
example, the code point U+02BC (MODIFIER LETTER APOSTROPHE) has a
General_Category of Lm. In practically every rendering (and we are
unaware of an exception), U+02BC is indistinguishable from U+2019
(RIGHT SINGLE QUOTATION MARK), which has a General_Category of Pf
(Final_Punctuation). U+02BC will also be read by large numbers of
people as being the same character as U+0027 (APOSTROPHE), which has
a General_Category of Po (Other_Punctuation), and some computer
systems may treat U+02BC as U+0027. U+02BC is PROTOCOL VALID
(PVALID) under IDNA2008 (see the IDNA Code Points document
[RFC5892]), whereas both other code points are DISALLOWED. So, to
begin with, it is plain that not every code point with a
General_Category of Ll, Lo, or Lm is consistent with the type of
conservatism principle discussed in Section 4.1 below or the previous
IAB recommendations.
To make matters worse, some languages are dependent on code points
with General_Category Mc (Spacing_Mark) or General_Category Mn
(Nonspacing_Mark). This dependency is particularly common in Indic
languages, though not exclusive to them. (At the risk of vastly
oversimplifying, the overarching issue is mostly the interaction of
complex writing systems and the way Unicode works.) To restrict
users of those languages to only code points with General_Category of
Ll, Lo, or Lm would be extremely limiting. While DNS labels are not
words, or sentences, or phrases (as noted in the next steps for IDN
[RFC4690]), they are intended to support useful mnemonics. Mnemonics
that diverge wildly from the usual conventions are poor ones, because
in not following the usual conventions they are not easy to remember.
Also, wide divergence from usual conventions, if not well-justified
(and especially in a shared namespace like the root), invites
political controversy.
Many of the issues above turn out to be relevant to all public zones.
Moreover, the overall issue of developing a policy for code point
permission is common to all zones that accept A-labels or U-labels
for registration. As Section 4.3 of the IDNA Protocol document
[RFC5891] says, every registry at every level of the DNS is "expected
to establish policies about label registrations".
For reasons of sound management, it is not desirable to decide
whether to permit a given code point only when an application
containing that code point is pending. That approach reduces
predictability and is bound to appear subject to special pleas. It
is better instead to produce the rules governing acceptance of code
points in advance.
As is evident from the foregoing discussion about the Letter and Mark
categories, it is simply not possible to make code point decisions
algorithmically. If it were possible to develop such an algorithm,
it would already exist: the DNS is hardly unique in needing to impose
restrictions on code points while accommodating many different
linguistic communities. Nevertheless, new guidelines can be made by
starting from overarching principles. These guidelines act more as
meta-rules, leading to the establishment of other rules about the
inclusion and exclusion of particular code points in labels in a
given zone, always based on the list of code points permitted by
IDNA.
2.1. More-Restrictive Rules Going Up the DNS Tree
A set of principles derived from the above ideas follows in Sections
3 through 5 below. Such principles fall into three categories. Some
principles apply to every DNS zone. Some additional principles apply
to all public zones, including the root zone. Finally, other
principles apply only to the root zone. This means that zones higher
in the DNS tree tend to have more restrictive rules (since additional
principles apply), and zones lower in the DNS tree tend to have less
restrictive rules, since they are used within a more narrow context.
In general, the relevant context for a principle is that of the zone,
not that of a given subset of the user community; for the root zone,
for example, the context is "the entire Internet population".
3. Principles Applicable to All Zones
3.1. Longevity Principle
Unicode properties of a code point ought to be stable across the
versions of Unicode that users of the zone are likely to have
installed. Because it is possible for the properties of a code point
to change between Unicode versions, a good way to predict such
stability is to ensure that a code point has in fact been stable for
multiple successive versions of Unicode. This principle is related
to the Stability Principle in Section 4.5.
The more diverse the community using the zone, the greater the
importance of following this principle. The policy for a leaf zone
in the DNS might only require stability across two Unicode versions,
whereas a more public zone might require stability across four or
more releases before the code point's properties are considered long-
lived and stable.
3.2. Least Astonishment Principle
Every zone administrator should be sensitive to the likely use of a
code point to be permitted, particularly taking into account the
population likely to use the zone. Zone administrators should
especially consider whether a candidate code point could present
difficulty if the code point is encountered outside the usual
linguistic circumstances. By the same token, the failure to support
a code point that is normal in some linguistic circumstances could be
very surprising for users likely to encounter the names in that
circumstance.
3.3. Contextual Safety Principle
Every zone administrator should be sensitive to ways in which a code
point that is permitted could be used in support of malicious
activity. This is not a completely new problem: the digit 1 and the
lowercase letter l are, for instance, easily confused in many
contexts. The very large repertoire of code points in Unicode (even
just the subset permitted for IDNs) makes the problem somewhat worse,
just because of the scale.
4. Principles Applicable to All Public Zones
4.1. Conservatism Principle
Public zones are, by definition, zones that are shared by different
groups of people. Therefore, any decision to permit a code point in
a public zone (including the root) should be as conservative as
practicable. Doubts should always be resolved in favor of rejecting
a code point for inclusion rather than in favor of including it, in
order to minimize risk.
4.2. Inclusion Principle
Just as IDNA2008 starts from the principle that the Unicode range is
excluded, and then adds code points according to derived properties
of the code points, so a public zone should only permit inclusion of
a code point if it is known to be "safe" in terms of usability and
confusability within the context of that zone. The default treatment
of a code point should be that it is excluded.
4.3. Simplicity Principle
The rules for determining whether a code point is to be included
should be simple enough that they are readily understood by someone
with a moderate background in the DNS and Unicode issues. This
principle does not mean that a completely naive person needs to be
able to understand the rationale for including a code point, but it
does mean that if the reason for inclusion of a very peculiar code
point, even a safe one, is too difficult to understand, the code
point would not be permitted.
The meaning of "simple" or "readily understood" is context-dependent.
For instance, the root zone has to serve everyone in the world; for
practical purposes, this means that the reasons for including a code
point need to be comprehensible even to people who cannot use the
script where the code point is found. In a zone that permits a
constrained subset of Unicode characters (for instance, only those
needed to write a single alphabetic language) and that supports a
clearly delineated linguistic community (for instance, the speakers
of a single language with well-understood written conventions), more
complicated rules might be acceptable. Compare this principle with
the Least Astonishment Principle in Section 3.2.
4.4. Predictability Principle
The rules for determining whether a code point is to be included
should be predictable enough that those with the requisite
understanding of DNS, IDNA, and Unicode will usually reach the same
conclusion. This is not a requirement for algorithmic treatment of
code points; as previously noted, that is not possible. Rather, it
is to say that the consistent application of professional judgment is
likely to yield the same results; combined with the principle in
Section 4.1, when results are not predictable, the anomalous code
point would not be permitted.
Just as in Section 4.3, this principle tends to cause more
restriction the more diverse the community using the zone; it is most
restrictive for the root zone. This is because what is predictable
within a given language community is possibly very surprising across
languages.
4.5. Stability Principle
Once a code point is permitted, it is at least very hard to stop
permitting that code point. In public zones (including the root),
the list of code points to be permitted should change very slowly, if
at all, and usually only in the direction of permitting an addition
as time and experience indicate that inclusion of such a code point
is both safe and consistent with these principles.
5. Principle Specific to the Root Zone
5.1. Letter Principle
"Requirements for Internet Hosts - Application and Support" [RFC1123]
notes that top-level labels "will be alphabetic". In the absence of
widespread agreement about the force of that note, prudence suggests
that U-labels in the root zone should exclude code points that are
not normally used to write words, or that are in some cases normally
used for purposes other than writing words. This is not the same as
using Unicode's General_Category to include only letters. It is a
restriction that expands the possible class of included code points
beyond the Unicode letters, but only expands so far as to include the
things that are normally used to create words. Under this principle,
code points with (for example) General_Category Mn (Nonspacing_Mark)
might be included -- but only those that are used to write words and
not (for instance) musical symbols. In addition, such marks should
only be used within a label in ways that they would be used when
making a word: combinations that would be nonsense when used in a
word should also be rejected when tried in DNS labels. This
principle should be applied as narrowly as possible; as the next
steps for IDN document [RFC4690] says, "While DNS labels may
conveniently be used to express words in many circumstances, the goal
is not to express words (or sentences or phrases), but to permit the
creation of unambiguous labels with good mnemonic value".
6. Confusion and Context
While many discussions of confusion have focused on characters, e.g.,
whether two characters are confusable with each other (and under what
circumstances), a focus on characters alone could lead to the
prohibition of very large numbers of labels, including many that
present little risk. Instead, the focus should be on whether one
label is confusable with another. For example, if a label contains
several characters that are distinct to a particular script, and all
of its characters are from that script, it is inherently not
confusable with a label from any other script no matter what other
characters might appear in it. Another label that lacks those
distinguishing characters might be a problem. The notion extends
from labels to domain names, in the sense that distinguishing
characters used in a higher-level label may set expectations with
respect to the characters in the lower-level labels. This
expectation might be regarded as a benefit, but it is also a problem,
since there is no technical way to require consistent policies in
delegated namespaces.
7. Conclusion
The principles outlined in this document can be applied when
considering any range of Unicode code points for possible inclusion
in a DNS zone. It is worth observing that doing anything (especially
in light of Section 4.5) implicitly disadvantages communities with a
writing system not yet well understood and not represented in the
technical and policy communities involved in the discussion. That
disadvantage is to be guarded against as much as practical, but is
effectively impossible to prevent (while still taking action) in
light of imperfect human knowledge.
8. Security Considerations
The principles outlined in this memo are intended to improve
usability and clarity and thereby reduce confusion among different
labels. While these principles may contribute to reduction of risk,
they are not sufficient to provide a comprehensive
internationalization policy for zone management.
Additional discussion of security considerations can be found in the
Unicode Security Considerations [UTR36].
9. Acknowledgements
The authors thank the participants in the IAB Internationalization
program for the discussion of the ideas in this memo, particularly
Marc Blanchet. In addition, Stephane Bortzmeyer, Paul Hoffman,
Daniel Kalchev, Panagiotis Papaspiliopoulos, and Vaggelis Segredakis
made specific comments.
10. IAB Members at the Time of Approval
Bernard Aboba
Jari Arkko
Marc Blanchet
Ross Callon
Alissa Cooper
Spencer Dawkins
Joel Halpern
Russ Housley
David Kessens
Danny McPherson
Jon Peterson
Dave Thaler
Hannes Tschofenig
11. Informative References
[IABCOMM1]
Internet Architecture Board, "IAB Statement: 'The
interpretation of rules in the ICANN gTLD Applicant
Guidebook'", February 2012. 2012, <http://www.iab.org/documents/
correspondence-reports-documents/201/>.
[IABCOMM2]
Internet Architecture Board, "Response to ICANN questions
concerning 'The interpretation of rules in the ICANN gTLD
Applicant Guidebook'", March 2012. 2012, <http://www.iab.org/
documents/correspondence-reports-documents/201/>.
[RFC1123] Braden, R., "Requirements for Internet Hosts - Application
and Support", STD 3, RFC 1123, October 1989.
[RFC2119] Bradner, S., "Key words for use in RFCs to Indicate
Requirement Levels", BCP 14, RFC 2119, March 1997.
[RFC4690] Klensin, J., Faltstrom, P., Karp, C., and IAB, "Review and
Recommendations for Internationalized Domain Names
(IDNs)", RFC 4690, September 2006.
[RFC5890] Klensin, J., "Internationalized Domain Names for
Applications (IDNA): Definitions and Document Framework",
RFC 5890, August 2010.
[RFC5891] Klensin, J., "Internationalized Domain Names in
Applications (IDNA): Protocol", RFC 5891, August 2010.
[RFC5892] Faltstrom, P., "The Unicode Code Points and
Internationalized Domain Names for Applications (IDNA)",
RFC 5892, August 2010.
[RFC5893] Alvestrand, H. and C. Karp, "Right-to-Left Scripts for
Internationalized Domain Names for Applications (IDNA)",
RFC 5893, August 2010.
[RFC5894] Klensin, J., "Internationalized Domain Names for
Applications (IDNA): Background, Explanation, and
Rationale", RFC 5894, August 2010.
[RFC5895] Resnick, P. and P. Hoffman, "Mapping Characters for
Internationalized Domain Names in Applications (IDNA)
2008", RFC 5895, September 2010.
[RFC6365] Hoffman, P. and J. Klensin, "Terminology Used in
Internationalization in the IETF", BCP 166, RFC 6365,
September 2011.
[UTR36] Davis, M. and M. Suignard, "Unicode Security
Considerations", Unicode Technical Report #36, July 2012.
[WCAG20] W3C, "Web Content Accessibility Guidelines (WCAG) 2.0",
W3C Recommendation, December 2008,
<http://www.w3.org/TR/2008/REC-WCAG20-20081211/>.
Authors' Addresses
Andrew Sullivan
Dyn, Inc.
150 Dow St
Manchester, NH 03101
USA
EMail: asullivan@dyn.com
Dave Thaler
Microsoft
One Microsoft Way
Redmond, WA 98052
USA
EMail: dthaler@microsoft.com
John C Klensin
1770 Massachusetts Ave, Ste 322
Cambridge, MA 02140
USA
Phone: +1 617 491 5735
EMail: john-ietf@jck.com
Olaf Kolkman
NLnet Labs
Science Park 400
Amsterdam 1098 XH
The Netherlands
EMail: olaf@NLnetLabs.nl