Internet Engineering Task Force (IETF) R. Polli
Request for Comments: 9512 DTD, Italian Government
Category: Informational E. Wilde
ISSN: 2070-1721 Axway
E. Aro
Mozilla
January
February 2024
YAML Media Type
Abstract
This document registers the application/yaml media type and the +yaml
structured syntax suffix with IANA. Both identify document
components that are serialized according to the YAML specification.
Status of This Memo
This document is not an Internet Standards Track specification; it is
published for informational purposes.
This document is a product of the Internet Engineering Task Force
(IETF). It represents the consensus of the IETF community. It has
received public review and has been approved for publication by the
Internet Engineering Steering Group (IESG). Not all documents
approved by the IESG are candidates for any level of Internet
Standard; see Section 2 of RFC 7841.
Information about the current status of this document, any errata,
and how to provide feedback on it may be obtained at
https://www.rfc-editor.org/info/rfc9512.
Copyright Notice
Copyright (c) 2024 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
to this document. Code Components extracted from this document must
include Revised BSD License text as described in Section 4.e of the
Trust Legal Provisions and are provided without warranty as described
in the Revised BSD License.
Table of Contents
1. Introduction
1.1. Notational Conventions
1.2. Fragment Identification
1.2.1. Fragment Identification via Alias Nodes
2. Media Type and Structured Syntax Suffix Registrations
2.1. Media Type application/yaml
2.2. The +yaml Structured Syntax Suffix
3. Interoperability Considerations
3.1. YAML Is an Evolving Language
3.2. YAML Streams
3.3. Filename Extension
3.4. YAML and JSON
3.5. Fragment Identifiers
4. Security Considerations
4.1. Arbitrary Code Execution
4.2. Resource Exhaustion
4.3. YAML Streams
4.4. Expressing Booleans
5. IANA Considerations
6. References
6.1. Normative References
6.2. Informative References
Appendix A. Examples Related to Fragment Identifier
Interoperability
A.1. Unreferenceable Nodes
A.2. Referencing a Missing Node
A.3. Representation Graph with Anchors and Cyclic References
Acknowledgements
Authors' Addresses
1. Introduction
YAML [YAML] is a data serialization format that is capable of
conveying one or multiple documents in a single presentation stream
(e.g., a file or a network resource). It is widely used on the
Internet, including in the API sector (e.g., see [OAS]), but a
corresponding media type and structured syntax suffix had not
previously been registered by IANA.
To increase interoperability when exchanging YAML streams and
leverage content negotiation mechanisms when exchanging YAML
resources, this specification registers the application/yaml media
type and the +yaml structured syntax suffix [MEDIATYPE].
Moreover, it provides security considerations and interoperability
considerations related to [YAML], including its relation with [JSON].
1.1. Notational Conventions
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
"SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and
"OPTIONAL" in this document are to be interpreted as described in
BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all
capitals, as shown here.
The terms "content negotiation" and "resource" in this document are
to be interpreted as in [HTTP].
The terms "fragment" and "fragment identifier" in this document are
to be interpreted as in [URI].
The terms "presentation", "stream", "YAML document", "representation
graph", "tag", "serialization detail", "node", "alias node",
"anchor", and "anchor name" in this document are to be interpreted as
in [YAML].
Figures containing YAML code always start with the %YAML directive to
improve readability.
1.2. Fragment Identification
A fragment identifies a node in a stream.
A fragment identifier starting with "*" is to be interpreted as a
YAML alias node (see Section 1.2.1).
For single-document YAML streams, a fragment identifier that is empty
or that starts with "/" is to be interpreted as a JSON Pointer
[JSON-POINTER] and is evaluated on the YAML representation graph,
traversing alias nodes; in particular, the empty fragment identifier
references the root node. This syntax can only reference the YAML
nodes that are on a path that is made up of nodes interoperable with
the JSON data model (see Section 3.4).
A fragment identifier is not guaranteed to reference an existing
node. Therefore, applications SHOULD define how an unresolved alias
node ought to be handled.
1.2.1. Fragment Identification via Alias Nodes
This section describes how to use alias nodes (see Sections 3.2.2.2
and 7.1 of [YAML]) as fragment identifiers to designate nodes.
A YAML alias node can be represented in a URI fragment identifier by
encoding it into bytes using UTF-8 [UTF-8], but percent-encoding of
those characters is not allowed by the fragment rule in Section 3.5
of [URI].
If multiple nodes match a fragment identifier, the first occurrence
of such a match is selected.
Users concerned with interoperability of fragment identifiers:
* SHOULD limit alias nodes to a set of characters that do not
require encoding to be expressed as URI fragment identifiers (this
is generally possible since anchor names are a serialization
detail), and
* SHOULD NOT use alias nodes that match multiple nodes.
In the example resource below, the relative reference (see
Section 4.2 of [URI]) file.yaml#*foo identifies the first alias node
*foo pointing to the node with value scalar and not to the one in the
second document, whereas the relative reference file.yaml#*document_2
identifies the root node of the second document {one: [a, sequence]}.
%YAML 1.2
---
one: &foo scalar
two: &bar
- some
- sequence
- items
...
%YAML 1.2
---
&document_2
one: &foo [a, sequence]
Figure 1: A YAML Stream Containing Two YAML Documents
2. Media Type and Structured Syntax Suffix Registrations
This section includes the information required for IANA to register
the application/yaml media type and the +yaml structured syntax
suffix per [MEDIATYPE].
2.1. Media Type application/yaml
The media type for YAML is application/yaml; the following
information serves as the registration form for this media type.
Type name: application
Subtype name: yaml
Required parameters: N/A
Optional parameters: N/A; unrecognized parameters should be ignored.
Encoding considerations: binary
Security considerations: See Section 4 of this document.
Interoperability considerations: See Section 3 of this document.
Published specification: [YAML], this document
Applications that use this media type: Applications that need a
human-friendly, cross-language, and Unicode-based data
serialization language designed around the common data types of
dynamic programming languages.
Fragment identifier considerations: See Section 1.2 of this
document.
Additional information:
Deprecated alias names for this type: application/x-yaml, text/
yaml, and text/x-yaml. These names are used but are not
registered.
Magic number(s): N/A
File extension(s): "yaml" (preferred) and "yml". See Section 3.3
of this document.
Macintosh file type code(s): N/A
Windows Clipboard Name: YAML
Person and email address to contact for further information: See the
Authors' Addresses section of this document.
Intended usage: COMMON
Restrictions on usage: None
Author: See the Authors' Addresses section of this document.
Change controller: IETF
2.2. The +yaml Structured Syntax Suffix
The suffix +yaml MAY be used with any media type whose representation
follows that established for application/yaml. The structured syntax
suffix registration form follows. See [MEDIATYPE] for definitions of
each part of the registration form.
Name: YAML Ain't Markup Language (YAML)
+suffix: +yaml
References: [YAML], this document
Encoding considerations: Same as application/yaml
Interoperability considerations: Same as application/yaml
Fragment identifier considerations: Unlike application/yaml, there
is no fragment identification syntax defined for +yaml.
A specific xxx/yyy+yaml media type needs to define the syntax and
semantics for fragment identifiers because the ones defined for
application/yaml do not apply unless explicitly expressed.
Security considerations: Same as application/yaml
Contact: httpapi@ietf.org or art@ietf.org
Author: See the Authors' Addresses section of this document.
Change controller: IETF
3. Interoperability Considerations
3.1. YAML Is an Evolving Language
YAML is an evolving language, and over time, some features have been
added and others removed.
The application/yaml media type registration is independent of the
YAML version. This allows content negotiation of version-independent
YAML resources.
Implementers concerned about features related to a specific YAML
version can specify it in YAML documents using the %YAML directive
(see Section 6.8.1 of [YAML]).
3.2. YAML Streams
A YAML stream can contain zero or more YAML documents.
When receiving a multi-document stream, an application that only
expects single-document streams should signal an error instead of
ignoring the extra documents.
Current implementations consider different documents in a stream
independent, similarly to JSON text sequences (see [RFC7464]);
elements such as anchors are not guaranteed to be referenceable
across different documents.
3.3. Filename Extension
The "yaml" filename extension is the preferred one; it is the most
popular and widely used on the web. The "yml" filename extension is
still used. The simultaneous usage of two filename extensions in the
same context might cause interoperability issues (e.g., when both a
"config.yaml" and a "config.yml" are present).
3.4. YAML and JSON
When using flow collection styles (see Section 7.4 of [YAML]), a YAML
document could look like JSON [JSON]; thus, similar interoperability
considerations apply.
When using YAML as a more efficient format to serialize information
intended to be consumed as JSON, information not reflected in the
representation graph and classified as presentation or serialization
details (see Section 3.2 of [YAML]) can be discarded. This includes
comments (see Section 3.2.3.3 of [YAML]), directives, and alias nodes
(see Section 7.1 of [YAML]) that do not have a JSON counterpart.
%YAML 1.2
---
# This comment will be lost
# when serializing in JSON.
Title:
type: string
maxLength: &text_limit 64
Name:
type: string
maxLength: *text_limit # Replaced by the value 64.
Figure 2: JSON Replaces Alias Nodes with Static Values
Implementers need to ensure that relevant information will not be
lost during processing. For example, they might consider alias nodes
being replaced by static values as acceptable.
In some cases, an implementer may want to define a list of allowed
YAML features, taking into account that the following features might
have interoperability issues with [JSON]:
* multi-document YAML streams
* non-UTF-8 encoding. Before encoding YAML streams in UTF-16 or
UTF-32, it is important to note that Section 8.1 of [JSON]
mandates the use of UTF-8 when exchanging JSON texts between
systems that are not part of a closed ecosystem and that
Section 5.2 of [YAML] recommends the use of UTF-8.
* mapping keys that are not strings
* cyclic references represented using anchors (see Section 4.2 and
Figure 4)
* .inf and .nan float values, since JSON does not support them
* non-JSON types, including the ones associated with tags like
!!timestamp that were included in the default schema of older YAML
versions
* tags in general, specifically ones that do not map to JSON types,
e.g., custom and local tags such as !!python/object and !mytag
(see Section 2.4 of [YAML])
%YAML 1.2
---
non-json-keys:
0: a number
[0, 1]: a sequence
? {k: v}
: a map
---
non-json-keys:
!date 2020-01-01: a timestamp
non-json-value: !date 2020-01-01
...
Figure 3: Example of Mapping Keys and Values Not Supported in
JSON in a Multi-Document YAML Stream
3.5. Fragment Identifiers
To allow fragment identifiers to traverse alias nodes, the YAML
representation graph needs to be generated before the fragment
identifier evaluation. It is important that this evaluation does not
cause the issues mentioned in Sections 3.4 and 4, such as infinite
loops and unexpected code execution.
Implementers need to consider that the YAML version and supported
features (e.g., merge keys) can affect the generation of the
representation graph (see Figure 9).
In Section 1.2, this document extends the use of specifications based
on the JSON data model with support for YAML fragment identifiers.
This is to improve the interoperability of already-consolidated
practices, such as writing OpenAPI documents [OAS] in YAML.
Appendix A provides a non-exhaustive list of examples to help readers
understand interoperability issues related to fragment identifiers.
4. Security Considerations
Security requirements for both media types and media type suffixes
are discussed in Section 4.6 of [MEDIATYPE].
4.1. Arbitrary Code Execution
Care should be used when using YAML tags because their resolution
might trigger unexpected code execution.
Code execution in deserializers should be disabled by default and
only be enabled explicitly. In the latter case, the implementation
should ensure (for example, via specific functions) that the code
execution results in strictly bounded time/memory limits.
Many implementations provide safe deserializers that address these
issues.
4.2. Resource Exhaustion
YAML documents are rooted, connected, directed graphs and can contain
reference cycles, so they can't be treated as simple trees (see
Section 3.2.1 of [YAML]). An implementation that treats them as
simple trees risks going into an infinite loop while traversing the
YAML representation graph. This can happen:
* when trying to serialize it as JSON or
* when searching/identifying nodes using specifications based on the
JSON data model (e.g., [JSON-POINTER]).
%YAML 1.2
---
x: &x
y: *x
Figure 4: A Cyclic Document
Even if a representation graph is not cyclic, treating it as a simple
tree could lead to improper behaviors, such as triggering an
Exponential Data Expansion (e.g., a Billion Laughs Attack).
%YAML 1.2
---
x1: &a1 ["a", "a"]
x2: &a2 [*a1, *a1]
x3: &a3 [*a2, *a2]
Figure 5: A Billion Laughs Document
This can be addressed using processors that limit the anchor
recursion depth and validate the input before processing it; even in
these cases, it is important to carefully test the implementation you
are going to use. The same considerations apply when serializing a
YAML representation graph in a format that does not support reference
cycles (see Section 3.4).
4.3. YAML Streams
Incremental parsing and processing of a YAML stream can produce
partial results and later indicate failure to parse the remainder of
the stream; to prevent partial processing, implementers might prefer
validating and processing all the documents in a stream at the same
time.
Repeated parsing and re-encoding of a YAML stream can result in the
addition or removal of document delimiters (e.g., --- or ...) as well
as the modification of anchor names and other serialization details
that can break signature validation.
4.4. Expressing Booleans
Section 10.3.2 of [YAML] specifies that only the scalars matching the
regular expression true|True|TRUE|false|False|FALSE are interpreted
as booleans. Older YAML versions were more tolerant (e.g.,
interpreting NO and N as False and interpreting YES and Y as True).
When the older syntax is used, a YAML implementation could then
interpret {insecure: n} as {insecure: "n"} instead of {insecure:
false}. Using the syntax defined in Section 10.3.2 of [YAML] prevents
these issues.
5. IANA Considerations
IANA has updated the "Media Types" registry
(https://www.iana.org/assignments/media-types) with the registration
information in Section 2.1 for the media type application/yaml.
IANA has updated the "Structured Syntax Suffixes" registry
(https://www.iana.org/assignments/media-type-structured-suffix) with
the registration information in Section 2.2 for the structured syntax
suffix +yaml.
6. References
6.1. Normative References
[HTTP] Fielding, R., Ed., Nottingham, M., Ed., and J. Reschke,
Ed., "HTTP Semantics", STD 97, RFC 9110,
DOI 10.17487/RFC9110, June 2022,
<https://www.rfc-editor.org/info/rfc9110>.
[JSON] Bray, T., Ed., "The JavaScript Object Notation (JSON) Data
Interchange Format", STD 90, RFC 8259,
DOI 10.17487/RFC8259, December 2017,
<https://www.rfc-editor.org/info/rfc8259>.
[JSON-POINTER]
Bryan, P., Ed., Zyp, K., and M. Nottingham, Ed.,
"JavaScript Object Notation (JSON) Pointer", RFC 6901,
DOI 10.17487/RFC6901, April 2013,
<https://www.rfc-editor.org/info/rfc6901>.
[MEDIATYPE]
Freed, N., Klensin, J., and T. Hansen, "Media Type
Specifications and Registration Procedures", BCP 13,
RFC 6838, DOI 10.17487/RFC6838, January 2013,
<https://www.rfc-editor.org/info/rfc6838>.
[OAS] Miller, D., Whitlock, J., Gardiner, M., Ralphson, M.,
Ratovsky, R., and U. Sarid, "OpenAPI Specification",
v3.0.0, 26 July 2017.
[RFC2119] Bradner, S., "Key words for use in RFCs to Indicate
Requirement Levels", BCP 14, RFC 2119,
DOI 10.17487/RFC2119, March 1997,
<https://www.rfc-editor.org/info/rfc2119>.
[RFC8174] Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC
2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174,
May 2017, <https://www.rfc-editor.org/info/rfc8174>.
[URI] Berners-Lee, T., Fielding, R., and L. Masinter, "Uniform
Resource Identifier (URI): Generic Syntax", STD 66,
RFC 3986, DOI 10.17487/RFC3986, January 2005,
<https://www.rfc-editor.org/info/rfc3986>.
[UTF-8] Yergeau, F., "UTF-8, a transformation format of ISO
10646", STD 63, RFC 3629, DOI 10.17487/RFC3629, November
2003, <https://www.rfc-editor.org/info/rfc3629>.
[YAML] Ben-Kiki, O., Evans, C., dot Net, I., Müller, T.,
Antoniou, P., Aro, E., and T. Smith, "YAML Ain't Markup
Language Version 1.2", 1 October 2021,
<https://yaml.org/spec/1.2.2/>.
6.2. Informative References
[RFC7464] Williams, N., "JavaScript Object Notation (JSON) Text
Sequences", RFC 7464, DOI 10.17487/RFC7464, February 2015,
<https://www.rfc-editor.org/info/rfc7464>.
Appendix A. Examples Related to Fragment Identifier Interoperability
A.1. Unreferenceable Nodes
This example shows a couple of YAML nodes that cannot be referenced
based on the JSON data model since their mapping keys are not
strings.
%YAML 1.2
---
a-map-cannot:
? {be: expressed}
: with a JSON Pointer
0: no numeric mapping keys in JSON
Figure 6: Example of YAML Nodes That Are Not Referenceable Based
on JSON Data Model
A.2. Referencing a Missing Node
In this example, the fragment #/0 does not reference an existing
node.
%YAML 1.2
---
0: "JSON Pointer `#/0` references a string mapping key."
Figure 7: Example of a JSON Pointer That Does Not Reference an
Existing Node
A.3. Representation Graph with Anchors and Cyclic References
In this YAML document, the #/foo/bar/baz fragment identifier
traverses the representation graph and references the string you.
Moreover, the presence of a cyclic reference implies that there are
infinite fragment identifiers #/foo/bat/../bat/bar referencing the
&anchor node.
%YAML 1.2
---
anchor: &anchor
baz: you
foo: &foo
bar: *anchor
bat: *foo
Figure 8: Example of a Cyclic Reference and Alias Nodes
Many YAML implementations will resolve the merge key "<<:"
(https://yaml.org/type/merge.html) defined in YAML 1.1 in the
representation graph. This means that the fragment #/book/author/
given_name references the string Federico and that the fragment
#/book/<< will not reference any existing node.
%YAML 1.1
---
# Many implementations use merge keys.
the-viceroys: &the-viceroys
title: The Viceroys
author:
given_name: Federico
family_name: De Roberto
book:
<<: *the-viceroys
title: The Illusion
Figure 9: Example of YAML Merge Keys
Acknowledgements
Thanks to Erik Wilde and David Biesack for being the initial
contributors to this specification and to Darrel Miller and Rich Salz
for their support during the adoption phase.
In addition, this document owes a lot to the extensive discussion
inside and outside the HTTPAPI Working Group. The following
contributors helped improve this specification by opening pull
requests, reporting bugs, asking smart questions, drafting or
reviewing text, and evaluating open issues: Tina (tinita) Müller, Ben
Hutton, Carsten Bormann, Manu Sporny, and Jason Desrosiers.
Authors' Addresses
Roberto Polli
Digital Transformation Department, Italian Government
Italy
Email: robipolli@gmail.com
Erik Wilde
Axway
Switzerland
Email: erik.wilde@dret.net
Eemeli Aro
Mozilla
Finland
Email: eemeli@gmail.com