rfc9307v2.txt   rfc9307.txt 
Internet Architecture Board (IAB) N. ten Oever Internet Architecture Board (IAB) N. ten Oever
Request for Comments: 9307 University of Amsterdam Request for Comments: 9307 University of Amsterdam
Category: Informational C. Cath Category: Informational C. Cath
ISSN: 2070-1721 ISSN: 2070-1721 University of Cambridge
M. Kühlewind M. Kühlewind
Ericsson Ericsson
C. S. Perkins C. S. Perkins
University of Glasgow University of Glasgow
August 2022 August 2022
Report from the IAB Workshop on Analyzing IETF Data (AID) 2021 Report from the IAB Workshop on Analyzing IETF Data (AID) 2021
Abstract Abstract
skipping to change at line 85 skipping to change at line 85
Appendix A. Data Taxonomy Appendix A. Data Taxonomy
Appendix B. Program Committee Appendix B. Program Committee
Appendix C. Workshop Participants Appendix C. Workshop Participants
IAB Members at the Time of Approval IAB Members at the Time of Approval
Acknowledgments Acknowledgments
Authors' Addresses Authors' Addresses
1. Introduction 1. Introduction
The IETF, as an international Standards Developing Organization The IETF, as an international Standards Developing Organization
(SDO), hosts a diverse set of data about about the IETF's history and (SDO), hosts a diverse set of data about the IETF's history and
development, current standardisation activities, Internet protocols, development, current standardisation activities, Internet protocols,
and the institutions that comprise the IETF. A large portion of this and the institutions that comprise the IETF. A large portion of this
data is publicly available, yet it is underutilized as a tool to data is publicly available, yet it is underutilized as a tool to
inform the work in the IETF or the broader research community that is inform the work in the IETF or the broader research community that is
focused on topics like Internet governance and trends in information focused on topics like Internet governance and trends in information
and communication technologies (ICT) standard setting. and communication technologies (ICT) standard setting.
The aim of the "IAB Workshop on Analyzing IETF Data (AID) 2021" The aim of the "IAB Workshop on Analyzing IETF Data (AID) 2021"
workshop was to study how IETF data is currently used, to understand workshop was to study how IETF data is currently used, to understand
what insights can be drawn from that data, and to explore open what insights can be drawn from that data, and to explore open
skipping to change at line 114 skipping to change at line 114
The workshop was organized with two all-group discussion slots at the The workshop was organized with two all-group discussion slots at the
beginning and the end of the workshop. In between, the workshop beginning and the end of the workshop. In between, the workshop
participants organized hackathon activities based on topics participants organized hackathon activities based on topics
identified during the initial discussion and in submitted position identified during the initial discussion and in submitted position
papers. The following topic areas were identified and discussed. papers. The following topic areas were identified and discussed.
2.1. Tools, Data, and Methods 2.1. Tools, Data, and Methods
The IETF holds a wide range of data sources. The main ones used are The IETF holds a wide range of data sources. The main ones used are
the mailinglist archives (https://mailarchive.ietf.org/arch/) the mailinglist archives [Mail-Arch], RFCs [IETF-RFCs], and the
[Mail-Arch], RFCs (https://www.ietf.org/standards/rfcs/) [IETF-RFCs], datatracker [Datatracker]. The latter provides information on
and the datatracker (https://datatracker.ietf.org/) [Datatracker]. participants, authors, meeting proceedings, minutes, and more
The latter provides information on participants, authors, meeting [Data-Overview]. Furthermore, there are statistics for the IETF
proceedings, minutes, and more (https://notes.ietf.org/iab-aid- websites [IETF-Statistics], the working group Github repositories,
datatracker-database-overview#) [Data-Overview]. Furthermore, there and the IETF survey data [Survey-Data]. There was discussion about
are statistics for the IETF websites (https://www.ietf.org/policies/ the utility of download statistics for the RFCs themselves from
web-analytics/) [IETF-Statistics], the working group Github
repositories, and the IETF survey data (https://www.ietf.org/blog/
ietf-community-survey-2021/) [Survey-Data]. There was discussion
about the utility of download statistics for the RFCs themselves from
different repos. different repos.
There is a wide range of tools to analyze this data produced by IETF There is a wide range of tools to analyze this data produced by IETF
participants or researchers interested in the work of the IETF. Two participants or researchers interested in the work of the IETF. Two
projects that presented their work at the workshop were BigBang projects that presented their work at the workshop were BigBang
(https://bigbang-py.readthedocs.io/en/latest/) [BigBang] and [BigBang] and Sodestream's IETFdata [ietfdata] library. The RFC
Sodestream's IETFdata (https://github.com/glasgow-ipl/ietfdata) Prolog Database was described in a submitted paper (see Section 4
[ietfdata] library. The RFC Prolog Database was described in a below). These projects could provide additional insight into
submitted paper (see Section 4 below). These projects could provide existing IETF statistics [ArkkoStats] and datatracker statistics
additional insight into existing IETF statistics
(https://www.arkko.com/tools/docstats.html) [ArkkoStats] and
datatracker statistics (https://datatracker.ietf.org/stats/)
[DatatrackerStats], e.g., gender-related information. Privacy issues [DatatrackerStats], e.g., gender-related information. Privacy issues
and the implications of making such data publicly available were and the implications of making such data publicly available were
discussed as well. discussed as well.
The datatracker itself is a community tool that welcomes The datatracker itself is a community tool that welcomes
contributions; for example, for additions to the existing interfaces contributions; for example, for additions to the existing interfaces
or the statistics page directly, see the Datatracker Database or the statistics page directly, see the Datatracker Database
Overview <https://notes.ietf.org/iab-aid-datatracker-database- Overview [Data-Overview]. At the time of the workshop, instructions
overview#> [Data-Overview]. At the time of the workshop, about how to set up a local development environment could be found at
instructions about how to set up a local development environment IAB AID Workshop Data Resources [DataResources]. Questions or
could be found at IAB AID Workshop Data Resources discussion about the datatracker and possible enhancements can be
<https://notes.ietf.org/iab-aid-data-resources> [DataResources]. sent to tools-discuss@ietf.org.
Questions or discussion about the datatracker and possible
enhancements can be sent to tools-discuss@ietf.org.
2.2. Observations on Affiliation and Industry Control 2.2. Observations on Affiliation and Industry Control
A large portion of the submitted position papers indicated interest A large portion of the submitted position papers indicated interest
in researching questions about industry control in the in researching questions about industry control in the
standardization process (as opposed to individual contributions in a standardization process (as opposed to individual contributions in a
personal capacity), where industry control covers both a) technical personal capacity), where industry control covers both a) technical
contributions and the ability to successfully standardize these contributions and the ability to successfully standardize these
contributions and b) competition on leadership roles. To assess contributions and b) competition on leadership roles. To assess
these questions, investigating participant affiliations, including these questions, investigating participant affiliations, including
skipping to change at line 185 skipping to change at line 176
Furthermore, there is the issue of mergers, acquisitions, and Furthermore, there is the issue of mergers, acquisitions, and
subsidiary companies. There is no authoritative exogenous source of subsidiary companies. There is no authoritative exogenous source of
variation for affiliation changes, so hand-collected and curated data variation for affiliation changes, so hand-collected and curated data
is used to analyze changes in affiliation over time. While this is used to analyze changes in affiliation over time. While this
approach is imperfect, conclusions can be drawn from the data. For approach is imperfect, conclusions can be drawn from the data. For
example, in the case of mergers or acquisition where a small example, in the case of mergers or acquisition where a small
organization joins a large organization, this results in a organization joins a large organization, this results in a
statistically significant increase in likelihood of an individual statistically significant increase in likelihood of an individual
being put in a working group chair position (see the document by being put in a working group chair position (see the document by
Baron and Kanevskaia (https://www.iab.org/wp-content/IAB- Baron and Kanevskaia [LEADERSHIP-POSITIONS]).
uploads/2021/11/Baron.pdf) [LEADERSHIP-POSITIONS]).
2.3. Community and Diversity 2.3. Community and Diversity
The workshop participants were highly interested in using existing The workshop participants were highly interested in using existing
data to better understand who the current IETF community is. They data to better understand who the current IETF community is. They
were also interested in the community's diversity and how to were also interested in the community's diversity and how to
potentially increase it and thereby increase inclusivity, e.g., potentially increase it and thereby increase inclusivity, e.g.,
understanding if there are certain factors that "drive people away" understanding if there are certain factors that "drive people away"
and why. Inclusivity and transparency about the standardization and why. Inclusivity and transparency about the standardization
process are generally important to keep the Internet and its process are generally important to keep the Internet and its
skipping to change at line 355 skipping to change at line 345
Future workshops that choose to integrate a hackathon could consider Future workshops that choose to integrate a hackathon could consider
asking participants to submit issues and questions beforehand asking participants to submit issues and questions beforehand
(potentially as part of the position papers or the sign-up process) (potentially as part of the position papers or the sign-up process)
to facilitate the formation of groups. to facilitate the formation of groups.
4. Position Papers 4. Position Papers
4.1. Tools, Data, and Methods 4.1. Tools, Data, and Methods
Sebastian Benthall, "Using Complex Systems Analysis to Identify Sebastian Benthall, "Using Complex Systems Analysis to Identify
Organizational Interventions" <https://www.iab.org/wp-content/IAB- Organizational Interventions" [COMPLEX-SYSTEMS]
uploads/2021/11/Benthall.pdf> [COMPLEX-SYSTEMS]
Stephen McQuistin, Colin Perkins, "The ietfdata Library" Stephen McQuistin and Colin Perkins, "The ietfdata Library"
<https://www.iab.org/wp-content/IAB-uploads/2021/11/McQuistin.pdf>
[ietfdata-Library] [ietfdata-Library]
Marc Petit-Huguenin, "The RFC Prolog Database" <https://www.iab.org/ Marc Petit-Huguenin, "The RFC Prolog Database" [PROLOG-DATABASE]
wp-content/IAB-uploads/2021/11/Petit-Huguenin.txt> [PROLOG-DATABASE]
Jari Arkko, "Observations about IETF process measurements" Jari Arkko, "Observations about IETF process measurements"
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Arkko.pdf>
[MEASURING-IETF-PROCESSES] [MEASURING-IETF-PROCESSES]
4.2. Observations on Affiliation and Industry Control 4.2. Observations on Affiliation and Industry Control
Justus Baron, Olia Kanevskaia, "Competition for Leadership Positions Justus Baron and Olia Kanevskaia, "Competition for Leadership
in Standards Development Organizations" <https://www.iab.org/wp- Positions in Standards Development Organizations"
content/IAB-uploads/2021/11/Baron.pdf> [LEADERSHIP-POSITIONS] [LEADERSHIP-POSITIONS]
Nick Doty, "Analyzing IETF Data: Changing affiliations" Nick Doty, "Analyzing IETF Data: Changing affiliations"
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Doty.pdf>
[ANALYZING-AFFILIATIONS] [ANALYZING-AFFILIATIONS]
Don Le, "Analysing IETF Data Position Paper" <https://www.iab.org/wp- Don Le, "Analysing IETF Data Position Paper" [ANALYSING-IETF]
content/IAB-uploads/2021/11/Le.pdf> [ANALYSING-IETF]
Elizaveta Yachmeneva, "Research Proposal" <https://www.iab.org/wp- Elizaveta Yachmeneva, "Research Proposal" [RESEARCH-PROPOSAL]
content/IAB-uploads/2021/11/Yachmeneva.pdf> [RESEARCH-PROPOSAL]
4.3. Community and Diversity 4.3. Community and Diversity
Priyanka Sinha, Michael Ackermann, Pabitra Mitra, Arvind Singh, Amit Priyanka Sinha, Michael Ackermann, Pabitra Mitra, Arvind Singh, and
Kumar Agrawal, "Characterizing the IETF through its consensus Amit Kumar Agrawal, "Characterizing the IETF through its consensus
mechanisms" <https://www.iab.org/wp-content/IAB-uploads/2021/11/ mechanisms" [CONSENSUS-MECHANISMS]
Sinha.pdf> [CONSENSUS-MECHANISMS]
Mallory Knodel, "Would feminists have built a better internet?" Mallory Knodel, "Would feminists have built a better internet?"
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Knodel.pdf>
[FEMINIST-INTERNET] [FEMINIST-INTERNET]
Wes Hardaker, Genevieve Bartlett, "Identifying temporal trends in Wes Hardaker and Genevieve Bartlett, "Identifying temporal trends in
IETF participation" <https://www.iab.org/wp-content/IAB- IETF participation" [TEMPORAL-TRENDS]
uploads/2021/11/Hardaker.pdf> [TEMPORAL-TRENDS]
Lars Eggert, "Who is the Average IETF Participant?" Lars Eggert, "Who is the Average IETF Participant?"
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Eggert.pdf>
[AVERAGE-PARTICIPANT] [AVERAGE-PARTICIPANT]
Emanuele Tarantino, Justus Baron, Bernhard Ganglmair, Nicola Persico, Emanuele Tarantino, Justus Baron, Bernhard Ganglmair, Nicola Persico,
Timothy Simcoe, "Representation is Not Sufficient for Selecting and Timothy Simcoe, "Representation is Not Sufficient for Selecting
Gender Diversity" <https://www.iab.org/wp-content/IAB- Gender Diversity" [GENDER-DIVERSITY]
uploads/2021/11/Tarantino.pdf> [GENDER-DIVERSITY]
4.4. Publications, Process, and Decision Making 4.4. Publications, Process, and Decision Making
Michael Welzl, Carsten Griwodz, Safiqul Islam, "Understanding Michael Welzl, Carsten Griwodz, and Safiqul Islam, "Understanding
Internet Protocol Design Decisions" <https://www.iab.org/wp-content/ Internet Protocol Design Decisions" [DESIGN-DECISIONS]
IAB-uploads/2021/11/Welzl.pdf> [DESIGN-DECISIONS]
Ignacio Castro et al, "Characterising the IETF through the lens of Ignacio Castro et al., "Characterising the IETF through the lens of
RFC deployment" <https://dl.acm.org/doi/abs/10.1145/3487552.3487821> RFC deployment" [RFC-DEPLOYMENT]
[RFC-DEPLOYMENT]
Carsten Griwodz, Safiqul Islam, Michael Welzl, "The Impact of Carsten Griwodz, Safiqul Islam, and Michael Welzl, "The Impact of
Continuity" <https://www.iab.org/wp-content/IAB-uploads/2021/11/ Continuity" [CONTINUITY]
Griwodz.pdf> [CONTINUITY]
Paul Hoffman, "RFCs Change" <https://www.iab.org/wp-content/IAB- Paul Hoffman, "RFCs Change" [RFCs-CHANGE]
uploads/2021/11/Hoffman.pdf> [RFCs-CHANGE]
Xue Li, Sara Magliacane, Paul Groth, "The Challenges of Cross- Xue Li, Sara Magliacane, and Paul Groth, "The Challenges of
Document Coreference Resolution in Email" <https://www.iab.org/wp- Cross-Document Coreference Resolution in Email"
content/IAB-uploads/2021/11/Groth.pdf> [CROSS-DOC-COREFERENCE] [CROSS-DOC-COREFERENCE]
Amelia Andersdotter, "Project in time series analysis: e-mailing Amelia Andersdotter, "Project in time series analysis: e-mailing
lists" <https://www.iab.org/wp-content/IAB-uploads/2021/11/ lists" [E-MAILING-LISTS]
Andersdotter.pdf> [E-MAILING-LISTS]
Mark McFadden, "A Position Paper by Mark McFadden" Mark McFadden, "A Position Paper by Mark McFadden" [POSITION-PAPER]
<https://www.iab.org/wp-content/IAB-uploads/2021/11/McFadden.pdf>
[POSITION-PAPER]
4.5. Environmental Sustainability 4.5. Environmental Sustainability
Christoph Becker, "Towards Environmental Sustainability with the Christoph Becker, "Towards Environmental Sustainability with the
IETF" <https://www.iab.org/wp-content/IAB-uploads/2021/11/Becker.pdf> IETF" [ENVIRONMENTAL]
[ENVIRONMENTAL]
Daniel Migault, "CO2eq: Estimating Meetings' Air Flight CO2 Daniel Migault, "CO2eq: Estimating Meetings' Air Flight CO2
Equivalent Emissions: An Illustrative Example with IETF meetings" Equivalent Emissions: An Illustrative Example with IETF meetings"
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Migault.pdf>
[CO2eq] [CO2eq]
5. Informative References 5. Informative References
[ANALYSING-IETF] [ANALYSING-IETF]
Article 19, "Analysing IETF Position Paper", Article 19, "Analysing IETF Position Paper",
<https://www.iab.org/wp-content/IAB-uploads/2021/11/ <https://www.iab.org/wp-content/IAB-uploads/2021/11/
Le.pdf>. Le.pdf>.
[ANALYZING-AFFILIATIONS] [ANALYZING-AFFILIATIONS]
skipping to change at line 783 skipping to change at line 752
supported in part by the UK Engineering and Physical Sciences supported in part by the UK Engineering and Physical Sciences
Research Council under grant EP/S036075/1. Research Council under grant EP/S036075/1.
Authors' Addresses Authors' Addresses
Niels ten Oever Niels ten Oever
University of Amsterdam University of Amsterdam
Email: mail@nielstenoever.net Email: mail@nielstenoever.net
Corinne Cath Corinne Cath
University of Cambridge
Email: corinnecath@gmail.com Email: corinnecath@gmail.com
Mirja Kühlewind Mirja Kühlewind
Ericsson Ericsson
Email: mirja.kuehlewind@ericsson.com Email: mirja.kuehlewind@ericsson.com
Colin Perkins Colin Perkins
University of Glasgow University of Glasgow
Email: csp@csperkins.org Email: csp@csperkins.org
 End of changes. 29 change blocks. 
78 lines changed or deleted 48 lines changed or added

This html diff was produced by rfcdiff 1.48.