rfc9307v2.txt | rfc9307.txt | |||
---|---|---|---|---|
Internet Architecture Board (IAB) N. ten Oever | Internet Architecture Board (IAB) N. ten Oever | |||
Request for Comments: 9307 University of Amsterdam | Request for Comments: 9307 University of Amsterdam | |||
Category: Informational C. Cath | Category: Informational C. Cath | |||
ISSN: 2070-1721 | ISSN: 2070-1721 University of Cambridge | |||
M. Kühlewind | M. Kühlewind | |||
Ericsson | Ericsson | |||
C. S. Perkins | C. S. Perkins | |||
University of Glasgow | University of Glasgow | |||
August 2022 | August 2022 | |||
Report from the IAB Workshop on Analyzing IETF Data (AID) 2021 | Report from the IAB Workshop on Analyzing IETF Data (AID) 2021 | |||
Abstract | Abstract | |||
skipping to change at line 85 ¶ | skipping to change at line 85 ¶ | |||
Appendix A. Data Taxonomy | Appendix A. Data Taxonomy | |||
Appendix B. Program Committee | Appendix B. Program Committee | |||
Appendix C. Workshop Participants | Appendix C. Workshop Participants | |||
IAB Members at the Time of Approval | IAB Members at the Time of Approval | |||
Acknowledgments | Acknowledgments | |||
Authors' Addresses | Authors' Addresses | |||
1. Introduction | 1. Introduction | |||
The IETF, as an international Standards Developing Organization | The IETF, as an international Standards Developing Organization | |||
(SDO), hosts a diverse set of data about about the IETF's history and | (SDO), hosts a diverse set of data about the IETF's history and | |||
development, current standardisation activities, Internet protocols, | development, current standardisation activities, Internet protocols, | |||
and the institutions that comprise the IETF. A large portion of this | and the institutions that comprise the IETF. A large portion of this | |||
data is publicly available, yet it is underutilized as a tool to | data is publicly available, yet it is underutilized as a tool to | |||
inform the work in the IETF or the broader research community that is | inform the work in the IETF or the broader research community that is | |||
focused on topics like Internet governance and trends in information | focused on topics like Internet governance and trends in information | |||
and communication technologies (ICT) standard setting. | and communication technologies (ICT) standard setting. | |||
The aim of the "IAB Workshop on Analyzing IETF Data (AID) 2021" | The aim of the "IAB Workshop on Analyzing IETF Data (AID) 2021" | |||
workshop was to study how IETF data is currently used, to understand | workshop was to study how IETF data is currently used, to understand | |||
what insights can be drawn from that data, and to explore open | what insights can be drawn from that data, and to explore open | |||
skipping to change at line 114 ¶ | skipping to change at line 114 ¶ | |||
The workshop was organized with two all-group discussion slots at the | The workshop was organized with two all-group discussion slots at the | |||
beginning and the end of the workshop. In between, the workshop | beginning and the end of the workshop. In between, the workshop | |||
participants organized hackathon activities based on topics | participants organized hackathon activities based on topics | |||
identified during the initial discussion and in submitted position | identified during the initial discussion and in submitted position | |||
papers. The following topic areas were identified and discussed. | papers. The following topic areas were identified and discussed. | |||
2.1. Tools, Data, and Methods | 2.1. Tools, Data, and Methods | |||
The IETF holds a wide range of data sources. The main ones used are | The IETF holds a wide range of data sources. The main ones used are | |||
the mailinglist archives (https://mailarchive.ietf.org/arch/) | the mailinglist archives [Mail-Arch], RFCs [IETF-RFCs], and the | |||
[Mail-Arch], RFCs (https://www.ietf.org/standards/rfcs/) [IETF-RFCs], | datatracker [Datatracker]. The latter provides information on | |||
and the datatracker (https://datatracker.ietf.org/) [Datatracker]. | participants, authors, meeting proceedings, minutes, and more | |||
The latter provides information on participants, authors, meeting | [Data-Overview]. Furthermore, there are statistics for the IETF | |||
proceedings, minutes, and more (https://notes.ietf.org/iab-aid- | websites [IETF-Statistics], the working group Github repositories, | |||
datatracker-database-overview#) [Data-Overview]. Furthermore, there | and the IETF survey data [Survey-Data]. There was discussion about | |||
are statistics for the IETF websites (https://www.ietf.org/policies/ | the utility of download statistics for the RFCs themselves from | |||
web-analytics/) [IETF-Statistics], the working group Github | ||||
repositories, and the IETF survey data (https://www.ietf.org/blog/ | ||||
ietf-community-survey-2021/) [Survey-Data]. There was discussion | ||||
about the utility of download statistics for the RFCs themselves from | ||||
different repos. | different repos. | |||
There is a wide range of tools to analyze this data produced by IETF | There is a wide range of tools to analyze this data produced by IETF | |||
participants or researchers interested in the work of the IETF. Two | participants or researchers interested in the work of the IETF. Two | |||
projects that presented their work at the workshop were BigBang | projects that presented their work at the workshop were BigBang | |||
(https://bigbang-py.readthedocs.io/en/latest/) [BigBang] and | [BigBang] and Sodestream's IETFdata [ietfdata] library. The RFC | |||
Sodestream's IETFdata (https://github.com/glasgow-ipl/ietfdata) | Prolog Database was described in a submitted paper (see Section 4 | |||
[ietfdata] library. The RFC Prolog Database was described in a | below). These projects could provide additional insight into | |||
submitted paper (see Section 4 below). These projects could provide | existing IETF statistics [ArkkoStats] and datatracker statistics | |||
additional insight into existing IETF statistics | ||||
(https://www.arkko.com/tools/docstats.html) [ArkkoStats] and | ||||
datatracker statistics (https://datatracker.ietf.org/stats/) | ||||
[DatatrackerStats], e.g., gender-related information. Privacy issues | [DatatrackerStats], e.g., gender-related information. Privacy issues | |||
and the implications of making such data publicly available were | and the implications of making such data publicly available were | |||
discussed as well. | discussed as well. | |||
The datatracker itself is a community tool that welcomes | The datatracker itself is a community tool that welcomes | |||
contributions; for example, for additions to the existing interfaces | contributions; for example, for additions to the existing interfaces | |||
or the statistics page directly, see the Datatracker Database | or the statistics page directly, see the Datatracker Database | |||
Overview <https://notes.ietf.org/iab-aid-datatracker-database- | Overview [Data-Overview]. At the time of the workshop, instructions | |||
overview#> [Data-Overview]. At the time of the workshop, | about how to set up a local development environment could be found at | |||
instructions about how to set up a local development environment | IAB AID Workshop Data Resources [DataResources]. Questions or | |||
could be found at IAB AID Workshop Data Resources | discussion about the datatracker and possible enhancements can be | |||
<https://notes.ietf.org/iab-aid-data-resources> [DataResources]. | sent to tools-discuss@ietf.org. | |||
Questions or discussion about the datatracker and possible | ||||
enhancements can be sent to tools-discuss@ietf.org. | ||||
2.2. Observations on Affiliation and Industry Control | 2.2. Observations on Affiliation and Industry Control | |||
A large portion of the submitted position papers indicated interest | A large portion of the submitted position papers indicated interest | |||
in researching questions about industry control in the | in researching questions about industry control in the | |||
standardization process (as opposed to individual contributions in a | standardization process (as opposed to individual contributions in a | |||
personal capacity), where industry control covers both a) technical | personal capacity), where industry control covers both a) technical | |||
contributions and the ability to successfully standardize these | contributions and the ability to successfully standardize these | |||
contributions and b) competition on leadership roles. To assess | contributions and b) competition on leadership roles. To assess | |||
these questions, investigating participant affiliations, including | these questions, investigating participant affiliations, including | |||
skipping to change at line 185 ¶ | skipping to change at line 176 ¶ | |||
Furthermore, there is the issue of mergers, acquisitions, and | Furthermore, there is the issue of mergers, acquisitions, and | |||
subsidiary companies. There is no authoritative exogenous source of | subsidiary companies. There is no authoritative exogenous source of | |||
variation for affiliation changes, so hand-collected and curated data | variation for affiliation changes, so hand-collected and curated data | |||
is used to analyze changes in affiliation over time. While this | is used to analyze changes in affiliation over time. While this | |||
approach is imperfect, conclusions can be drawn from the data. For | approach is imperfect, conclusions can be drawn from the data. For | |||
example, in the case of mergers or acquisition where a small | example, in the case of mergers or acquisition where a small | |||
organization joins a large organization, this results in a | organization joins a large organization, this results in a | |||
statistically significant increase in likelihood of an individual | statistically significant increase in likelihood of an individual | |||
being put in a working group chair position (see the document by | being put in a working group chair position (see the document by | |||
Baron and Kanevskaia (https://www.iab.org/wp-content/IAB- | Baron and Kanevskaia [LEADERSHIP-POSITIONS]). | |||
uploads/2021/11/Baron.pdf) [LEADERSHIP-POSITIONS]). | ||||
2.3. Community and Diversity | 2.3. Community and Diversity | |||
The workshop participants were highly interested in using existing | The workshop participants were highly interested in using existing | |||
data to better understand who the current IETF community is. They | data to better understand who the current IETF community is. They | |||
were also interested in the community's diversity and how to | were also interested in the community's diversity and how to | |||
potentially increase it and thereby increase inclusivity, e.g., | potentially increase it and thereby increase inclusivity, e.g., | |||
understanding if there are certain factors that "drive people away" | understanding if there are certain factors that "drive people away" | |||
and why. Inclusivity and transparency about the standardization | and why. Inclusivity and transparency about the standardization | |||
process are generally important to keep the Internet and its | process are generally important to keep the Internet and its | |||
skipping to change at line 355 ¶ | skipping to change at line 345 ¶ | |||
Future workshops that choose to integrate a hackathon could consider | Future workshops that choose to integrate a hackathon could consider | |||
asking participants to submit issues and questions beforehand | asking participants to submit issues and questions beforehand | |||
(potentially as part of the position papers or the sign-up process) | (potentially as part of the position papers or the sign-up process) | |||
to facilitate the formation of groups. | to facilitate the formation of groups. | |||
4. Position Papers | 4. Position Papers | |||
4.1. Tools, Data, and Methods | 4.1. Tools, Data, and Methods | |||
Sebastian Benthall, "Using Complex Systems Analysis to Identify | Sebastian Benthall, "Using Complex Systems Analysis to Identify | |||
Organizational Interventions" <https://www.iab.org/wp-content/IAB- | Organizational Interventions" [COMPLEX-SYSTEMS] | |||
uploads/2021/11/Benthall.pdf> [COMPLEX-SYSTEMS] | ||||
Stephen McQuistin, Colin Perkins, "The ietfdata Library" | Stephen McQuistin and Colin Perkins, "The ietfdata Library" | |||
<https://www.iab.org/wp-content/IAB-uploads/2021/11/McQuistin.pdf> | ||||
[ietfdata-Library] | [ietfdata-Library] | |||
Marc Petit-Huguenin, "The RFC Prolog Database" <https://www.iab.org/ | Marc Petit-Huguenin, "The RFC Prolog Database" [PROLOG-DATABASE] | |||
wp-content/IAB-uploads/2021/11/Petit-Huguenin.txt> [PROLOG-DATABASE] | ||||
Jari Arkko, "Observations about IETF process measurements" | Jari Arkko, "Observations about IETF process measurements" | |||
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Arkko.pdf> | ||||
[MEASURING-IETF-PROCESSES] | [MEASURING-IETF-PROCESSES] | |||
4.2. Observations on Affiliation and Industry Control | 4.2. Observations on Affiliation and Industry Control | |||
Justus Baron, Olia Kanevskaia, "Competition for Leadership Positions | Justus Baron and Olia Kanevskaia, "Competition for Leadership | |||
in Standards Development Organizations" <https://www.iab.org/wp- | Positions in Standards Development Organizations" | |||
content/IAB-uploads/2021/11/Baron.pdf> [LEADERSHIP-POSITIONS] | [LEADERSHIP-POSITIONS] | |||
Nick Doty, "Analyzing IETF Data: Changing affiliations" | Nick Doty, "Analyzing IETF Data: Changing affiliations" | |||
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Doty.pdf> | ||||
[ANALYZING-AFFILIATIONS] | [ANALYZING-AFFILIATIONS] | |||
Don Le, "Analysing IETF Data Position Paper" <https://www.iab.org/wp- | Don Le, "Analysing IETF Data Position Paper" [ANALYSING-IETF] | |||
content/IAB-uploads/2021/11/Le.pdf> [ANALYSING-IETF] | ||||
Elizaveta Yachmeneva, "Research Proposal" <https://www.iab.org/wp- | Elizaveta Yachmeneva, "Research Proposal" [RESEARCH-PROPOSAL] | |||
content/IAB-uploads/2021/11/Yachmeneva.pdf> [RESEARCH-PROPOSAL] | ||||
4.3. Community and Diversity | 4.3. Community and Diversity | |||
Priyanka Sinha, Michael Ackermann, Pabitra Mitra, Arvind Singh, Amit | Priyanka Sinha, Michael Ackermann, Pabitra Mitra, Arvind Singh, and | |||
Kumar Agrawal, "Characterizing the IETF through its consensus | Amit Kumar Agrawal, "Characterizing the IETF through its consensus | |||
mechanisms" <https://www.iab.org/wp-content/IAB-uploads/2021/11/ | mechanisms" [CONSENSUS-MECHANISMS] | |||
Sinha.pdf> [CONSENSUS-MECHANISMS] | ||||
Mallory Knodel, "Would feminists have built a better internet?" | Mallory Knodel, "Would feminists have built a better internet?" | |||
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Knodel.pdf> | ||||
[FEMINIST-INTERNET] | [FEMINIST-INTERNET] | |||
Wes Hardaker, Genevieve Bartlett, "Identifying temporal trends in | Wes Hardaker and Genevieve Bartlett, "Identifying temporal trends in | |||
IETF participation" <https://www.iab.org/wp-content/IAB- | IETF participation" [TEMPORAL-TRENDS] | |||
uploads/2021/11/Hardaker.pdf> [TEMPORAL-TRENDS] | ||||
Lars Eggert, "Who is the Average IETF Participant?" | Lars Eggert, "Who is the Average IETF Participant?" | |||
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Eggert.pdf> | ||||
[AVERAGE-PARTICIPANT] | [AVERAGE-PARTICIPANT] | |||
Emanuele Tarantino, Justus Baron, Bernhard Ganglmair, Nicola Persico, | Emanuele Tarantino, Justus Baron, Bernhard Ganglmair, Nicola Persico, | |||
Timothy Simcoe, "Representation is Not Sufficient for Selecting | and Timothy Simcoe, "Representation is Not Sufficient for Selecting | |||
Gender Diversity" <https://www.iab.org/wp-content/IAB- | Gender Diversity" [GENDER-DIVERSITY] | |||
uploads/2021/11/Tarantino.pdf> [GENDER-DIVERSITY] | ||||
4.4. Publications, Process, and Decision Making | 4.4. Publications, Process, and Decision Making | |||
Michael Welzl, Carsten Griwodz, Safiqul Islam, "Understanding | Michael Welzl, Carsten Griwodz, and Safiqul Islam, "Understanding | |||
Internet Protocol Design Decisions" <https://www.iab.org/wp-content/ | Internet Protocol Design Decisions" [DESIGN-DECISIONS] | |||
IAB-uploads/2021/11/Welzl.pdf> [DESIGN-DECISIONS] | ||||
Ignacio Castro et al, "Characterising the IETF through the lens of | Ignacio Castro et al., "Characterising the IETF through the lens of | |||
RFC deployment" <https://dl.acm.org/doi/abs/10.1145/3487552.3487821> | RFC deployment" [RFC-DEPLOYMENT] | |||
[RFC-DEPLOYMENT] | ||||
Carsten Griwodz, Safiqul Islam, Michael Welzl, "The Impact of | Carsten Griwodz, Safiqul Islam, and Michael Welzl, "The Impact of | |||
Continuity" <https://www.iab.org/wp-content/IAB-uploads/2021/11/ | Continuity" [CONTINUITY] | |||
Griwodz.pdf> [CONTINUITY] | ||||
Paul Hoffman, "RFCs Change" <https://www.iab.org/wp-content/IAB- | Paul Hoffman, "RFCs Change" [RFCs-CHANGE] | |||
uploads/2021/11/Hoffman.pdf> [RFCs-CHANGE] | ||||
Xue Li, Sara Magliacane, Paul Groth, "The Challenges of Cross- | Xue Li, Sara Magliacane, and Paul Groth, "The Challenges of | |||
Document Coreference Resolution in Email" <https://www.iab.org/wp- | Cross-Document Coreference Resolution in Email" | |||
content/IAB-uploads/2021/11/Groth.pdf> [CROSS-DOC-COREFERENCE] | [CROSS-DOC-COREFERENCE] | |||
Amelia Andersdotter, "Project in time series analysis: e-mailing | Amelia Andersdotter, "Project in time series analysis: e-mailing | |||
lists" <https://www.iab.org/wp-content/IAB-uploads/2021/11/ | lists" [E-MAILING-LISTS] | |||
Andersdotter.pdf> [E-MAILING-LISTS] | ||||
Mark McFadden, "A Position Paper by Mark McFadden" | Mark McFadden, "A Position Paper by Mark McFadden" [POSITION-PAPER] | |||
<https://www.iab.org/wp-content/IAB-uploads/2021/11/McFadden.pdf> | ||||
[POSITION-PAPER] | ||||
4.5. Environmental Sustainability | 4.5. Environmental Sustainability | |||
Christoph Becker, "Towards Environmental Sustainability with the | Christoph Becker, "Towards Environmental Sustainability with the | |||
IETF" <https://www.iab.org/wp-content/IAB-uploads/2021/11/Becker.pdf> | IETF" [ENVIRONMENTAL] | |||
[ENVIRONMENTAL] | ||||
Daniel Migault, "CO2eq: Estimating Meetings' Air Flight CO2 | Daniel Migault, "CO2eq: Estimating Meetings' Air Flight CO2 | |||
Equivalent Emissions: An Illustrative Example with IETF meetings" | Equivalent Emissions: An Illustrative Example with IETF meetings" | |||
<https://www.iab.org/wp-content/IAB-uploads/2021/11/Migault.pdf> | ||||
[CO2eq] | [CO2eq] | |||
5. Informative References | 5. Informative References | |||
[ANALYSING-IETF] | [ANALYSING-IETF] | |||
Article 19, "Analysing IETF Position Paper", | Article 19, "Analysing IETF Position Paper", | |||
<https://www.iab.org/wp-content/IAB-uploads/2021/11/ | <https://www.iab.org/wp-content/IAB-uploads/2021/11/ | |||
Le.pdf>. | Le.pdf>. | |||
[ANALYZING-AFFILIATIONS] | [ANALYZING-AFFILIATIONS] | |||
skipping to change at line 783 ¶ | skipping to change at line 752 ¶ | |||
supported in part by the UK Engineering and Physical Sciences | supported in part by the UK Engineering and Physical Sciences | |||
Research Council under grant EP/S036075/1. | Research Council under grant EP/S036075/1. | |||
Authors' Addresses | Authors' Addresses | |||
Niels ten Oever | Niels ten Oever | |||
University of Amsterdam | University of Amsterdam | |||
Email: mail@nielstenoever.net | Email: mail@nielstenoever.net | |||
Corinne Cath | Corinne Cath | |||
University of Cambridge | ||||
Email: corinnecath@gmail.com | Email: corinnecath@gmail.com | |||
Mirja Kühlewind | Mirja Kühlewind | |||
Ericsson | Ericsson | |||
Email: mirja.kuehlewind@ericsson.com | Email: mirja.kuehlewind@ericsson.com | |||
Colin Perkins | Colin Perkins | |||
University of Glasgow | University of Glasgow | |||
Email: csp@csperkins.org | Email: csp@csperkins.org | |||
End of changes. 29 change blocks. | ||||
78 lines changed or deleted | 48 lines changed or added | |||
This html diff was produced by rfcdiff 1.48. |