| rfc9309v4.txt | rfc9309.txt | |||
|---|---|---|---|---|
| Internet Engineering Task Force (IETF) M. Koster, Ed. | Internet Engineering Task Force (IETF) M. Koster | |||
| Request for Comments: 9309 | Request for Comments: 9309 | |||
| Category: Standards Track G. Illyes, Ed. | Category: Standards Track G. Illyes | |||
| ISSN: 2070-1721 H. Zeller, Ed. | ISSN: 2070-1721 H. Zeller | |||
| L. Sassman, Ed. | L. Sassman | |||
| Google LLC | Google LLC | |||
| September 2022 | September 2022 | |||
| Robots Exclusion Protocol | Robots Exclusion Protocol | |||
| Abstract | Abstract | |||
| This document specifies and extends the "Robots Exclusion Protocol" | This document specifies and extends the "Robots Exclusion Protocol" | |||
| method originally defined by Martijn Koster in 1994 for service | method originally defined by Martijn Koster in 1994 for service | |||
| owners to control how content served by their services may be | owners to control how content served by their services may be | |||
| skipping to change at line 573 ¶ | skipping to change at line 573 ¶ | |||
| [ROBOTSTXT] | [ROBOTSTXT] | |||
| "The Web Robots Pages (including /robots.txt)", 2007, | "The Web Robots Pages (including /robots.txt)", 2007, | |||
| <https://www.robotstxt.org/>. | <https://www.robotstxt.org/>. | |||
| [SITEMAPS] "What are Sitemaps? (Sitemap protocol)", April 2020, | [SITEMAPS] "What are Sitemaps? (Sitemap protocol)", April 2020, | |||
| <https://www.sitemaps.org/index.html>. | <https://www.sitemaps.org/index.html>. | |||
| Authors' Addresses | Authors' Addresses | |||
| Martijn Koster (editor) | Martijn Koster | |||
| Stalworthy Manor Farm | ||||
| Suton Lane | Suton Lane | |||
| Wymondham, Norfolk | Wymondham, Norfolk | |||
| NR18 9JG | NR18 9JG | |||
| United Kingdom | United Kingdom | |||
| Email: m.koster@greenhills.co.uk | Email: m.koster@greenhills.co.uk | |||
| Gary Illyes (editor) | Gary Illyes | |||
| Google LLC | Google LLC | |||
| Brandschenkestrasse 110 | Brandschenkestrasse 110 | |||
| CH-8002 Zürich | CH-8002 Zürich | |||
| Switzerland | Switzerland | |||
| Email: garyillyes@google.com | Email: garyillyes@google.com | |||
| Henner Zeller (editor) | Henner Zeller | |||
| Google LLC | Google LLC | |||
| 1600 Amphitheatre Pkwy | 1600 Amphitheatre Pkwy | |||
| Mountain View, CA 94043 | Mountain View, CA 94043 | |||
| United States of America | United States of America | |||
| Email: henner@google.com | Email: henner@google.com | |||
| Lizzi Sassman (editor) | Lizzi Sassman | |||
| Google LLC | Google LLC | |||
| Brandschenkestrasse 110 | Brandschenkestrasse 110 | |||
| CH-8002 Zürich | CH-8002 Zürich | |||
| Switzerland | Switzerland | |||
| Email: lizzi@google.com | Email: lizzi@google.com | |||
| End of changes. 6 change blocks. | ||||
| 8 lines changed or deleted | 9 lines changed or added | |||
This html diff was produced by rfcdiff 1.48. | ||||