Robots.txt for the agentic web. The open standard that lets websites define how AI agents can access and interact with their content.
-
Updated
May 30, 2026 - Python
Robots.txt for the agentic web. The open standard that lets websites define how AI agents can access and interact with their content.
To associate your repository with the apop topic, visit your repo's landing page and select "manage topics."