GPTBot – OpenAI’s Web Crawler(platform.openai.com)
319 points by schappim | 267 comments
OpenAI documentation page describing GPTBot, its web crawler, including its user agent string and how site owners can identify or block it.
#web-crawler on Hacker News
1 story tagged web-crawler, newest first.