AI crawler directory: who crawls your site for AI, and how to control it
Who runs each AI crawler, what it is for and whether robots.txt controls it, taken only from the operators' own documentation. Unverified bots are listed separately.
Who runs each AI crawler, what it is for and whether robots.txt controls it, taken only from the operators' own documentation. Unverified bots are listed separately.