I’m using Cloudflare for one of my sites and recently noticed the AI Audit tool, which claims to:
“Analyze and control how AI crawlers scan your site.”
Has anyone here used it? If so, what insights did it provide about your site, and was it helpful?
The tool provides a report on which AI or large language model (LLM) tools are scraping your site. The reports aren’t frequent or very detailed, so don’t expect much.
It also lets you block some AI crawlers from scraping your site, which is the ‘control’ aspect. The idea is that you could negotiate with these companies to ‘sell’ your data to them, but unless your site is massive, that’s unlikely to happen.
Other than that, it’s not super helpful for most users. Stick to standard SEO practices and make sure your site is optimized for Bing, as that’s where ChatGPT gets its data from.