Google’s Mueller Says AI Crawlers Access Sitemaps & RSS In His Logs via @sejournal, @MattGSouthern

Search Engine Journal By Matt G. Southern Oct 5, 2026 · 5:47 PM 1 views 0 comments

Google’s Mueller Says AI Crawlers Access Sitemaps & RSS In His Logs via @sejournal, @MattGSouthern — Image: Search Engine Journal

Google's John Mueller says AI training crawlers usually don't offer sitemap submission and suggests default sitemap names or RSS feeds to help them find sites.

The post Google’s Mueller Says AI Crawlers Access Sitemaps & RSS In His Logs appeared first on Search Engine Journal.

Search Engine Journal Original story · www.searchenginejournal.com

Read the full story

How does this story make you feel?

👍 ❤️ 💡 😮 😂 😢 😠

Discussion (0)

No comments yet. Start the conversation!

Discussion (0)

More to read

Google AI Pilot Pays Some Sites Under 0.1% Of Ad Revenue via @sejournal, @MattGSouthern

Google Tells Sites To Fact-Check AI Content Before Publishing via @sejournal, @MattGSouthern

Apple Tightens macOS 'Full Disk Access' Controls As AI Agents 'Substantially' Increase Risk