Thursday, November 5, 2026 Today’s Paper
Log in Join free
Vol. I · No. 37 Texas Edition
Thursday, Nov 5
Xultr
Texas first. Then the world.
Always free Updated 4 minutes ago
Read. React. Discuss.
Tech

How to actually block AI bots from scraping your website

TechRadar By Benedict Collins 5 min read 1 views 0 comments
How to actually block AI bots from scraping your website
Image: TechRadar

OpenAI will now honor AI scraping rules contained within the robots.txt file

TechRadar Original story · www.techradar.com
Read the full story
How does this story make you feel?
👍 ❤️ 💡 😮 😂 😢 😠

Discussion (0)

No comments yet. Start the conversation!

More to read