Sunday, November 8, 2026 Today’s Paper
Log in Join free
Vol. I · No. 41 Texas Edition
Sunday, Nov 8
Texas first. Then the world.
Always free Updated 2 minutes ago
Read. React. Discuss.
Tech

Ask HN: Non-Malicious Bots

By andai 1 min read 1 views 0 comments

When I ask an AI to load a link, sometimes it can load it, and sometimes it can't (and I have to copy paste the text myself).Sometimes it can load it even when it has the "checking if you're a malicious bot". I'm wondering how that works. Isn't AI scraper traffic literally the thing that page is designed to stop?Do they let Google, OpenAI etc. user agents through? Or do those companies just have a bunch of guys in a warehouse somewhere with Chrome open, forwarding the AI's HTTP requests?

Comments URL: https://news.ycombinator.com/item?id=50403901

Points: 1

# Comments: 0

Hacker News (Newest) Original story · news.ycombinator.com
Read the full story

Discussion (0)

No comments yet. Start the conversation!