Perplexity AI is using stealth, undeclared crawlers to evade website no-crawl directives ~tech internet Article 1214 words 35 votes
Trapping misbehaving bots in an AI Labyrinth ~tech Article 1142 words, published Mar 19 2025 40 votes