Perplexity AI is using stealth, undeclared crawlers to evade website no-crawl directives

ShroudedScribe
2025-08-05T01:09:21Z

Link URL: https://blog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/

Comments URL: https://tildes.net/~tech/1pgq/perplexity_ai_is_using_stealth_undeclared_crawlers_to_evade_website_no_crawl_directives

Votes: 35

Comments: 19