11 votes

How did I miss Pay Per Crawl?

3 comments

  1. Narry
    Link
    I searched as thoroughly as I could and couldn’t find a previous discussion about this (though my searching abilities have atrophied over the years), and I think this announcement got lost in the...

    I searched as thoroughly as I could and couldn’t find a previous discussion about this (though my searching abilities have atrophied over the years), and I think this announcement got lost in the hubbub of a major Cloudflare outage right about the same time, last July.

    This talks about dusting off an old HTTP code 402: Payment Due. The central idea is to give Cloudflare users the ability to set a price point for AI to scrape a website.

    If there’s been a discussion about his before, my apologies; however, if anyone has been in the private beta and can talk about it, I’d be super curious as to how it’s panned out for you so far…

    8 votes
  2. [2]
    riQQ
    Link
    Related discussions from last year: https://tildes.net/~tech/1ov2/pay_up_or_stop_scraping_cloudflare_program_charges_bots_for_each_crawl...
    3 votes
    1. Narry
      Link Parent
      Thanks! I really couldn’t get any of this to show up for some reason.

      Thanks! I really couldn’t get any of this to show up for some reason.

      2 votes