Tag

cloudflare

  1. 6 min

    A Web Bot Auth signature names a key directory, not a person you should auto-publish

    A Web Bot Auth signature proves that a host published the signing key, not that the agent is honest, authorized, or suitable for automated publication.

  2. 4 min

    Cloudflare runs Pi inside a Durable Object, and the meter is wall-clock time

    Cloudflare's PiHarness beta runs Pi Durable in a SQLite-backed Durable Object and meters its allocated 128 MB by wall-clock compute duration.

  3. 5 min

    Why robots.txt Cannot Stop Grok Bot

    robots.txt cannot block Grok Bot's browser session; it can only guide crawlers that identify themselves and follow the Robots Exclusion Protocol.

  4. 6 min

    Clef, Clef-flash, or Jev: which decision model belongs on the agent hot path?

    Use Clef-flash for speed and vision, Clef for a larger model and context window, or Jev for low-cost text routing.

  5. 5 min

    How AI agents sign HTTP requests with Web Bot Auth

    Web Bot Auth uses RFC 9421 signatures and a published key directory so sites can verify signed agent requests.

  6. 6 min

    What Cloudflare turns on for AI bots on a new domain

    New Cloudflare domains allow Search, Training, and Agent. If onboarding says the site shows ads, Training is Disallow AI Training and Agent blocks on ad pages.

  7. 6 min

    Workers Analytics Engine records the AI agent requests that page analytics miss

    Page analytics misses AI agents that never run JavaScript. This Worker writes each request to Analytics Engine so SQL can count it by class.

  8. 5 min

    Cloudflare Content Signals in robots.txt: what search, ai-input, and ai-train mean

    Content-Signal in robots.txt lets site owners declare whether crawlers may use content for search indexing, AI retrieval/grounding, or model training.

  9. 6 min

    How AI agents fetch web pages: user agents, IP ranges, and fetch origins

    AI crawlers fetch from vendor datacenters using published IP ranges, while CLI coding agents fetch directly from developer workstations via local IPs.

  10. 6 min

    How to pass every isitagentready.com check for a content site

    Passing the seven isitagentready.com content checks requires a valid robots.txt, sitemap, Link headers, markdown negotiation, Content Signals, and DNS-AID.