Cloudflare plans trust bands for verified bots that follow site rules

The evaluation is internal, with public Radar bands and customer controls planned. Cloudflare has not disclosed its scoring method or independent validation; competitors are already marketing broader agent-trust systems.

By · Published

Primary source: Cloudflare Blog

Why it matters

Bot identity tells a site who is making a request; it does not show whether that bot respects site rules over time. Cloudflare's planned trust bands could connect observed crawler behavior to customer traffic controls, but the method and validation remain unpublished.

Cloudflare begins tracking whether verified bots heed robots.txt and 429s — Research engineer intern Chris Tsoukaladelis authored the October 16th announcement; Cloudflare says public trust bands will follow after internal evaluation.

Cloudflare, the network-security company co-founded by Matthew Prince, is evaluating whether verified bots continue to follow websites' rules after identifying themselves. The company plans to turn repeated behavior, including compliance with robots.txt and responses to HTTP 429 rate-limit messages, into trust bands that customers could eventually use to manage traffic.…

Reader comments

Conversation for this story loads after sign-in.