Cloudflare 计划为遵守站点规则的已验证机器人设置信任等级

该评估是内部进行的,计划提供公开的 Radar 分级和客户控制。Cloudflare 未披露其评分方法或独立验证;竞争对手已经在宣传更广泛的代理信任系统。

By · Published

Primary source: Cloudflare Blog

为何重要

机器人身份告诉网站是谁在发出请求;但它并不表明该机器人是否会随着时间遵守网站规则。Cloudflare 计划中的 trust bands 可能会将观测到的爬虫行为与客户的流量控制联系起来,但其方法和验证仍未公开。

Cloudflare begins tracking whether verified bots heed robots.txt and 429s — Research engineer intern Chris Tsoukaladelis authored the October 16th announcement; Cloudflare says public trust bands will follow after internal evaluation.

Cloudflare, the network-security company co-founded by Matthew Prince, 正在评估已验证机器人在表明身份后是否持续遵守网站规则。该公司计划将重复行为(包括遵守 robots.txt 和对 HTTP 429 速率限制消息的响应)转换为客户最终可用于管理流量的信任带。根据 Cloudflare 在其 October 16th announcement 中的说法,该系统目前为内部使用。…

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Reader comments

Conversation for this story loads after sign-in.