Ao Qu and collaborators open-source Reef for learning from live agent interactions

The MIT researcher and a distributed contributor group built an Apache-2.0 stack that updates model weights and agent harnesses from live experience.

By · Published

Primary source: Hugging Face Newsroom

Why it matters

Reef turns inference logs into a versioned learning pipeline for both model weights and agent software. Its release controls evaluate candidate updates before publication and leave the serving version unchanged when a candidate is rejected.

Glowing data streams flow into an intricate, luminous structure, transforming into refined forms within a modern research environment.

MIT researcher Ao Qu and a distributed group of AI researchers open-sourced Reef on September 15th, putting agent learning directly inside the infrastructure that serves user requests.

Ao Qu on X

The project describes Reef as fully open source.…

Reader comments

Conversation for this story loads after sign-in.