Ao Qu and collaborators open-source Reef for learning from live agent interactions
The MIT researcher and a distributed contributor group built an Apache-2.0 stack that updates model weights and agent harnesses from live experience.
By Ryan Merket · Published
Primary source: Hugging Face Newsroom
Why it matters
Reef turns inference logs into a versioned learning pipeline for both model weights and agent software. Its release controls evaluate candidate updates before publication and leave the serving version unchanged when a candidate is rejected.

MIT researcher Ao Qu and a distributed group of AI researchers open-sourced Reef on September 15th, putting agent learning directly inside the infrastructure that serves user requests.
The project describes Reef as fully open source.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.