Nanbeige launches 3B Looped Transformer model, saying it boosts capacity without extra parameters

The open‑source model Nanbeige4.2‑3B adds a Looped Transformer layer that the team says improves agent performance while keeping the parameter count at three billion.

By · Published

Primary source: X

Why it matters

If Nanbeige’s Looped Transformer delivers deeper reasoning without additional parameters, it could reshape how developers balance model size and performance, opening a path to more capable low‑footprint agents.

Illustration of Nanbeige4.2-3B depicted as a Looped Transformer layer looping around a 3B marker to suggest added capacity without more parameters.

On July 22nd, 2026, the X account of Nanbeige announced the release of Nanbeige4.2‑3B, a three‑billion‑parameter language model that incorporates a new Looped Transformer architecture. The post, which included a link to the model’s Hugging Face repository, states that the Looped Transformer “increases model capacity without adding parameters, delivering a capable 3B agent.”…

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Reader comments

Conversation for this story loads after sign-in.