BOSS Zhipin releases 3B agent model with a reused transformer stack

The Apache-2.0 model uses a two-pass Looped Transformer and was trained on 28 trillion tokens for coding, office and tool workflows.

By · Published

Primary source: X

Why it matters

BOSS Zhipin is using recruiting revenue and internal workflow experience to compete in general agent models. If Nanbeige's results hold outside its own tests, startups could run useful coding and office agents with a far smaller memory footprint.

BOSS Zhipin releases 3B agent model with a reused transformer stack — The Apache-2.0 model uses a two-pass Looped Transformer and was trained on 28 trillion tokens for coding, office and tool workflows.

Nanbeige LLM Lab, the AI research group inside Chinese recruiting platform BOSS Zhipin, released a compact agent model on July 24th that uses the same transformer layers twice to increase its effective depth without adding parameters.…

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Reader comments

Conversation for this story loads after sign-in.