AMD releases Instella-MoE to showcase end-to-end training on Instinct GPUs
The 16B-parameter model activates 2.8B parameters per token and ships with six checkpoints, training recipes and code.
By Ryan Merket · Published
Primary source: X
Why it matters
Instella-MoE gives AI teams a reproducible test of AMD's stack for sparse-model training and RL, though its research-only weight license limits commercial use.
AMD researchers led by Jiang Liu and Prakamya Mishra (@PrakamyaMishra) released Instella-MoE on July 24th, giving developers the weights and training artifacts for a mixture-of-experts language model built from scratch on AMD Instinct GPUs. Mishra described the release in a thread on X on Monday as AMD's first fully open MoE model.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.