Ai2 opens MoE training stack after testing a 1.2T-parameter setup
Ai2 says its system can train larger sparse models with less overhead. Its trillion-parameter result measures system performance, not a completed model.
By RuntimeWire Staff · Published

Ai2 says its system can train larger sparse models with less overhead. Its trillion-parameter result measures system performance, not a completed model.