Mistral: Mixtral 8x22B (base)

Mixtral 8x22B is a large-scale language model from Mistral AI. It consists of 8 experts, each 22 billion parameters, with each token using 2 experts at a time. It was released via [X](https://twitter.com/MistralAI/status/1777869263778291896). #moe

• Context window: 65,536 tokens
• Input: text
• Output: text

View on OpenRouter. Model data sourced from OpenRouter.