opt-125m-gqa-ub-6-best-for-KV-cache

Hugging Face model repository xformAI/opt-125m-gqa-ub-6-best-for-KV-cache, listed under the text-generation task. This listing describes a public repository, not an inference endpoint.

View on Hugging Face. Model discovered on Hugging Face; repository presence does not establish a release date or inference availability.