FreeToken reports 22-25 tok/s for a 284B DeepSeek model on one RTX 5090
Shuo Yang, Xiaoze Fan and collaborators report the decode rate using CPU compute, a 32 GB RTX 5090 and 192 GiB of system memory.
By RuntimeWire Staff · Published

Shuo Yang, Xiaoze Fan and collaborators report the decode rate using CPU compute, a 32 GB RTX 5090 and 192 GiB of system memory.