FreeToken reports 22-25 tok/s for a 284B DeepSeek model on one RTX 5090

Shuo Yang, Xiaoze Fan and collaborators report the decode rate using CPU compute, a 32 GB RTX 5090 and 192 GiB of system memory.

By · Published

Thermal scan of an NVIDIA RTX 5090 GPU and RAM modules showing active MoE inference and data flow.

Shuo Yang, Xiaoze Fan and collaborators report the decode rate using CPU compute, a 32 GB RTX 5090 and 192 GiB of system memory.