NVIDIA's opt-in MXFP8 kernel hits 2.5x in a Kimi K3 microbenchmark on one VR200
The TensorRT-LLM change is off by default and targets replicated shared experts on SM107.
By RuntimeWire Staff · Published

The TensorRT-LLM change is off by default and targets replicated shared experts on SM107.