vLLM lets compressed-tensors block-FP8 weights survive an engine restart
The merged change lets a restarted engine map processed CUTLASS block-FP8 weights through CUDA IPC, with exact greedy output checked on a B300.
By RuntimeWire Staff · Published

The merged change lets a restarted engine map processed CUTLASS block-FP8 weights through CUDA IPC, with exact greedy output checked on a B300.