vLLM fixes Mamba cache bug that turned an 832-token hit into the wrong passcode
A mid-block resume could publish a partial SSM state under a full-block hash. The patch cuts the reproducer's hit from 832 tokens to 16 and restores "pillow."
By RuntimeWire Staff · Published

A mid-block resume could publish a partial SSM state under a full-block hash. The patch cuts the reproducer's hit from 832 tokens to 16 and restores "pillow."