vLLM fixes Mamba cache bug that turned an 832-token hit into the wrong passcode

A mid-block resume could publish a partial SSM state under a full-block hash. The patch cuts the reproducer's hit from 832 tokens to 16 and restores "pillow."

By · Published

An open metal combination padlock spills loose asterisk-marked wheels onto a table beside three asterisk keys and one dash key.

A mid-block resume could publish a partial SSM state under a full-block hash. The patch cuts the reproducer's hit from 832 tokens to 16 and restores "pillow."