Hugging Face fixes TRL CISPO default that shrank gradients fivefold in its reproduction

Hugging Face's TRL v1.18.0 sets the CISPO default to 5.0 after an inherited 0.2 ceiling clipped on-policy weights near 1.

By · Published

A smiling yellow plush holds a glowing blue network-patterned sphere beside a broken metal chain; “Rw” appears on a shelf.

Hugging Face's TRL v1.18.0 sets the CISPO default to 5.0 after an inherited 0.2 ceiling clipped on-policy weights near 1.