DwarfStar compresses frontier models to run them on local machines

DwarfStar's ds4 is an MIT-licensed C engine for selected models on high-memory Macs, CUDA and ROCm systems, built by Redis creator Salvatore Sanfilippo.

By · Published

A laptop and compact desktop computer sit side by side on a desk, illustrating DwarfStar’s ds4 effort to run selected models locally.

DwarfStar's ds4 is an MIT-licensed C engine for selected models on high-memory Macs, CUDA and ROCm systems, built by Redis creator Salvatore Sanfilippo.