DwarfStar compresses frontier models to run them on local machines
DwarfStar's ds4 is an MIT-licensed C engine for selected models on high-memory Macs, CUDA and ROCm systems, built by Redis creator Salvatore Sanfilippo.
By Ryan Merket · Published

DwarfStar's ds4 is an MIT-licensed C engine for selected models on high-memory Macs, CUDA and ROCm systems, built by Redis creator Salvatore Sanfilippo.