llama.cpp adds a typed-decision API for five specialized open models

Xuan-Son Nguyen's change brings yes-or-no, classification and scoring outputs to llama-server, with development builds available ahead of an expected v0.6.0 release.

By · Published · Updated

llama.cpp adds a typed-decision API for five specialized open models — Xuan-Son Nguyen's change brings yes-or-no, classification and scoring outputs to llama-server, with development builds available ahead of an expected v0.6.0 release.

Xuan-Son Nguyen's change brings yes-or-no, classification and scoring outputs to llama-server, with development builds available ahead of an expected v0.6.0 release.