Thinking Machines shrinks Inkling to 26B parameters and puts it on a laptop
Inkling 2 Mini loops its middle layers three times per token, scores 20.1 on the AA Index by the lab's count, and runs on Macs with 32GB of RAM.
By Ryan Merket · Published

Inkling 2 Mini loops its middle layers three times per token, scores 20.1 on the AA Index by the lab's count, and runs on Macs with 32GB of RAM.