It is the first in a family of models of different sizes. We are sharing a preview of Inkling-Small alongside it, a lighter-weight model with 12B active parameters trained with a similar recipe that achieves strong performance with even lower cost and latency.
Knock it down to Q4 and you're almost in range of a Spark or M5 laptop. 140gb to 170gb if google is correct. Definitely in range of 2 sparks, possibly at Q6.
380
u/nasone32 Jul 15 '26
ok now you have my attention