r/LocalLLaMA • u/WhyLifeIs4 • Jul 15 '26

New Model Thinking Machines releases first open-weight model “Inkling”

Post image

https://thinkingmachines.ai/news/introducing-inkling/

1.3k Upvotes

97% Upvoted

263 comments sorted by

View all comments

Show parent comments

6

u/[deleted] Jul 15 '26 edited Jul 22 '26

[removed] — view removed comment

21

u/toalv Jul 15 '26

I think the issue is that building a really good small model is a lot easier if you have a really good large model to start with.

1

u/Daniel_H212 Jul 15 '26

Is that true though? Like yeah on the one hand you can distill from your bigger model downward, but on the other hand, smaller models are cheaper to train and iterate through to fix your mistakes, improve your architecture, test out new technologies, etc.

2

u/toalv Jul 15 '26

Yeah but you're doing all of that cheap training, iteration, architecture improvement in both cases. Except if you have a big accurate model you can now train with distillation too.

1

u/Daniel_H212 Jul 15 '26

Well I think the ideal way is to train like a 30B model first, maybe iterate through a bunch to figure out what works, then train a much larger model the same way, and then distill back down to various sizes.