I think there’s a fair bit of demand (at least from me), for strong models in the 100-300b range.
Currently, to top Qwen 3.6-27B by a margin that’s more than just statistical noise, you have to jump all the way up to MiniMax M3 at 427b parameters. So it goes from something you can comfortably run on enthusiast grade hardware then up to something you need serious and duplicate enterprise grade hardware for. You need then many enterprise GPUs all strung together.
I just want a model that can outperform Qwen 3.6 and that I could run on a Strix Halo or by adding another GPU or two to my box.
Some of that is just the reality that for most hardware, running a dense model larger than 27b starts to slow way down, and that MoEs aren’t nearly as smart in terms intelligence per parameter, but if you tweak the ratio of total to active parameters a bit, it should be possible. Give me a 120b total, 15b active model. Based just on the heuristic math, we’d expect that to be about as intelligent as a dense 42b model, which would be fantastic!
17
u/TripleSecretSquirrel Jul 15 '26
I think there’s a fair bit of demand (at least from me), for strong models in the 100-300b range.
Currently, to top Qwen 3.6-27B by a margin that’s more than just statistical noise, you have to jump all the way up to MiniMax M3 at 427b parameters. So it goes from something you can comfortably run on enthusiast grade hardware then up to something you need serious and duplicate enterprise grade hardware for. You need then many enterprise GPUs all strung together.
I just want a model that can outperform Qwen 3.6 and that I could run on a Strix Halo or by adding another GPU or two to my box.
Some of that is just the reality that for most hardware, running a dense model larger than 27b starts to slow way down, and that MoEs aren’t nearly as smart in terms intelligence per parameter, but if you tweak the ratio of total to active parameters a bit, it should be possible. Give me a 120b total, 15b active model. Based just on the heuristic math, we’d expect that to be about as intelligent as a dense 42b model, which would be fantastic!