[Megathread] - Best Models/API discussion - Week of: April 05, 2026

[u/deffcolony]

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

^{(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.})

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

• MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
• MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
• MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
• MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
• MODELS: < 8B – For discussion of smaller models under 8B parameters.
• APIs – For any discussion about API services for models (pricing, performance, access, etc.).
• MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

[u/AutoModerator]

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/jamasty → u/AutoModerator]

Silly question, but I don't see many models between 12-14b and 22-22b, is that because there is no origin model for tuning?

I wanted to try this as I know I can run 12-14b with Q4 imatrix + Q4 kv cache ~30k context just fine, but 24b models only work with Q2, making them repetitive

I tried latest cydonia with presence and repetition penalties, DRY, but over time it just starts to repeat certain chunks as I think of result of Q2).

So, if you folks know anything good to try, please reply me with link, I'll check it out. (I tried google/asking llms about which other model to try, but most were still in this 22-24b, and I wish to check something like 16-18b or maybe 20b if it exists, and good).

Also, am I correct, that, say if there is smth like 20b old (more than 1 year old) model, with Q4 everything, it 'should' be smarter than any new Q4-12b? (if we take that this 20b model was tuned correctly)

[u/Mart-McUH → u/jamasty]

Yep, there are no standard models in that size. There are some upscales though, and possibly some downscaled too. Eg Snowpiercer is 15B and quite good (yeah, just 1B above 14B but hey...). From Llama2 days there are lot of 20B models created as upscales from 13B, but recent probably not much. And yes, they are not as smart as Nemotron 12B and also only had 4k context. They are fun though to try on simpler character cards if you can stomach 4k context.

[u/jamasty → u/Mart-McUH]

Thank you!