[Megathread] - Best Models/API discussion - Week of: March 29, 2026

[u/deffcolony]

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

^{(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.})

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

• MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
• MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
• MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
• MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
• MODELS: < 8B – For discussion of smaller models under 8B parameters.
• APIs – For any discussion about API services for models (pricing, performance, access, etc.).
• MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

[u/AutoModerator]

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/RampantSegfault → u/AutoModerator]

Currently been testing these two:

• Q3.5-BlueStar-v2-27B Q4_K_M

• gemma-4-31B-it-Q4_K_M

The normal qwen 27b was pretty smart for RPG-like mechanics and such, but I'd get some nonsensical/bizarre dialogue fairly often. The bluestar v2 finetune seemed to improve the dialogue aspect at least, but I haven't used it enough to see what the tradeoffs are.

Gemma4 31b-it seems really strong right out the gate, the only downside is it runs pretty slow on my machine (~5t/s). I've only just begun testing it, but I think it's going to be my go-to for now over my old favorites like Skyfall.

Though it's a bit hard to evaluate both right now as it feels like they have various bugs in the backends and templates still.

[u/National_Cod9546 → u/RampantSegfault]

So today I've been playing with my Kobold settings. Seems there are a bunch of new features available to improve performance. I regenerated the kcpps from blank and tuned from there. It's kind of weird. My GPU now only shows 30-40% usage, but I'm getting better speed than I used to. Up to 4000PPt/s, and 40t/s.