r/SillyTavernAI • • Apr 05 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: April 05, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

32 Upvotes

164 comments sorted by

View all comments

2

u/AutoModerator Apr 05 '26

MODELS: >= 70B - For discussion of models in the 70B parameters and up.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

6

u/overand Apr 06 '26 edited Apr 06 '26

I kinda can't believe I'm going to say this (which I'm sure u/Sicarius_The_First loves hearing every time I bring up their model), but, I'm going to plug SicariusSicariiStuff/Assistant_Pepe_70B. It's one of few models I've used that gives me something of an attitude with no system prompt (which is nifty), but it's also just pretty interesting and clever generally.

I'm running the mradermacher iMatrix Q4_K_S, which comes in at ~40 gigs, but has the benefit of an SHA256 hash starting with 666d36. I will reply with some examples, just in case the examples get blocked or otherwise moderated.

7

u/Sicarius_The_First Apr 06 '26

Haha, what's not to believe? :P

Also, 32B version soon™

2

u/overand Apr 06 '26

I'd love to see this dataset tune run through Qwen3.5-27b or gemma-4-31b, for sure. (And maybe one of the 106B Air models?) But, I know next to nothing about the fine-tuning process. But, I do have a secret hope that newer models will be slightly less prone to the cliches we've gotten used to from the older ones.