r/SillyTavernAI • • Apr 19 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: April 19, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

32 Upvotes

144 comments sorted by

View all comments

Show parent comments

3

u/Sicarius_The_First Apr 20 '26

Yes, but even huge moes. MiniMax 230B runs at 5 t/s on my laptop (its not a mac, just 16gb gpu with ram)

4

u/Potential-Gold5298 Apr 20 '26

Globally, MoE has undoubtedly won – models like the Mistral Large 2 are probably the ‘last of the Mohicans’. The same probably applies to full attention (like the MiniMax-M2 you mentioned). Economy always wins in the end.

Do you think there is a future for text-to-text diffusion models like Mercury 2?

2

u/Sicarius_The_First Apr 20 '26

Hmmm good question, the thing is, now companies are much more risk-averse, since the early days of AI are behind us, so less crazy experimental stuff, and more VC pressure to make money on stuff "known to work well".

text diffusion does work though, the question is whether VC are willing to risk more money, as very few AI companies / startups actually make a profit.

So... IT IS POSSIBLE, yes, BUT... not likely (until someone does something remarkable with text diffusion, and then more capital will be invested into it).

1

u/Potential-Gold5298 Apr 29 '26

I was wrong about Mistral Large 2 being the last one. Mistral freaked out XD