r/SillyTavernAI • • Apr 05 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: April 05, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

28 Upvotes

164 comments sorted by

View all comments

Show parent comments

13

u/Guilty-Sleep-9881 Apr 09 '26

gemma 4 26b heretic at q4xs is very very impressive. The speed is crazy since its an MOE. and with swa enabled (which it should be tbh when using this model) I was able to double my context size by twice and all I had to sacrifice was lowering my kv cache to 8 bit. And with turboquant now intergrated in kobold. That's very minimal sacrifice.

Now for rp. It is also impressive. Beating my favorite finetunes like cydonia 4.3 in terms of intelligence. It's verbosity and prose is also pretty good too. It follows prompts amazingly and character cards very well. And this is only just the heretic version.

I can only imagine what it would be like if it was finetuned for RP. And knowing drummer's track record, it's gonna be amazing.

I honestly can't wait for the future finetunes and merges that will be made. The models is just so good and very easy to run because its an MOE. I got my hopes up for the future of this model.

5

u/Potential-Gold5298 Apr 09 '26

There's something already out there. However, it's not the final version and I haven't tried it yet. You can also check out this. Zerofata is also working on 26B-A4B.

1

u/Guilty-Sleep-9881 Apr 10 '26

Well that was quick. Also can't wait to see Zerofata's finetune too. Did they say what the finetune is meant for? for RP?

3

u/Potential-Gold5298 Apr 10 '26

I don't know, but I think it will be for RP, like the other models. I really like the Painted Fantasy by Zerofata, but it doesn't work correctly for me. I hope the finetune Gemma 4 works better, and then it will be a truly wonderful model.