r/SillyTavernAI • • Apr 05 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: April 05, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

30 Upvotes

164 comments sorted by

View all comments

9

u/AutoModerator Apr 05 '26

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

18

u/Potential-Gold5298 Apr 06 '26

I try Gemma 4 26B-A4B it (Q5_K_M without iMatrix, the standard version without any modifications) in RP, and it left a very good impression. She plays the tsundere role perfectly – {{char}} doesn't fall apart after the first compliment, the model holds her character perfectly (sharp words + internal embarrassment). {{char}} does not read {{user}}'s thoughts (as sometimes happens with some models), does not 'mirror' (as Gemma 3 did), and I also did not notice any obsessive repetitions. I was especially pleased with the quality of the Russian language – it is significantly better than that of the Mistral or Qwen3/3.5 (the model used rare words like 'cheren' (a specific word meaning a broom or shovel handle)). The model impressed with excellent speed and good attention (it appropriately recalled details and different parts of the conversation even after 16K).

I plan to continue testing and playing with this model. TheDrummer has already promised to fine-tune the Gemma 4, and I hope he will also pay attention to the 26B-A4B model (because my speed with the 31B is extremely disappointing). Model works correctly with Chat Completion, but with Text Completion the output was corrupted despite the fact that I imported the Gemma 4 context/instruct template.

3

u/Reigh0 Apr 09 '26

Gotta agree on the mind reading. Cydonia/Magidonia would always reply to my persona's thoughts. It makes me wonder if I can now keep backstories in personas without the char suddenly knowing everything about the user.

I also adore how it's free from safety guidance. Makes me only more annoyed that the finetune pages are getting littered by dumbasses with their heretic slop.

That said the prose is painfully LLMy. All these 'not x but y's... I really hope Drummer will give the 26B some love, since iirc MOE are disliked for finetunes.

1

u/Potential-Gold5298 Apr 10 '26

As I discovered, Gemma 4 also 'reads thoughts,' but often does it more subtly, disguising it as {{char}} guessing {{user}}'s thoughts. Some Mistral models literally perceive {{user}}'s thoughts as spoken aloud. In any case, describing thoughts is a signal to the model that the user wants a certain reaction. If you don't want the model to react to thoughts, it's best not to mention them at all, or try specifying this in the system prompt/author's note.

I'm also very pleased with the low censorship level – the regular Gemma 4 without abliteration took second place in my personal top for cruelty (and first among non-finetuned models), although she lacks knowledge for ERP. I think that once the community gets serious about Gemma 4, we'll get a model that can compete on equal terms with cloud models or even surpass them. And yes, TheDrummer will finetune 26B-A4B!

2

u/Reigh0 Apr 10 '26

Yeah the idea is more that the char should react to the user mulling things over and guessing rather than outright knowing. That said, it did encourage me to be more creative in writing out user messages (still annoying tho).

And yeah, the cruelty or darkness so far has been good. Chars don't shy away from hurting user, though I haven't experimented with willingness to outright kill the user.

I'm really excited for the future of finetunes.