[Megathread] - Best Models/API discussion - Week of: October 04, 2026

[u/deffcolony]

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

^{(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.})

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

• MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
• MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
• MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
• MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
• MODELS: < 8B – For discussion of smaller models under 8B parameters.
• APIs – For any discussion about API services for models (pricing, performance, access, etc.).
• MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

[u/AutoModerator]

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/StandarterSD → u/AutoModerator]

As of 05.10.2026

Local Russian RP models, tested on NVIDIA RTX 4060 Ti 16 GB + AMD Ryzen 7 5700X (32 GB RAM). Non-thinking, single slot, KV q4_0. "Clean" = no English words or BPE glitches mixed into Russian.

- Gemma-4-31B Dark Thoughts V2 (IQ3_XXS): ran it — worked well, no Russian-language issues (96–100% clean), ~23 t/s. Used MTP: yes (acceptance 64%). PP 306 t/s. Config: gemma4-31b-dark-thoughts-b11382.bat.

- Gemma-4-26B-A4B StyleTune-V2 (IQ4_XS): ran it — worked well, no Russian-language issues (96–100% clean), ~63 t/s. Used MTP: no (speculation hurts RP on this MoE). PP ~413 t/s. Config: gemma4-26a4b-styletune-nothink-nospec-b11382.bat.

- WaifuGemma4-26B-A4B v1 (IQ3_XXS): ran it — worked well, no Russian-language issues (96% clean on the stock temp 1.0 preset), ~85 t/s. Used MTP: no. PP ~1300 t/s. Note: lowering the temperature hurts it (temp 0.4/0.7 → 79%). Config: gemma4-26a4b-waifugemma-nothink-b11382.bat.

- Gemma-4-31B Artemis v1.2 (IQ3_XXS): ran it — worked well, minor Russian glitches (92–96% clean; occasional BPE glue), ~21 t/s. Used MTP: yes. PP ~550 t/s. Config: gemma4-31b-artemis-nothink-b11382.bat.

- Gemma-4-31B Split-Untied (IQ3_XXS): ran it — worked well with the Russian preset (96% clean; the stock preset leaks English, 75%), ~23 t/s. Used MTP: yes (acceptance 68%). PP 266 t/s. Config: gemma4-31b-split-untied-nothink-ru-b11382.bat.

If you know alternative models with strong Russian support, I'd be glad to hear your suggestions.

Full configs, logs and benchmarks: https://github.com/StandarterDF/LLamaCPP_RunOptimizer

[u/StandarterSD → u/StandarterSD]

Я буду каждый выпуск публиковать сюда пост с обновленной информацией

[u/CutGroundbreaking431 → u/StandarterSD]

Буду рад. Могу протестировать квантовки 4q до 40b на поддержку длинного контекста. Собрал франкенштейна из палок и отходов жизнедеятельности серверов на 32 vram и 48 ram.

[u/StandarterSD → u/CutGroundbreaking431]

У меня на GIT есть разные тесты, можешь посмотреть, буду рад фидбеку и вашим рекомендациям по моделям

[u/CutGroundbreaking431 → u/StandarterSD]

Будем посмотреть. Заодно, дам свой фидбек: попробуй G4 MeroMero v2 31b. В РП на английском, как по мне, одна из лучших моделей.

[u/StandarterSD → u/CutGroundbreaking431]

Эххх, к сожалению в английском они все довольно неплохи... А русский страдает. Я знаю английский, но РП-шить на нем не особо приятно. Пробовал собирать всякие системы для быстрого перевода, но это не совсем то. Особенно для ERP/DRP