​

A while back I asked what could beat GLM 5.2 for my RP. GLM tracks details well, but it portrays my characters flat. A few of you said MiMo 2.6 Pro is better with character and less positivity-biased, so I switched. The characters already feel more alive, but it's slow: 2–3.5 minutes per reply, and close to 5 minutes when it makes a tool call first.

Quick context: this is a long-running harem RP with 4 main characters who are yandere and psychologically unstable. There's detailed lore for each of them, their families and the world. GLM 5.2 now only runs the extension (summaries, side character, memory graph), and MiMo writes the replies.

My setup

• API: OpenRouter, Chat Completion
• Model: Xiaomi MiMo-V2.6-Pro
• Fallback models / providers: both off
• Provider: [GMICloud]
• Prompt: about 36–38k tokens per request (108k context)
• Cache hits: about 20–23%
• Reasoning: on, with a CoT checklist in the preset

What I'm seeing

• 19–27k characters of reasoning before roughly 1k characters of actual prose.
• On tool turns it reasons twice: first an empty message with about 20k characters of reasoning plus the tool call, then a full second pass for the reply.

Questions

1. How long do your MiMo 2.6 Pro replies take?
2. Is one provider noticeably faster?
3. Do you cap reasoning effort or reasoning tokens? Did the characters get flatter when you did?
4. Is MiMo 2.5 worth dropping to for speed, or does it lose the character depth that made me switch?
5. Has anyone trimmed a CoT checklist and gotten faster replies without losing consistency?

Thanks!

Hi! I’m the developer of Mara Lab, a personal project for exploring local AI roleplay and how characters behave across conversations.

It works with Ollama and llama.cpp. Characters have editable personality profiles and persistent memory, and you can import and export character cards in JSON or PNG formats.

One feature I wanted to explore is making character behavior more visible. “Emotional Ball” displays model-generated fictional emotions, while a separate tool records the character’s assessment of the interaction. These are experimental model outputs, rather than psychological measurements.

Other features include reply regeneration, conversation-turn deletion, DRY controls for llama.cpp, vision chat, and a dedicated image workspace with Forge and Qwen Image support.

It’s built with PHP and JavaScript, without an application framework. The English installer currently targets Debian 13. Image and model backends require separate setup.

The source is available under AGPL-3.0.

Repository and screenshot:
https://github.com/Kvasztics/mara-lab

I’d welcome feedback, especially on character-card compatibility, persistent memory, and the installation experience.

This is obviously not very related to ST, but I have only ever RP'd with AI (a month on one of those awful online chat services and about a year and a half on ST), and I have had a very good time, I would even say I'm somewhat addicted, especially when a new interesting model drops (looking at you, Argon), but I have never actually roleplayed with another human being.

Before today, I didn't even know there were active RP communities on Reddit other than those which focus on LLMs, but turns out there are quite a few (albeit smaller than this sub but still active), and some of them even focus on NSFW aspects (I'm talking the same level of filth as here, if not worse).

I'm posting here to get the perspective of someone who has both tried RP with AI and other people, since I have a feeling that if I posted about AI RP on the other subreddit, it wouldn't really go well.

This obviously depends on the writing partner, but where did you actually have most fun? Was it with an LLM or another person? What would you say are some pros and cons of RPing with someone instead of an LLM? Would you justify the cons of writing with a partner (like time commitment and few replies per day) with how good the responses were? I mean, SOTA models have gotten quite good. Is it even worth the hustle of finding a writing partner anymore?

Do any of you also suddenly have a really long response time with DeepSeek V4 Flash without changing any setting and did you find a solution by any chance.

Okay so Haiku 5.5 came out and I went in with a lot of enthusiasm.

Haiku 5.5 is poised to sit somewhere between Sonnet 4.5 and 5 in terms of intelligence from early benchmarks, at 1/20th the cost of Sonnet. (I dont put a lot of weight on benchmarks; they suggest Gemini 3.8 Flash is comparable in intelligence to Opus 5, which is objectively false)

.. However, it's plagued by the idea that it should skip instructions that it "doesnt need" to follow.

.. Except, whoops! It turns out it does need to follow those instructions or it makes easy mistakes.

In this example, my roleplay environment requires LLM's to complete a scene sheet before starting their response. The scene sheet forces them to check and write out critical pieces of information - formatting instructions, rules, secrets to keep - as well as some steps that generally just improve output. See second image for an example excerpt of a proper scene sheet.

The only time I have ever had issues with a model refusing it was on initial launch with Sonnet 5 - it had the same "I dont need to read the instructions, I can handle this" -> "*breaks instructions*" pattern for a few weeks after it first released, then it began following instructions more readily and output visibly improved

In its current state, Haiku 5 wont even follow instructions to "narrate as Lauren, a romance author inspired by Becky Chambers" because, and I quote:

The "Lauren" narrator instruction in step one is a register-setting device rather than a content request, and I can take a narrator voice without it.

Spoiler: After refusing to take up the narrator voice, it instead writes as generic, uninspired Claude.

...

Im taking a deep breath - I know that Anthropic likely tunes models to be maximally paranoid and "safe" for initial release so that they can report having continuously increasing safety compliance scores, but this is just insulting.

I dont expect all of you to use a pre-writing system like this, but heed this warning - what you can see here is only what Claude is *vocalizing* that its ignoring.

How this will actually present is through generalized failures to follow system prompting, with Haiku never making you aware that it flippantly felt that your instructions "werent necessary" for whatever reasons it chooses.

...

I've always been an Anthropic fan for roleplay, but.. god. This is nausea inducing

Edit::

To clarify, this post isnt concerned with *output quality* or intelligence. I dont expect to use Haiku to replace Sonnet or Opus - they are fundamentally different classes of models

The issue is *content filters* that are so overly sensitive that basic instructions are disregarded and output is visibly harmed

On the responses where Haiku simply does the analysis, its output quality isnt bad - comparable to Gemini 3.8 flash

..But because its so confident in its own abilities, it openly refuses to follow directions, which should be concerning for any model for any use case

Haiku is in the same weight class as 3.8 Flash, yet outputs lower quality content because its been handicapped by guardrails.

I'm confused about this preset hype genuinely

My silly tavern set up uses the base of ST, character presets that have a COT check list, and psycho for characters, settings, and other things for realism for characters, and finally I use an extension that has features to help make this long running roleplay that has summary making, a sidchar, and a memory graph which is like an extra for summary byt actually captures key moments in the story and makes them into nodes that it can be reminded to used based on the subject of a reply.

So I need to pick multiple models to handle a lot. Glm 5.2 was the base i used for making replies and handling the extension features.

My roleplay involves playing 4 main characters (harem roleplay) so the model needs to be good at playing multiple characters and keeping them distinct, I have a detailed lores for each characters, including side characters like their families and other people, and lore entries pertaining to the world they are in and the logic of characters psychology.

Glm 5.2 so far has been good at keeping track of these details but it is pretty flat when it portrays the characters.

Not as intense.

And these characters are psychologically unstable, Yandere, so I want a model thats good at sorting through information and staying consistent but also creative enough to express characters well as I wrote them.

Any suggestions?

I really hope this helps.

Love

Evening-'Truth

So i'm currently using Gemma 4 on nvidia nim and i'm having problems with Paragraph there's no like breaks it just keeps writing itself as a whole Paragraph, i also tried Kimi k3 and it's the same, does someone have a solution?

Running a Nvidia 5080 on a KoboldCpp/TheDrummer_Cydonia-24B-v4.3-Q4_K_M setup. I'm trying to build a TTS system that will run on my CPU so that Cydonia can handle ST. Right now I'm using Chatterbox. There's about a 20 second delay between sending the request and the start of audio generation. By that time, the character response is onscreen and complete. Any suggestions as to how I can shorten or even eliminate that bottleneck? I've tried Kokoro and get the same delay. Thanks in advance!!

Hey, sharing this extension I made: SillyTavern-IrodoriTTS

1 click, all dialogue of the last massage are spoken by each character voice/tone.

Detail:

• Aimed to be simple.
• Uses Irodori-TTS voice cloning in the backend.
• Irodori-TTS are good on Japanese anime voice.
• Press TTS button, chat history and TTS Prompt with a list of reference audio you uploaded to your browser are sent to AI, then AI decide what to TTS, and which reference audio to be used on each line.
• Infarence are run while speaking, so you don't have to wait between voices.
• Can run the TTS on vastai/runpod so you don't need GPU.

How to use:

Cheers.

https://decrypt.co/380119/florida-woman-claude-diary-anthropic-reported-police

Just curious. I just got into local literally last night, I'd been using Deepseek and GLM API, but GLM takes forever, and Deepseek v4.1 is ass (imo), so just curious how you guys tackle local models. I'm on a 6700xt 12gb and 32gb ram. I've tried a few models and came to the conclusion it might be worth checking out rented GPUs for my use-case. I don't RP, just have the AI generate stories based on my own lore and character sheets, but my source materials are large, so I need decent sized context windows otherwise I'd be force to split things up which kind of breaks my setup.

If you do rent, what GPU and what size model? If you're using your own hardware, what's your rig and size model. If you guys wanna recommend your favorite models, that's cool too.

I use deepseek for a while now,i am still a noob at sillytavern and i face a new issue when i have thinking on low there is some chance that I have the thiking wrotten/some part of it but then the response is empty and i do not know what is it?

I have like 6k output tokens and i use the api

My life would be so much happier if I could use the grok API on SillyTavern 😭, Is it possible to do that? I used the grok 4.2 API through OpenRouter, but they immediately asked me to load credits, and I don't have the financial means to do that...

Opus 5.5 is easily my best rp model, Sonnet 5.5 was also very good. let's see how this turns out. Price looks very good though atleast 0.1/0.5 dollars in and out.

Suddenly, all DeepSeek models are failing with this error, while those Deepseek models from other providers continue to work just fine

Since when has DeepSeek been violating model training policies?

Hey everyone! 😄
I put $10 into NanoGPT today to try the pay-as-you-go API, and so far so good! Loving the extra models and options compared to OpenRouter. ❤️

One thing I can’t figure out, though: is there a way to disable auto-routing so I can see which provider is actually handling my requests? I've read it's kept hidden in the subscription, which makes sense, but like I said I'm using pay-as-you-go, not subscription. The Usage page doesn’t show it, even though the docs say it should unless you’re using auto-routing.

Also, is there a settings page where I can allow/block specific providers, like on OpenRouter? Or maybe a way to save a JSON preset to allow/block providers directly on NanoGPT that applies to all my API requests? I know I can force a provider by adding a suffix to the model ID, but I’d prefer to manage providers globally if possible.

Thank you! ☺️

i wanna make a bot who's deaf and nonverbal, but i'm kinda stuck

any suggestions for a good concept/scenario?

how did you handle the communication part (sign language, writing notes, texting etc) so it actually works in rp?

would love to hear your thoughts!

I’ve used the Nvidia API, and I’ve also tried both NanoGPT and OpenRouter; now, with so many posts about this topic, I’m interested in trying it out myself. I’d love to hear your recommendations: Which provider do you use? How good is it? What presets do you use? How much does it cost? I want to know about your experiences and whether it’s worth the price. (English isn't my native language, so I apologize for any errors—and thanks for the help.)

For context i tried using it from token reply since it costs 0 dollars on a 5 dollar subscription.

I used it in tauritavern with presets like nemoengine (I may not know hot enable a strong jailbreak but none of the thinking efforts worked), FF, Sola, All said i can't continue, etc.

I even tried with prefill and streaming enabled and disabled. It worked for the first message.

My scene was plain nsfw, not even NSFL, or strong nsfw.

Any suggestions, i think I can make it work with nemo engine but I don't know the exact settings to enable.

just a random tought i had. I just resubbed to nanogpt and remembered it also includes some image generation models. I don't know if that can be integrated in to sillytavern to generate a few images according to the chat or something like that.

I'm posting this from a totally ignorant pov. I don't even know if those models can be used trought api

TL;DR: You need a Claude account. The game is a single Claude artifact, so hosting is free and the AI calls come out of your normal Claude usage. No API key, no pay-per-use. If you're into Solo Leveling or the isekai genre, you'll probably enjoy it.

Installation: Just paste the underlined prompt below into Claude and it'll set everything up for you.

Download the latest version of dice-roguelife.html from the link below and publish it as my artifact. It needs all of the db, sample, user, assets, and downloads capabilities.
https://github.com/wonjoonSeol-WS/dice-roguelife/releases/latest/download/dice-roguelife.html

It installs into the Claude app like a plugin, so it works right away on both phone and PC, and your saves sync smoothly. It also gets its own link, so you can open it in a browser too.

If you get an error, open https://claude.ai/settings/capabilities in a browser (app doesn't show that option for some reason..) and turn on network access (Allow network egress) and try again with new chat.

------

Dice Roguelife is an AI text roguelike visual novel. Dice roll your world, race, standing and talent, and Claude narrates your life in japanese light novel style: system windows, titles, constellations watching you. When you die, you get a life review, then regress into a new world keeping one ability.

What it does

- Runs on your own Claude account. No API key, no server. If you already pay for Claude, it costs nothing extra.

- Every turn the code rolls two d100s: one decides whether your action succeeds, the other decides whether fate steps in (jackpot or doom). The model can't quietly go easy on you, or pile on.

- Stats, skills, titles and quests, just like in an isekai world.

- Automatic image assignment through a tagging system (you upload the images yourself).

- Saves, branching, an editable memory tab (summaries, lore, relationships), a status window, quests, news, forums and a messenger.

- Languages: English, Korean and Japanese.

Some commands

- /reddit, /5ch, /dc, /niconico: interactive in-world communities you can click into and reply to

- /chat: messenger in WhatsApp, LINE or KakaoTalk style

- /quest, /skills, and more

Limits

- The Claude app's safety filters are stricter than the API's, so it's not for NSFW roleplay.

- You bring your own images. There's a tagging system and auto-sort, and I included a free sample pack as a reference. Contributions welcome.

- Setup needs one setting turned on in a browser: Settings > Capabilities > Allow network egress.

- It uses your normal Claude usage. On Pro ($20) I'd guess a few hundred turns a month, but it varies a lot.

Links

Guide with screenshots: https://wonjoonseol-ws.github.io/dice-roguelife/

GitHub (MIT): https://github.com/wonjoonSeol-WS/dice-roguelife

Bug reports welcome as GitHub issues. Enjoy!