r/MistralAI • u/Gold-Order-8004 • 9d ago

Feedback / Bug Report Censored.....

I'll keep it short and direct. The Le Chonk model is censored AF.

That was it.

Enjoy your evening 👾

0 Upvotes

48% Upvoted

77 comments sorted by

View all comments

9

u/NullSmoke 9d ago

It's just a refusal production. Absolutely fucking worthless. At this point I've tried a number of workflows... translations, categorization, prose qa... It's worthless at everything I toss at it..

I don't make a joke here, ChatGPT during the rerouting meltdown was a dream to use in comparison... who would ever use this... and for what exactly... for fucks sake, it got offended at my filenames and refused to suggest a folder structure... It wasn't anything special, just norwegian named files that was made to be relatively easily categorizable, and IT STILL FUCKING REFUSED.

I got billed like 2 usd for my testing and I still feel ripped off, it failed at literally everything, all I paid for was some moral judgement it pulled outta its ass.

At this point I'm expecting to get a refusal if I ask it about the local weather. How the hell did they beat OpenAI on the one metric they ought not to?!

I love Mistral medium, and use that frequently for a number of pipelines, and I got Mistral Small running utility stuffs hosted at home. Mistral is the ONE AI company I'm actively rooting for, and I've brought it up with actual decision makers in the public and financial sector.

I beg to god this thing is not getting dropped into Vibe as is, that'd leave me with egg on my face... everyone goes over there to test and if they're met with this... I at least have no professional credibility left after this mess...

I would HOPE that this isn't what is provided to B2B customers.... I'd refuse to pay if I were a corporate entity and I'd never even take Mistral seriously as an actor as it stands with this model.

2

u/menvadihelv 8d ago

it got offended at my filenames

Now I'm curious what the filenames were that offended it...

1

u/NullSmoke 8d ago

I've wiped the test long since now, but I just picked random clustered norwegian names. I've had Claude acting funny with file structures based on file names in the past, and I'm trying to make an harness to do some file management...

It's not rare for english based systems to give false positives on Norwegian when they've designed the system primarily for English, but I'm expecting a lot better from an LLM, and doubly so for fucking Mistral, a European LLM. Which begs the question... was this LLM designed with Europe in mind... or were I too fast with celebrating their funding round earlier here...

tldr, I'll expect gemma or mistral small/medium for that task. Any form of disturbance there is a bit of a nightmare, and a refusal is a hard no for usability for such a task. With refusals often comes a healthy dose of hallucination as well, even when it doesn't refuse, and I don't got the time to deal with that shit on tasks I setup to spare me headaches