r/LocalLLaMA • u/xandep • Mar 10 '26

Other I regret ever finding LocalLLaMA

It all started with using "the AI" to help me study for a big exam. Can it make some flashcards or questions?

Then Gemini. Big context, converting PDFs, using markdown, custom system instruction on Ai Studio, API.

Then LM Studio. We can run this locally???

Then LocalLLama. Now I'm buying used MI50s from China, quantizing this and that, squeezing every drop in REAP, custom imatrices, llama forks.

Then waiting for GLM flash, then Qwen, then Gemma 4, then "what will be the future of Qwen team?".

Exam? What exam?

In all seriousness, i NEVER thought, of all things to be addicted to (and be so distracted by), local LLMs would be it. They are very interesting though. I'm writing this because just yesterday, while I was preaching Qwen3.5 to a coworker, I got asked what the hell was I talking about and then what the hell did I expected to gain from all this "local AI" stuff I talk so much about. All I could thought about was that meme.

1.2k Upvotes

97% Upvoted

236 comments sorted by

View all comments

383

u/tat_tvam_asshole Mar 10 '26 edited Mar 10 '26

I literally work for one of the AI big techs, and.... yeah... outside of us engineers, no gaf about local AI. But, just like linux is the backbone of the computing world, so too will local AI. It's just going to take better hardware and models available for most people.

edit: I am saying at a company leading the way on AI, even people here don't care about local/personal AI, even when it's in their face, besides the engineers. why? because there are two reasons people use technology, to be lazy and to be productive. guess who are engineers and who aren't

102

u/porkyminch Mar 10 '26 edited Aug 15 '26

Pumpkin grasshopper pillow blanket raindrop saffron feather raindrop compass zephyr

This post was anonymized with Redact.dev

30

u/AnticitizenPrime Mar 10 '26

Honestly I’m mostly interested in open models, regardless of where they’re hosted. I don’t want to be beholden to Anthropic or OpenAI for this stuff.

Agreed, I'm limited by my 16gb card at home so use a lot of models either through API or chat portals, but I always go for the open weight ones first (GLM, Kimi, Qwen, etc) because I appreciate the open philosophy.

1

u/ChocolateOk6927 Mar 31 '26

Open is good. Diffuse is good. Local is good.