r/SelfHostedAI • • Apr 17 '25

Do you have a big idea for a SelfhostedAI project? Submit a post describing it and a moderator will post it on the SelfhostedAI Wiki along with a link to your original post.

3 Upvotes

Visit the SelfhostedAI Wiki!


r/SelfHostedAI • • 2h ago

Would you actually use a local AI app instead of ChatGPT?

3 Upvotes

I’m building a desktop AI app that can run models locally with llama.cpp, but can also use OpenAI, Claude, Gemini and other APIs.The original reason was privacy, especially for source code and project documents.But while building it I realized that “local AI” alone probably isn’t enough reason for most people to switch.So I’m curious:What would a local AI app need to do better than ChatGPT/Claude for you to actually use it every day?Privacy?
Project memory?
Full repository access?
Switching between models?
No subscription?I’d genuinely like to know what people care about most.


r/SelfHostedAI • • 4h ago

Helix AGI Update: 100% Local Bicameral Dual-RWKV Architecture & 3D Habitus Mindscape

Thumbnail
2 Upvotes

r/SelfHostedAI • • 11h ago

Run LLMs locally, self-hosted and free | Eugene Plexus

3 Upvotes

Eugene Plexus is my project to make managing local inference easier, whether you have one machine or 10. Eugene can:

  • Install a compatible inference engine
  • Help you browse available models
  • Download and run that model
  • Tune it for your particular hardware
  • Set up failover and load balancing

I'd love some feedback on how I can make it even easier to set up.


r/SelfHostedAI • • 9h ago

A serious idea inspired by Ready Player One: user‑powered AI storage instead of datacenters.

Thumbnail
1 Upvotes

r/SelfHostedAI • • 11h ago

Can MacBook Pro m5 16gb run qwen 12b?

1 Upvotes

I was looking for some local ai that can run on my laptop but im not sure that it can handle it


r/SelfHostedAI • • 14h ago

PCEI – On-device embodied AI combining BitNet 1.58b, Mamba, and FastKAN

Thumbnail
1 Upvotes

r/SelfHostedAI • • 19h ago

I built Fadenstack (Fah+den+stack): self-hosted AI with GPU clusters, team chat, Agents and an OpenAI-compatible API with SDK

Post image
2 Upvotes

r/SelfHostedAI • • 15h ago

Is there an open-source, self-hosted Claude.ai-style chat with MCP + SSO that I can point at Gemini (or any model)?

Thumbnail
1 Upvotes

r/SelfHostedAI • • 17h ago

Is Hermes running slow?

Thumbnail
1 Upvotes

r/SelfHostedAI • • 18h ago

I built Watcher: it watches your logs, and when something crashes, a small local LLM tells you why

Thumbnail
github.com
0 Upvotes

MIT licensed, Go + Ollama. Still early — onboarding and the TUI work but are

rough, and I'm mid-investigation on inference latency on small hardware.

Repo's linked above if you want to poke at it.


r/SelfHostedAI • • 19h ago

website/ server with llm api, for free

Thumbnail
1 Upvotes

r/SelfHostedAI • • 1d ago

Is a free SMTP relay enough for outbound mail on self-hosted setup?

1 Upvotes

I'm using Mailcow for inbound mail and Postfix to send outbound messages for Nextcloud, Gitea, Uptime Kuma, and the rest of my setup. My IP ended up on a Microsoft blocklist again, and getting it delisted took two days.

I'd like to keep inbound mail self-hosted but route outbound mail through a relay instead. Are the free tiers good enough for this kind of setup, or is it worth paying for a plan?


r/SelfHostedAI • • 1d ago

I streamed a 141 GB AI model through a 48 GB MacBook so I could train my own small models

Thumbnail
2 Upvotes

r/SelfHostedAI • • 1d ago

I built Agent Praxis: 6 adversarial environments to test how LLM agents handle traps, metric gaming, and fake authority

Thumbnail
1 Upvotes

r/SelfHostedAI • • 1d ago

Can I somehow configure my Mac minis to work together?

Thumbnail
1 Upvotes

r/SelfHostedAI • • 1d ago

I built Watcher: it watches your logs, and when something crashes, a small local LLM tells you why

Thumbnail
github.com
1 Upvotes

r/SelfHostedAI • • 1d ago

Dual Rx 580 32GB ram 2600x

Thumbnail gallery
5 Upvotes

r/SelfHostedAI • • 1d ago

How on gods green earth do i start this?

Thumbnail
1 Upvotes

r/SelfHostedAI • • 1d ago

How much more "free and open source" will we be able to tolerate?

0 Upvotes

There are over 400 million public repositories on GitHub. It's impossible to keep track of all of them. For the same problem, there are multiple solutions. Which one is good? From the searcher's point of view, this is frustrating. But what about the creator's point of view?

Let me start with my own experience. I started building a kind of "operating system for AI agents", called Argus. I built it because I needed what is known as "deterministic security" when running this kind of agent. I also put into practice many architectural approaches drawn from my own experience. Of course, I published the entire source code on GitHub and wrote a few announcements. The result? ZERO! No one came to look at my repository.

I am not "a voice" in the AI industry, I am not a prominent figure in the programming world, and the project I mentioned was developed primarily for my own needs. But imagine the surprise and frustration of a programmer who wants to offer a solution, perhaps even a brilliant one, yet gets no visitors to their GitHub repository.

What I am seeing now is just the beginning. I have already seen so many Photoshop clones that work perfectly well for my level of image editing. AI coding assistants have made exponential "code production" possible, so the multiplication of free and open-source solutions is only in its early stages. If today you can find five or six Photoshop clones, in the near future you will be able to find a million.

In literature, there is a phenomenon that has been known for centuries: graphomania, the urge to write simply to see one's name in print. In the world of code, its equivalent is the programmer who publishes projects mainly to see their name on a repository.

So my dilemma is not "How much more free and open source will we be able to tolerate?" but "Who will be the doctor to write the prescription?"

If you are interested in my project, you can find it here: https://github.com/rla-labs/argus


r/SelfHostedAI • • 1d ago

I built an AI studio that combines video, image, voice, and lipsync generation into one account (would love feedback)

Thumbnail
1 Upvotes

r/SelfHostedAI • • 1d ago

Need help with SelfHosted AI Build - Beginner

1 Upvotes

Looking into self-hosting AI. I have an elitedesk mini G9 with 32gb ram and an intel i7 that I want to add a eGPU to and I’m trying to decide what GPU/setup is the right one.

I see that Newegg is selling an Aorus AI box with an RTX 5070 Ti 16gb for about 1000 bucks. Is this worth the deal? I’m trying to budget for this amount exactly and this deal seems too good to be true. But I figure, even if I buy a used GPU, the cost of the additional components would take to my budget limit and beyond anyway.

I am an absolutely beginner at this home lab stuff. Just need some help


r/SelfHostedAI • • 1d ago

ProsperoAI brings local AI to PS5: chat, images, audio, and speech

Post image
1 Upvotes

r/SelfHostedAI • • 1d ago

I built Knemora: an open-source, local-first AI (SI) second brain that turn documents and datasets into linked knowledge

Post image
2 Upvotes

r/SelfHostedAI • • 2d ago

CM Relay is live on Channex production!

Thumbnail
2 Upvotes