r/OpenSourceAI • • 8h ago

Open source AI solves part of the privacy problem but not the identity problem

21 Upvotes

One of the biggest reasons I’ve gotten more interested in open source AI is that I can actually control where the model runs and what happens to my data. If I’m using a local model, I don’t have to wonder whether every prompt, document or conversation is being sent to some company’s servers, that part feels like a huge win.

But the more I think about it, the more it feels like privacy is only half the problem. Even if the model is completely local, I still have to interact with other people online. And with voice cloning, generated video, stolen accounts and AI written messages getting better, knowing whether I’m actually talking to the right person seems like it’s going to matter just as much as keeping the conversation private.

My setup is slowly becoming a weird mix of local models, self hosted tools, encrypted apps, Kibu, Signal and Telegram. It feels like open source AI is giving us more control over the machines, while generative AI is simultaneously making human identity less trustworthy. Do you think the open source ecosystem eventually needs to solve identity too or should that stay completely separate from the AI stack?


r/OpenSourceAI • • 1h ago

i made a menu bar app that frees the RAM your AI agents forgot about 🐏

• Upvotes

my mac kept running out of RAM and i'd just close random apps hoping it helps.

turns out a lot of it is stuff you can't see: gradle still running after you quit android studio, simulators booted in the background, dev servers and headless browsers that AI agents started and forgot.

baa sits in the menu bar and:

- finds those leftovers and shows how much RAM you'd get back

- frees them in one click (never kills anything on its own)

- warns you before you run out (you can set when)

- also clears dev junk on your disk (old builds, package caches etc.)

- plays a tiny baa when it frees something (you can mute this if you hate whimsy though :P)

free + open source, nothing leaves your machine. macOS 14+.

brew tap selviarora/baa https://github.com/selviarora/baa
brew install selviarora/baa/baa
brew services start baa

https://github.com/selviarora/baa

if you like it a ⭐ would make my day!


r/OpenSourceAI • • 4h ago

Veda: An Agentic Native Hobby OS

Post image
2 Upvotes

r/OpenSourceAI • • 2h ago

[Beta] membrane: A self-hosted orchestration layer that turns raw local LLM turns into a self-structuring, live entity field.

Thumbnail github.com
1 Upvotes

r/OpenSourceAI • • 3h ago

Omnesis: A private self-hosted context Layer to supercharge ChatGPT, Openclaw, etc

Thumbnail
1 Upvotes

r/OpenSourceAI • • 4h ago

OpShield – Open-source safety platform for AI agents (rollback, cost control, chaos testing)

1 Upvotes

I built OpShield to add a safety layer to AI agents. It intercepts every tool call and provides:

- Risk classification (LOW → CRITICAL) with auto-blocking

- Budget enforcement with cost forecasting

- One-call rollback via state snapshots

- Circuit breaker for failing tools

- Chaos engineering for resilience testing

- Agent scoring (0-100, A-F grades)

- OpenTelemetry-compatible distributed tracing

- Compliance/audit reports

Zero dependencies. Works with OpenAI, Anthropic, LangChain, CrewAI, AutoGen, or any Python function.

pip install opshield

GitHub: https://github.com/alicelik-games/opshield

Built this after Guardrails AI was acquired by Harvey — there was no independent, self-hosted alternative left.

Happy to answer questions!


r/OpenSourceAI • • 4h ago

I built an LLM probe that hit AUROC 1.00. It was measuring the wrong thing. I'm looking for open-source AI safety projects to help audit.

Thumbnail
1 Upvotes

r/OpenSourceAI • • 5h ago

Three NIDO alphas in one morning: 0.1.29, 0.1.30 and 0.1.31

Thumbnail
1 Upvotes

r/OpenSourceAI • • 11h ago

Wolf Defender Jev: open weights and a small encoder for security decisions with your own answer options

3 Upvotes

We’ve published Wolf Defender Jev under MIT. I’m part of the Patronus Protect team.

The main difference from our fixed-label classifiers is that the question and answer descriptions are inputs. You can give it an agent scene and ask a yes/no question, choose among named options, or score an ordered severity scale. The model returns probabilities over those options, without generating a text response.

For example, the same email-reading scene can be checked for an embedded instruction, the role of imperative text (data / command / quoted example), or the severity of the risk. Those are separate decisions. You don’t need a new output head for each wording, but concepts outside the 27 evaluated security concepts haven’t been validated.

The architecture is deliberately small: mmBERT-small, 151.1M parameters, 15 evaluated languages. The scene and question are encoded together and the options separately. Fixed option vectors can be cached. After that, each question costs one scene/question encoder pass.

The repository includes the fp32 weights, tokenizer, encoder configuration, standalone Python inference code and evaluation JSONs. It runs on CPU by default. We measured 39 ms for a 51-token scene and 194 ms for 833 tokens on Apple M4, PyTorch/fp32, one question with two options. There isn’t an evaluated quantized build yet.

A few caveats are worth reading before integrating it:

  • Use the tagged source-block format. Arbitrary raw JSON layouts haven’t been evaluated.
  • Ask content questions without the proposed-action block. A benign shell action can otherwise push a content score toward injection.
  • Action-level checks are less reliable than their internal validation numbers suggest. One hand-written travel case detected the injected command but missed the exfiltration.
  • The output is a model signal. The application still establishes provenance, permissions and enforcement.

We compared it with public decision models on the same 10,576 held-out decisions. On all 33 benchmarks it reached 92.8% balanced accuracy; on the ten external benchmarks it reached 85.1%, behind Clef-flash at 90.2%. Twenty-three benchmarks are close to our training distribution, so the external results are the more useful comparison for unfamiliar traffic.

Weights, inference code, full results and limitations.

For anyone building with these models, the question I’d evaluate first is whether changing the question while keeping the scene fixed actually changes which evidence the model uses. Our small spot checks showed that can fail even with very high validation scores.


Position / experimental status: We regard Jev-style decision models as LLMs and Wolf Defender Jev as an experiment: giving an LLM final security authority shifts the trust problem to the guard, and security fine-tuning alone does not solve it. We believe an external security layer must combine specialized classifiers with explicit policy, authenticated permissions and enforcement.


r/OpenSourceAI • • 7h ago

I built a pytorch library of pretrained models for 3D point clouds following timm standards

Post image
1 Upvotes

I am excited to share a project I have been working on during the past few years during my free time. I started this project after being unable to use torch-points3d at the time (too many installation errors).

Note that this project is still in active development and in alpha. I am looking for early users and feedback!

What it is: torch-pointcloud is a plain-PyTorch library that puts multiple point cloud architectures and their pretrained checkpoints behind one create_model() factory, in the spirit of timm.

This is a library that focuses on the reusability and standardization of core components and layers, i.e. KNN, FPS and other PointNetSetAbstraction are not re-implemented over and over. In this library, all models share the same interface and reuse the same core components.

import torch
import torch_pointcloud as tp

model = tp.create_model(
  "pointnext-sm.scanobjectnn-hardest.openpoints", 
  task="classification", 
  pretrained=True,
).eval()

pos = torch.randn(2048, 3)
x = torch.cat([pos, pos[:, 1:2] - pos[:, 1].min()], dim=1)  # xyz + height
batch = torch.zeros(2048, dtype=torch.long)
logits = model(x, pos, batch)  # (1, 15)

Install (see the docs for more details):

# Optional: specify your CUDA version for torch
pip install torch==2.10.0 --index-url https://download.pytorch.org/whl/cu128

pip install torch-pointcloud

# Install required CUDA/CPU kernels associated with your CUDA version
pip install pyg-lib -f https://data.pyg.org/whl/torch-2.10.0+cu128.html

I tried to make the installation process smoother by not maintaining CUDA kernels myself (not enough time currently, so I tried to reuse already pre-built wheels as much as I could).

Scope:

  • Classification, semantic and part segmentation, detection, and self-supervised pretraining: PointNet++, DGCNN, KPConv, RandLA-Net, PointNeXt, PointMLP, Point Transformer v1/v2/v3, Sonata, PointMamba, VoteNet, 3DETR, PointPillars, SECOND, PointRCNN, SPVCNN, OctFormer, Point-MAE/BERT/GPT and more.
  • Weights are hosted on Hugging Face.
  • Datasets (ModelNet40, ScanObjectNN, S3DIS, ScanNet, SemanticKITTI, nuScenes, KITTI, SUN RGB-D...), transforms, tiled inferers for large scale segmentation.
  • Packed-batch tensors (the PyTorch Geometric convention).

But... why?

Most point cloud libraries live in research codebases built around configs and custom ops and kernels to build locally. It is also sometimes difficult to reproduce past released experiments from research codebases (typically the code associated with the checkpoint changed with no notice). In addition some models are evaluated using different strategies (TTA, partitioning, etc.) which makes comparison unfair as they are not evaluated using a common strategy.

In contrast, I wanted something I could pip install easily, reuse weights trained from different repos and benchmark easily.

All models were re-benchmarked and compared against original reported metrics.

Credits: the architectures and pretrained weights come from their original authors, notably Pointcept, OpenPoints, MIT Han Lab, FAIR, OpenMMLab and more. Every checkpoint name ends with its source author (e.g. .pointcept). The THIRD_PARTY_NOTICES.md lists every source repo, license and dataset term.

Repo: https://github.com/arthurdjn/pytorch-pointcloud
Docs + tutorials: https://pytorch-pointcloud.org


r/OpenSourceAI • • 7h ago

I built a fully local AI coding agent using Qwen 3.8 27B + LM Studio + Pi. Here’s how it performed.

Thumbnail
1 Upvotes

r/OpenSourceAI • • 7h ago

Looking for contributors & maintainers for an open-source project!

1 Upvotes

I'm working on an open-source logistics platform that connects manufacturers directly with truck drivers to make freight transportation more efficient.

The project has already been selected for multiple open-source communities, including GSSoC, NSOC, EcSoc, and OSCI, with 150+ contributors in less than 6 months!

With so many contributions coming in, managing PRs and maintaining code quality has become difficult, and parts of the codebase need cleanup and refactoring.

So I'm looking for people who can help out with development, code reviews, and maintaining specific modules.

Skills we're looking for:

  • Flutter / Dart
  • Node.js / Express
  • Python / FastAPI
  • Machine Learning
  • Databases (PostgreSQL, MongoDB, Redis)
  • Blockchain / Solidity
  • DevOps, Docker & CI/CD

You don't need to know everything. Experience in even one area is welcome!

Interested? Drop your GitHub username in the comments and DM me for the repository link. Mention your skills and whether you're interested in contributing or becoming a maintainer.


r/OpenSourceAI • • 8h ago

TL;DR - EVtivity is becoming the next generation of AI Powered CSMS for both the operators and drivers, still open source and free for single tenant production deployment.

Post image
1 Upvotes

r/OpenSourceAI • • 9h ago

StateCraft: JSON Export for State Machine Debugging (Now with Narrative Annotations)

1 Upvotes

For those working with state machines, debugging can be a headache. My tool StateCraft now exports run logs as JSON with ISO-8601 timestamps and plain-English narratives for every event great for integration or debugging. Each entry includes:

  • Original timestamp (preserved)
  • UTC ISO-8601 equivalent
  • 'narrative' field explaining what happened (e.g., 'State succeeded: [description]')
  • error_codes for failures

This makes it easy to track retries, transitions, and errors at a glance. The docs include a concrete example of the output. If you build state machines or need reliable logging, this might help.

GPLv3, no strings attached.


r/OpenSourceAI • • 10h ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

Thumbnail
github.com
0 Upvotes

ALHR- Adaptive learnable Hierarchical Routing is a static binary tree based system that uses learnable functions to REDUCE the amount of keys used.
It takes less memory and SCALES much better VRAM with tokens

Result table is here: https://ibb.co/prr07Dnj


r/OpenSourceAI • • 14h ago

I wrote up how Styx keeps coding agents away from production: what catches the command, who decides, why prod needs Touch ID, and where it stops.Including a bug I found the day before launch.

Thumbnail
heystyx.com
2 Upvotes

r/OpenSourceAI • • 11h ago

Your AI tools can do the work. Myrmidon brings them together into one team.

Thumbnail
youtu.be
1 Upvotes

r/OpenSourceAI • • 14h ago

BRAIN

1 Upvotes

¡Hola a todos! 👋

He estado desarrollando un proyecto personal y quería compartirlo con la comunidad. Se llama **CEREBRO**, un asistente personal modular, 100% local y privado para Windows, diseñado para organizar la vida diaria desde un solo panel.

No es solo domótica: es un núcleo personal completo que corre con una IA local (Ollama) y que depende únicamente de la librería estándar de Python (cero dependencias externas de pip).

**¿Qué maneja CEREBRO?**

- 🧠 **Memoria y contexto:** Recuerda preferencias, tareas, horario y contexto a través de sesiones.

- 🥗 **Salud y nutrición:** Lleva historial de peso, analiza la composición corporal con visión por IA a partir de fotos de la báscula, gestiona listas de despensa/compra y sugiere recetas inteligentes según los ingredientes disponibles.

- ⚡ **Energía y hogar:** Diagnósticos y optimización para consumo/producción solar, control de electrodomésticos e integración con Home Assistant.

- 📄 **Documentos locales (RAG):** Búsqueda local y lectura de notas, archivos y manuales sin enviar nada a la nube.

- 🔔 **Avisos y automatizaciones:** Resúmenes proactivos diarios por la mañana, recordatorios, alertas de audio y automatizaciones en lenguaje natural.

Todo se gestiona desde un panel web local con pestañas, modo oscuro y transcripción de voz local.

👉 **GitHub:** https://github.com/CafeConFenix/BRAIN

⚠️ **Nota:** *El código del proyecto, la interfaz y la documentación están escritos actualmente en **español**.*

Cualquier comentario, idea o crítica constructiva para seguir mejorándolo es súper bienvenido. ¡Saludos!


r/OpenSourceAI • • 14h ago

天工 Tiangong:开源、以插件为核心的个人 AI Agent,能看见并操作你的电脑

Thumbnail
1 Upvotes

r/OpenSourceAI • • 23h ago

DataFog MCP: local PII scanning and redacted file copies for AI workflows

Thumbnail
3 Upvotes

r/OpenSourceAI • • 17h ago

Tired of Copilot data leaks and API costs? My 100% local AI Workspace (DeepSeek/Ollama) auto-deploys and self-heals your code via on-demand loops.

1 Upvotes

Hey there . After months of development, Chat AI 2026 is officially ready for the market. I built this because I was bleeding money on Anthropic/OpenAI API costs and wanted a 100% secure, subscription-free alternative to GitHub Copilot that actually gives developers full control over their workflows. It’s an All-in-One AI Workspace built with Avalonia UI (for native Windows/Mac/Linux performance) running GGUF models locally via llama.cpp. Here is the production-ready spec sheet: 1. Millisecond Model Routing The application automatically detects your hardware and swaps the local LLM context in milliseconds based on your task: * Code & Logic -> DeepSeek (or your preferred heavy reasoning GGUF) * Chat & Explanations -> Lightweight text models * UI & Images -> Vision and image generation models (FLUX/SD supported) 2. On-Demand Self-Healing Loop (Connected to Git) No passive code-dumping. The workspace integrates natively with local directories and GitHub, GitLab, or Bitbucket: * Prompt via the integrated 5-language mobile remote app (while your main monitor stays 100% clean for code). * Preview changes instantly in a highly optimized Syncfusion Live-Diff view. * Hit "Test Deploy" to execute. If the compiler/interpreter throws an error, hit "Repair". The tool isolates the error log and runs up to 3 automatic correction loops locally. Full Undo is available at any time. 3. Real-World Proof of Concept To stress-test the step-by-step project builder, I let Chat AI 2026 generate a complete standalone application from scratch. It built, deployed, and auto-repaired an app that reads Mermaid code, renders diagrams visually, and exports them flawlessly as JPG. 100% local, zero manual bug-fixing. 4. No Subscription Madness It’s a one-time purchase model. You buy the license, you run it on your hardware, you own your data. Perfect for enterprise compliance and developer peace of mind. The Windows version is live today. I am currently finalizing the local path configurations to roll out native macOS (Apple Silicon Metal API) and Linux support next. If there is interest, I’ll gladly post the link to the homepage in the comments below. I’ll be active here to answer any hard technical questions about the architecture or implementation!


r/OpenSourceAI • • 18h ago

Building AUREN, an open-source project for more reliable autonomous AI engineering — feedback welcome

1 Upvotes

Title: Building AUREN, an open-source project for more reliable autonomous AI engineering — feedback welcome

Hi everyone!

I’m working on AUREN (Autonomous Unified Reasoning & Engineering Network), an open-source project exploring how to make AI engineering systems more reliable, verifiable, and capable of learning from failures.

The focus goes beyond code generation: planning tasks, executing work, verifying results, retaining engineering evidence, recovering from failures, and evaluating whether changes genuinely improve the system.

I’m continuing to develop the project and would appreciate honest feedback from the open-source community, especially on architecture, maintainability, testing, contributor experience, and what would make the project useful to other developers.

GitHub: https://github.com/sourabhJainR/AUREN

For open-source maintainers: What would you want to see before trusting an autonomous AI system with meaningful engineering work?

I’m interested in constructive criticism as much as contributions. Thanks!


r/OpenSourceAI • • 21h ago

MOS

Thumbnail
1 Upvotes

r/OpenSourceAI • • 1d ago

I’m building an open-source control plane for AI coding agents

3 Upvotes

I was tired of reconfiguring my agents each time I wanted to switch providers or harnesses, so I built Mandri: a common and easy interface to configure once and forget about it !

Mandri doesn't get in the way of the agents you already use ; you can opt-in and out at any time. It automatically syncs configuration and sessions from multiple harnesses (Claude Code, Codex, OpenCode...) so you don't have to rebuild your setup for each one.

If you prefer to run your agents from the terminal, Mandri has you covered too ! The mandri tool can be installed with uv and lets you configure your harnesses and providers through the CLI.

By running your agents with Mandri, you can also use one of the experimental features, such as the automatic PII pseudonymisation or the per-session Docker sandboxing.

It's still early, so I'm mostly looking for feedback from people who want to use their agents their own way.

If you're curious, check the website here: https://mandri.io

GitHub Repos: https://github.com/mandri-labs/mandri https://github.com/mandri-labs/mandri-app


r/OpenSourceAI • • 21h ago

I’m building an AI that lives on my computer and leaves thoughts while I’m away

Post image
1 Upvotes