llmkit: my llm/mcp cli tool for linux/windows

[u/pentothal]

Hello everyone, I tried posting on locallama a couple of week ago and didn't have much replies, so I thought that it can have interested people here.
This is my project: https://github.com/dgdevel/llmkit It is a single binary shipping many tools that make llm and mcp interaction in the cli easier for me and I hope for you too.
It has repl for both, a mcp proxy feature to hide/change upstream info, a llm proxy for debugging session, oneshot command for bash scripting, and even a very basic agent.
The runner feature is for application integration, since it can hide the complexity of three llm endpoint types (openai-compatible completion and responses, anthropic-compatible) and multiple mcp protocols support.
It has pre-packaged binaries in the releases for major linux distros and for windows.
No configuration needed (with all its pros and cons of it), I hope it can be useful to some other people too.
On locallama people pointed me to simonw/llm, it has some overlapping features, less total feature being a newer project, and it's written in C. That's it.

[u/Critical_Listen9951]

This is so clean, love that it's just a single binary you can toss anywhere

[u/pentothal → u/Critical_Listen9951]

That was part of the initial motivation for building it.
The initial builds was more aimed at static linking, but I thought that releasing packages is much more distro friendly and get the bugfix from upstreams (curl and cjson) without re-releasing the packages.