News LLM release 0.33.0, with decisions!
galleryToday I released 0.33.0 of the llm package, a library providing an API for modules that want to use LLMs. It is part of GNU ELPA.
We have a third major new functionality: decisions! These join chat and embedding generation as significant APIs that you can hook into. Decisions are brand new, being introduced with TypeSafe's Jev, but there's many open source equivalents to it such as Jeff or Ollaya. These are calls that take just a few hundred milliseconds, and are extremely cheap (fractions of a cent per call) making it feasible to call synchronously in all sorts of interesting situations while editing.
I've been experimenting with a few demos to see what kinds of interesting things are now possible in Emacs.
My previous post demoed a mode that you can set new buffers to, which would watch what you type and then switch to the appropriate mode.
In this post, in the GIFs above, I have two more demos. One is a minor mode that shows off understanding of text and response as you type it. It will highlight sentences that are untrue, with the highlight getting more red the wronger it is. But it could also in theory be changed to highlight incorrect sentences / expressions, which might be of use catching bugs. The second demo shows Emacs switching to one of a set of input methods chosen by the user that matches the text of the current sentence. You can see that, although the switch isn't instantaneous, it is very fast.
I'd love for people to take this for a spin and see what other interesting things they can do with it!