Local model runtimes, inference engines, agent frameworks and coding systems that are useful beyond a demo.
4 long-form field guidesOpenHands / OpenHands
The current OpenHands repository centers on Agent Canvas, a self-hosted control surface for starting coding-agent conversations and automating engineering work across local, container, remote, and cloud backends. That scope makes it more ambitious than a chat panel and more operationally demanding than an editor extension.
ollama / ollama
Ollama packages model acquisition, local execution, configuration, a command-line interface, and an application-facing API into one approachable runtime. Its current documentation also supports larger cloud-hosted models, so the project is best understood as a consistent model interface with local execution as a major strength, not as an offline guarantee.
Aider-AI / aider
Aider works inside an existing Git repository, builds a map of the codebase, sends selected context to a chosen model, applies edits, and records changes through familiar version-control machinery. Its restraint is the point: the developer keeps the terminal, editor, test suite, and repository as the center of work.
continuedev / continue
Continue helped establish a configurable alternative to sealed coding assistants through editor extensions, a terminal client, model choice, rules, prompts, and tool integrations. The official repository now states that it is read-only and no longer actively maintained, with 2.0.0 presented as the final release. That status is the first fact any prospective adopter needs.