Open-source magnitudedev/magnitude (Apache-2.0, ~3.1k stars) is a local inference server that profiles your hardware, recommends fitting local models, then downloads, tunes, and runs them — plugged into Codex, Claude Code, Cline, and Hermes. Models load on demand and unload when memory is tight, so coding agents can use local models without a separate stack.

Key Takeaways

  • Open source: magnitudedev/magnitude, Apache-2.0, ~3.1k stars.
  • Features: hardware profiling, local model picks, on-demand load/unload.
  • Integrations: Codex, Claude Code, Cline, Hermes.
ADSponsored