LocalAI

Self-hosted, OpenAI-compatible engine that runs LLMs, vision, voice, image, and video models on any hardware.