
LocalAI
An open-source AI engine that runs LLMs, vision, voice, image and video models on your own hardware behind OpenAI-compatible APIs, with no GPU required.
- GitHub stars
- 50k
- Last commit
- yesterday
- Latest release
- v4.12.1
- Licence
- MIT
- Self-hosted
- Yes

LocalAI is an open-source AI engine for running models of many kinds, including language, vision, voice, image and video models, on your own hardware. A GPU is not required. It is written in Go and released under the MIT license, was started by Ettore Di Giacinto and is looked after by the LocalAI team.
Its design is a small core with separate backends that are pulled on demand, so nothing unused gets installed. Backends wrap engines such as llama.cpp, vLLM, whisper.cpp, stable-diffusion and MLX, and you can write your own in any language against an open interface. It can run on CPU alone, through Vulkan, or on NVIDIA, AMD, Intel and Apple Silicon hardware.
APIs are drop-in compatible with OpenAI, Anthropic and ElevenLabs across every backend. Multi-user features include API key authentication, user quotas and role-based access, and built-in agents support tool use, RAG, MCP and skills. The project stresses that data stays on your infrastructure. It suits developers and teams who want a private, self-hosted replacement for cloud AI APIs.
Key features
- Runs LLM, vision, voice, image and video models
- Composable backends pulled on demand
- OpenAI, Anthropic and ElevenLabs API compatibility
- Runs on CPU, NVIDIA, AMD, Intel and Apple Silicon
- API key authentication, quotas and role-based access
- Built-in agents with tools, RAG and MCP
Pricing: Free and open source under the MIT license.
















