llamafile

llamafile is a Mozilla Builders project, now revamped by Mozilla.ai, that lets you distribute and run LLMs as one file. It combines llama.cpp with Cosmopolitan Libc into a framework that folds the complexity of running a model into one executable, known as a llamafile, which needs no installation and runs on your machine under most operating systems and CPU architectures. The goal is to make open models more approachable for developers and end users. The repository metadata lists the license as Other.

The project also bundles whisperfile, which applies the same single-file packaging to whisper.cpp for speech-to-text, transcribing and translating audio on the same platforms. Starting with version 0.10.0, llamafile uses a new build system that keeps it aligned with current llama.cpp, adding support for newer models while some earlier features may be missing. Previous versions remain on the releases page, and pre-built llamafiles state which server version they bundle.