About Whisper
Whisper is a speech recognition model from OpenAI, general in purpose, released as open source under the MIT license. It was trained on a large and diverse audio dataset and handles several tasks in one model: transcription in multiple languages, translation of speech, and identifying the spoken language. The repository contains the Python code needed to run it.
It uses a Transformer sequence-to-sequence model trained on several speech processing tasks, including voice activity detection, which are represented together as a sequence of tokens predicted by the decoder. As a result, one model can stand in for what used to take several separate components in a speech pipeline. Special tokens act as task specifiers or classification targets.
The authors trained and tested with Python 3.9 and PyTorch 1.10, and expect the code to work with Python 3.8 to 3.11 and recent PyTorch versions. It can be installed with pip as openai-whisper or directly from the repository, and it relies on a few packages such as OpenAI's tiktoken tokenizer. Links to a blog post, paper, model card and Colab example are provided. It suits developers and researchers who need speech-to-text they can run themselves.
Key features
- Multilingual speech recognition
- Speech translation across languages
- Spoken language identification
- Transformer sequence-to-sequence architecture
- Install with pip
- Model card, paper and Colab example
Good fit for
- →Transcribing audio and video
- →Adding speech-to-text to applications
- →Speech recognition research
- Built with
- Python
- Tags
- speech-recognition
- speech-to-text
- openai
- python
- transcription
- pytorch
- translation
- ai
Whisper: questions and answers
- What is Whisper used for?
- Whisper is OpenAI's open-source general-purpose speech recognition model, which handles multilingual transcription, speech translation and language identification. It is a good fit for transcribing audio and video, adding speech-to-text to applications, and speech recognition research.
- Is Whisper open source?
- Yes. Whisper is open source under the MIT licence. Its source code is on GitHub at openai/whisper and is written mainly in Python.
- Is Whisper free?
- Yes. Whisper is open source, so the software itself is free to use.
- What is Whisper an alternative to?
- Whisper is an open-source alternative to Deepgram and AssemblyAI. Other open-source alternatives to Deepgram include whisper.cpp and LocalAI.
- Is Whisper actively maintained?
- Yes. The most recent commit to Whisper was on 31 August 2026, and the latest release is v20250625, published on 26 June 2025. The project has 110k stars on GitHub.
Open-source alternatives to Whisper
See all
whisper.cpp
AI Infrastructure
Port of OpenAI's Whisper model in C/C++
MITvs Deepgram★ 54k
LocalAI
AI Infrastructure
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video -
MITvs ChatGPT★ 49k
labml
AI Infrastructure
🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱
MITvs Weights & Biases★ 2.3k
vLLM
AI Infrastructure
A high-throughput and memory-efficient inference and serving engine for LLMs
Apache-2.0vs Amazon Bedrock★ 93k
Superduper
AI Infrastructure
Superduper: End-to-end framework for building custom AI applications and agents.
Apache-2.0★ 5.3k
llamafile
AI Infrastructure
Distribute and run LLMs with a single file.
OSSvs ChatGPT★ 26k
SaaS alternatives to Whisper
See all
Deepgram
AI Infrastructure
Speech-to-text and voice AI APIs for transcription and voice agents
SaaS
AssemblyAI
AI Infrastructure
Speech recognition and audio intelligence API for transcription
SaaS
Speechmatics
AI Infrastructure
Speech recognition API supporting many languages and real-time transcription
SaaS
Costbase
AI Infrastructure
Aggregates the costs of AI providers into one dashboard for developers of AI products
SaaS
OpenAI API Platform
AI Infrastructure
Developer API and platform for accessing OpenAI models like GPT for text, vision and audio
SaaS
AgentGov
AI Infrastructure
Open source platform for AI agent tracing and EU AI Act compliance with audit trails and risk documentation
SaaS
