About AI Video Search Engine
AI Video Search Engine, or AVSE, searches inside videos rather than only their titles. The author built it to show that a Google-style index for video content is feasible with technology that is readily available. It extracts the transcript, thumbnail, description and title of a YouTube video, then creates vector embeddings through JigsawStack's multimodal embedding model.
Transcripts are chunked with timestamps and stored in Supabase's PostgreSQL with the pg_vector extension. A question is matched by vector cosine search across the database, a second search finds related chunks inside each result video, and the chunks are mapped back to the timestamped transcript so the relevant clip plays. Summaries come in point form and text, and chat sessions are temporary and not stored.
Hosting it yourself involves Supabase, Hasura on Fly, JigsawStack and Vercel. The repo includes a Hasura migration, a script for indexing whole YouTube channels, and a script to regenerate embeddings for another model. The current model supports over 75 languages.
Key features
- Transcript extraction from YouTube videos
- Vector search by question across stored videos
- Plays the relevant clip using timestamps
- Video summaries in point form and text
- Temporary chat sessions about a video
- Script for indexing whole channels locally
- Embedding model covering many languages
Good fit for
- Searching spoken content in YouTube videos
- Reference design for vector video search
AI Video Search Engine: questions and answers
- What is AI Video Search Engine used for?
- AI Video Search Engine is a TypeScript demo that indexes YouTube video transcripts as vectors so you can ask questions and jump to the matching clip. It is a good fit for searching spoken content in YouTube videos and reference design for vector video search.
- Is AI Video Search Engine open source?
- Yes. AI Video Search Engine is open source. Its source code is on GitHub at yoeven/ai-video-search-engine and is written mainly in TypeScript.
- Is AI Video Search Engine free?
- Yes. AI Video Search Engine is open source, so the software itself is free to use.
- Can I self-host AI Video Search Engine?
- Yes. AI Video Search Engine can be self-hosted on your own server or infrastructure.
- What are some alternatives to AI Video Search Engine?
- Similar open-source tools in the Search category include Orama, Xyne and XERJ. SaaS products in the same category include Amazon OpenSearch Service, Azure AI Search and MomentClip.
- Is AI Video Search Engine actively maintained?
- The most recent commit to AI Video Search Engine was on 3 March 2025. The project has 630 stars on GitHub, with 3 added in the last 30 days.
Open-source alternatives to AI Video Search Engine
See all
Orama
Search
π A complete search engine and RAG pipeline in your browser, server or edge network with
OSSvs Algoliaβ 11k
Xyne
Search
AI-first Search & Answer Engine for work. Open-source alternative to Glean.
Apache-2.0vs Gleanβ 698
XERJ
Search
XERJ is the new way for AI to search data. Its autoindex capability activates agents to kn
Apache-2.0vs Elasticβ 19k
Vespa
Search
The AI search platform
Apache-2.0vs Elasticβ 7.2k
Trieve
Search
All-in-one platform for search, recommendations, RAG, and analytics offered via API
MITvs Algoliaβ 2.7k
Degoog
Search
Search engine aggregator with a comprehensive plugin/extension system
AGPL-3.0vs Startpageβ 2.5k
SaaS alternatives to AI Video Search Engine
See all
Amazon OpenSearch Service
Search
Managed AWS service for running OpenSearch clusters for search and log analytics
SaaS
Azure AI Search
Search
Azure managed search with full-text, vector and hybrid retrieval
SaaS
MomentClip
Search
Search YouTube videos with natural language to find any moment by topic, dialogue or visual
SaaS
Vectara
Search
Managed retrieval and RAG platform with semantic search APIs
SaaS
Dotient
Search
App for finding personal files by describing what they look like
SaaS
Exa
Search
Search API that returns web pages by meaning, built for AI applications
SaaS
