About MLRun
MLRun is an open-source AI orchestration framework for managing machine learning and generative AI applications across their lifecycle. It automates data preparation, model tuning, customization, validation, and optimization of ML models, LLMs, and live AI applications over elastic resources.
The platform enables rapid deployment of scalable real-time serving and application pipelines, with built-in observability and flexible deployment options supporting multi-cloud, hybrid, and on-prem environments. It is designed for data engineers, data scientists, and machine learning engineers to collaborate using one technology stack.
Key features
- Automates AI pipeline end to end from training and testing to deployment and management in production
- Auto-generates batch and real-time data pipelines
- Orchestrates distributed data processing, model training, LLM customization, and serving with auto-scaling
- Allocates VMs or containers on demand and provisions GPUs to improve utilization
- Auto-tracks data, lineage, experiments, and models; monitors models, resources, and data in real time
- Supports all mainstream frameworks, managed ML services, and LLMs with an open architecture
Good fit for
- Managing ML and generative AI applications in production
- Automating model training and testing pipelines with CI/CD
- Deploying real-time serving and application pipelines
MLRun: questions and answers
- What is MLRun used for?
- MLRun is an open-source AI orchestration framework that automates data preparation, model tuning, validation, and deployment of ML and generative AI applications across their lifecycle. It is a good fit for managing ML and generative AI applications in production, automating model training and testing pipelines with CI/CD, and deploying real-time serving and application pipelines.
- Is MLRun open source?
- Yes. MLRun is open source under the Apache-2.0 licence. Its source code is on GitHub at mlrun/mlrun and is written mainly in Python.
- Is MLRun free?
- Yes. MLRun is open source, so the software itself is free to use.
- Can I self-host MLRun?
- Yes. MLRun can be self-hosted on your own server or infrastructure.
- What is MLRun an alternative to?
- MLRun is an open-source alternative to Amazon SageMaker, Comet and Domino Data Lab. Other open-source alternatives to Amazon SageMaker include MLflow, Kubeflow and Polyaxon.
- Is MLRun actively maintained?
- Yes. The most recent commit to MLRun was on 10 November 2026, and the latest release is v1.13.0, published on 4 November 2026. The project has 1.7k stars on GitHub, with 2 added in the last 30 days.
Open-source alternatives to MLRun
See all
MLflow
AI Infrastructure
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables te
Apache-2.0vs Weights & Biases★ 29k
Kubeflow
AI Tools
The Cloud Native AI Platform
Apache-2.0vs Together AI★ 16k
Polyaxon
Workflow Automation
AI Infra / AI Orchestration / AI Control Plane
Apache-2.0vs Amazon SageMaker★ 3.7k
KubeDL
AI Infrastructure
Run your deep learning workloads on Kubernetes more easily and efficiently.
Apache-2.0vs Amazon SageMaker★ 534
BentoML
AI Infrastructure
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM
Apache-2.0vs Amazon SageMaker★ 8.9k
Backend.AI
AI Infrastructure
Backend.AI is a streamlined, container-based computing cluster platform that hosts popular
LGPL-3.0vs RunPod★ 680
SaaS alternatives to MLRun
See all
Amazon SageMaker
AI Infrastructure
AWS platform for building, training and deploying machine learning models
SaaS
Comet
AI Infrastructure
Experiment tracking, model registry and LLM evaluation platform
SaaS
Domino Data Lab
AI Infrastructure
Enterprise MLOps platform for building, governing and deploying data science models
SaaS
H2O.ai
AI Infrastructure
AI platform for predictive and generative AI model building and deployment
SaaS
Lightning AI
AI Infrastructure
Cloud platform for building, training and deploying AI models with studios and GPUs
SaaS
NVIDIA AI Enterprise
AI Infrastructure
Software suite of NIM microservices, frameworks and tools for running production AI
SaaS

