
Ray
Ray is an open source framework for managing, executing, and optimizing compute needs, designed to support any AI or ML workload.
- GitHub stars
- 44k
- Last commit
- yesterday
- Latest release
- ray-2.60.0
- Licence
- Apache-2.0
- Self-hosted
- Yes
- Hosted version
- Available

Ray is an AI compute engine that consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. It is Python-native and built by developers for developers, designed to orchestrate infrastructure for distributed workloads on any accelerator at any scale.
The platform aims to address the AI Complexity Wall by supporting any AI or ML workload, any data types and model architectures, and heterogeneous GPUs and CPUs with fine-grained scaling. It can scale from a laptop to thousands of GPUs.
Key features
- Supports any AI or ML workload
- Handles multi-modal data processing including images, videos, audio
- Runs distributed training for Gen AI foundation models, time series models, and traditional AI/ML models
- Offers model serving with independent scaling and fractional resources via Ray Serve
- Supports batch inference with heterogeneous compute using CPUs and GPUs


























