exo
Distributed AI inference across multiple devices, enabling clusters of Macs/iPhones/iPads to run large models.
📋 Info
| GitHub Stars | ⭐ 45.2k Stars |
| License | Apache-2.0 |
| Language | Python |
| Version | 1.0 |
| Updated | 2026-06-08 |
📖 Overview
Exo is a unique multi-device distributed AI inference tool that automatically connects your Mac, iPhone, iPad, or even an old laptop to form a virtual "large GPU" cluster for running models with extremely high parameter counts. It discovers devices via peer-to-peer networking and intelligently distributes model layers without requiring complex configurations. Privacy is prioritized, as all data transfers occur between local devices rather than being uploaded to the cloud. It’s particularly suitable for users with multiple Apple devices at home who want to make full use of their idle computing power.
✨ Features
- Automatic network setup across multiple devices
- point-to-point distributed inference
- Privacy first
- Running large language models on consumer-grade devices
- It supports Llama, Qwen, and DeepSeek.
Advertisement