Local Deploy
Offline Deployment Tools
Enable your local device to serve as a smart brain.
| Rank | Tool | Stars | Description | Details |
|---|---|---|---|---|
| 1 | Ollama | ⭐ 173.6k | One-click local execution for over 100 large language models including Llama, Mi | Details |
| 2 | Open WebUI | ⭐ 140.7k | The most feature-rich self-hosted AI platform, supporting Ollama/OpenAI APIs and | Details |
| 3 | vLLM | ⭐ 82.2k | A high-throughput LLM inference engine whose PagedAttention technology boosts GP | Details |
| 4 | GPT4All | ⭐ 77.4k | A desktop application for running LLMs locally with zero configuration, requirin | Details |
| 5 | exo | ⭐ 45.2k | Distributed AI inference across multiple devices, enabling clusters of Macs/iPho | Details |