

Exo · od 24.06.2024 (erste öffentliche Veröffentlichung auf GitHub) · 2× · naposledy 12. 11. 2026
27
Momentum
exo is open-source software from Exo Labs (London) that connects multiple devices, primarily Apple Silicon Macs plus Linux and other hardware, into a local AI cluster. Models too large for one device are split across devices via tensor or pipeline parallelism, and the cluster is managed through an API and a dashboard.
Vývoj momenta
17.08.15.11.
Vlastnosti
| Throughput/Latency | Tensor parallelism: up to 1.8x speedup on 2 devices, 3.2x on 4; DeepSeek V3 671B (4-bit) on 8x M4 Pro Mac Mini: 5.37 tokens/s, TTFT 2.91 s |
| License | Apache 2.0 (EXO 1.0 open source) |
| Platform | macOS (Apple Silicon, app requires macOS Tahoe 26.2+), Linux (from source); Homebrew install also available |
| Protocol Compatibility | OpenAI-, Claude- and Ollama-compatible APIs; ChatGPT-compatible API on localhost:52415 |
| Release Date | June 24, 2024 (first public GitHub release) |
| Supported Models/Providers | MLX and tinygrad backends; incl. LLaMA, Mistral, Qwen, DeepSeek, LLaVA; Kimi K2.5, MiniMax M2.1 (v1.0.67) |