Stars
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Heterogeneous AI Computing Virtualization Middleware