Base Compute · Documentation
BaseRT
The fastest LLM inference runtime for Apple Silicon. Pull a model from HuggingFace, chat with it, or serve an OpenAI-compatible API
$ curl -LsSf https://basecompute.co/install.sh | shInstallInstallationGet the engine and the BaseRT CLI onto your PATH.Start hereQuickstartPull a model and chat in under a minute.ServeServing an APIRun the OpenAI-compatible server for chat, completions, and more.ReferenceCLI referenceEvery BaseRT command and flag.IntegrateBindingsPython, Node, Rust, and Swift over a stable C API.ReferenceServer APIThe OpenAI-compatible HTTP endpoints in detail.