Repository navigation
feat: add Unsloth Studio provider (local OpenAI-compatible runtime) - #11692
Open
yannickloth wants to merge 3 commits into
Open
yannickloth wants to merge 3 commits into
yannickloth wants to merge 3 commits into
Conversation
Contributor
Action items
|
…t reasoning support only
- logo.svg: official Unsloth mark from unslothai/unsloth (AGPL-3.0),
embedded as data URI per the atomic-chat precedent (image is on the
logo allowlist); provenance commented in-file.
- qwen3-30b-a3b-2507: remove knowledge (lab fact, not a host override).
- gpt-oss-20b: reasoning = { supported = true } only — Unsloth's
llama-server /v1 surface documents no per-request effort control.
Author
|
All three action items addressed in e0f52ff:
|
Contributor
Action items
|
…ed reasoning effort - logo.svg: compliant currentColor vector redraw of the official badge (simplified monochrome: badge ring, sloth-head cutout, eye-patch islands, stroked smile); no fixed size, square viewBox. - gpt-oss-20b: reasoning effort per live probe of /v1/chat/completions (server validates reasoning_effort with none/minimal/low/medium/high/ max/xhigh); drop copied description. - qwen files: drop copied name/description, inherit from base_model.
Author
|
All four items addressed in d691ce1:
|
Contributor
Action items
|
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds
unsloth-studioas a provider: Unsloth Studio is a local model runtime (Desktop app / web UI, llama-server-backed) that exposes an OpenAI-compatible API onlocalhost(default port8888, per their opencode integration docs; the API docs say "typically 8000 or 8888").Entry mirrors the existing local-runtime precedent (
providers/lmstudio/):provider.toml:@ai-sdk/openai-compatible+@opencode/ai/providers/openai-compatible,api = "http://127.0.0.1:8888/v1",env = ["UNSLOTH_API_KEY"](documented in their unsloth-start reference: "--api-keySupply a Unsloth API key. You can also setUNSLOTH_API_KEY."), sources commented in-file.gpt-oss-20b,qwen3-coder-30b,qwen3-30b-a3b-2507), zero-cost like LM Studio's local entries. A provider must have at least one model for the v1 generator, but the live inventory of a local runtime is per-machine — the header comment says so explicitly, and opencode discovers it at runtime.Validation
bun validate: passes.bun run v1:check: exits 1 with a purely additive diff, as expected for any new provider:Context
Filed anomalyco/opencode#59557 requesting runtime model discovery for Unsloth Studio in opencode (the same mechanism Ollama/LM Studio/vLLM get via
createLocalProviderPlugin). This catalog entry gives the static/connectsurface; discovery covers the dynamic per-machine inventory.