Skip to content

feat(core): discover vLLM models - #43022

Merged
nexxeln merged 3 commits into
v2from
vllm-provider
Aug 17, 2026
Merged

nexxeln merged 3 commits into
v2from
vllm-provider

Conversation

@nexxeln

@nexxeln nexxeln commented Aug 17, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add a built-in vLLM provider that checks /health and discovers extended ModelCards from /v1/models
  • project served model IDs and max_model_len with process-wide polling deduplication
  • support custom endpoints, path-prefixed proxies, bearer authentication, and live config reloads
  • replace and restore same-ID Models.dev entries based on successful live discovery
  • conservatively avoid advertising tools or vision because vLLM does not expose its server launch capabilities
  • document zero-config and configured vLLM discovery

Testing

  • bun test in packages/core (1840 passed, 9 skipped)
  • bun typecheck in packages/core
  • repository-wide pre-push typecheck
  • targeted Oxlint and Prettier checks
  • V2 docs validation and production build
  • branch server smoke test against a congruent vLLM mock: readiness, discovery, and streamed /api/generate response

@nexxeln
nexxeln merged commit cc53db4 into v2 Aug 17, 2026
8 checks passed
@nexxeln
nexxeln deleted the vllm-provider branch August 17, 2026 12:26
jinhuang712 pushed a commit to jinhuang712/opencode that referenced this pull request Sep 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant