Skip to content

feat: add native Flint HIP serving - #43

Open
alexhegit wants to merge 33 commits into
recursive-oss:mainfrom
alexhegit:feat/flint-native-hip
Open

alexhegit wants to merge 33 commits into
recursive-oss:mainfrom
alexhegit:feat/flint-native-hip

Conversation

@alexhegit

Copy link
Copy Markdown

Summary

  • add the native gfx1151 Flint runtime target and local-only checkpoint serving
  • bind packaging to reviewed runtime source, tree, binary digest, and runtime contract
  • update the trusted runtime to Flint f09b8f0 with Anthropic API and bounded two-session continuous batching

Verification

  • make test-cli
  • package policy and forged-runtime rejection tests
  • real 22.57GB checkpoint load on Radeon 8060S / gfx1151
  • OpenAI non-stream pair
  • OpenAI + Anthropic streaming pair
  • simultaneous strict tools
  • disconnect peer isolation and recovery

The production checkpoint remains local-only and is not included.

@alexey-rsi

Copy link
Copy Markdown

Hi @alexhegit ,

Thanks for the PR! However, we're only planning to merge things that we can thoroughly test and we don't have access to your GPUs of interest at the moment. So will have to close this for now, we may address it down the line. This PR can serve as unofficial example for others, of course

Best,
Alexey

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants