All pull requests

Pull requests

• Support M6/32 GiB Flint, oQ3e selection and prefill throughput

  #54·siilats opened Nov 7, 2026·

  ·

• Warn about other rec commands instead of refusing to install

  #53·NopeCharon opened Nov 6, 2026·

  ·
  1

• Accept replayed reasoning aliases without rejecting messages

  #52·strin opened Nov 5, 2026·

  ·
  1

• Fix chunked request bodies on both model APIs

  #51·strin opened Nov 5, 2026·

  ·
  1

• perf(rec_mlx): exact sub-4K prefix rewind, multi-branch LRU cache, and wired Metal residency

  #50·oniisanlabs opened Nov 4, 2026·

  ·

• perf(rec_mlx): optimize M5 Pro prefill (+40.8%), decode kernels, and GPU core scaling

  #49·oniisanlabs opened Nov 3, 2026·

  ·

• Support for oh-my-pi (omp) as a harness with rec launch omp

  #47·daniel-sali opened Nov 2, 2026·

  ·

• Draft: Integrate liked prs

  #45·siilats opened Oct 28, 2026·

  ·

• Ship a macOS 15 build alongside the macOS 26 build

  #44·berendkleinhaneveld opened Oct 28, 2026·

  ·
  1

  2

• feat: add native Flint HIP serving

  #43·alexhegit opened Oct 28, 2026·

  ·
  1

• Reuse/shrink KVStorage across prefix misses and bound prefill/stream memory

  #42·Wildebeest opened Oct 27, 2026·

  ·

• Bump mlx to 0.32.4 and nanobind to 3.1.0

  #41·Wildebeest opened Oct 27, 2026·

  ·

• Reject unsupported structured response formats

  #40·gezerui888 opened Oct 27, 2026·

  ·
  1

  1

• Add a thinking_budget request field

  #32·yweng-sct opened Oct 25, 2026·

  ·
  1

  1

• Add rec serve --host to choose the listen address

  #31·wcole3 opened Oct 24, 2026·

  ·
  1

• Add experimental Linux/ROCm backend for Flint

  #29·zihaomu opened Oct 24, 2026·

  ·

• Use the causal mask mode for global-layer prefill attention

  #25·tc3oliver opened Oct 24, 2026Contributor·

  ·

• Keep 64 prefix checkpoints so new sessions reuse a shared preamble

  #24·pedro-pscunha opened Oct 24, 2026·

  ·

• Share one sort between top_p and top_k sampling

  #23·tc3oliver opened Oct 24, 2026Contributor·

  ·

• Resolve each KV address once per token in long-context attention

  #22·tc3oliver opened Oct 23, 2026Contributor·

  ·

• Skip fully masked key tiles in sliding-window prefill attention

  #21·tc3oliver opened Oct 23, 2026Contributor·

  ·

• Add host binding option for server and update related documentation

  #18·eddyger opened Oct 23, 2026·

  ·

• Add Apple M2 Max support via native MLX decoding

  blockedenhancementhardware_support
  #16·nocmt opened Oct 23, 2026·

  ·
  2

• Add opt-in residual-stream steering and a projection probe

  #14·audreyt opened Oct 23, 2026Contributor·

  ·
  1

• Add Apple M3 Max support

  blockedenhancementhardware_support
  #7·rcwtf opened Oct 22, 2026·

  ·
  1