Pinned Loading

1. aphrodite-engine aphrodite-engine Public

   Forked from aphrodite-engine/aphrodite-engine

   Large-scale LLM inference engine

   Python

2. exllamav2 exllamav2 Public

   Forked from turboderp-org/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python

3. koboldcpp koboldcpp Public

   Forked from LostRuins/koboldcpp

   A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

   C++

4. turboderp-org/exllamav2 turboderp-org/exllamav2 Public

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python 4k 305

5. aphrodite-engine/aphrodite-engine aphrodite-engine/aphrodite-engine Public

   Large-scale LLM inference engine

   C++ 1.3k 149