Pinned Loading

1. gpustack gpustack Public

   A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.

   Python 5k 525

2. runner runner Public

   Collection of Dockerfiles to build images for various inference services across different accelerated backends.

   Dockerfile 13 9

3. runtime runtime Public

   Provides a unified interface to detect GPU resources and manages GPU workloads.

   Python 14 16

4. gguf-parser-go gguf-parser-go Public

   Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

   Go 266 24

5. vox-box vox-box Public

   A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

   Python 210 33