Fast state-of-the-art image and video segmentation in portable C/C++

Mount Hugging Face Buckets and repos as local filesystems. No download, no copy, no waiting.

Portable C++17 implementation of ACE-Step 1.5 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.

A C++17 single-file header-only wrapper for llama.cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

A free, open source, and extensible speech-to-text application that works completely offline.

A cosy home for your LLMs.

Audio playback and capture library written in C, in a single source file.

Local LLM-assisted text completion for Qt Creator.

Simple GUI around whisper.cpp for voice-to-text on Linux

Local LLM-assisted text completion for Qt Creator.

MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.

Low-latency AI engine for mobile devices & wearables

Emacs package for LLM-assisted code/text completion

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

The application performs real-time inference on audio from an ALSA capture device

TTS support with GGML

LLM plugin for interacting with llama-server models

Running any GGUF SLMs/LLMs locally, on-device in Android

DINOv2 inference engine written in C/C++ using ggml and OpenCV.

Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

Real-time webcam demo with SmolVLM and llama.cpp server

📎 Clippy, now with some AI

Command to convert from color text (ANSI or 256) to image.

Simple frontend for LLMs built in react-native.

Speech-to-text transcription VST3/ARA plugin