Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
-
Updated
Oct 8, 2026 - Go
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
Android native AI inference library, bringing text, image, video, STT, TTS inference
A UI for stable-diffusion.cpp.
A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp
single-executable / library which combines llama.cpp, whisper.cpp, and stable-diffusion.cpp
Examples using the llmedge library
An experimental nanobind wrapper around llama.cpp, whisper.cpp, and stable-diffusion.cpp
Self-hosted AI image and video generation for AMD Ryzen AI APUs on Linux: Vulkan (Mesa RADV) via stable-diffusion.cpp, no ROCm. Web UI with queue, model manager, multi-user auth and system diagnostics.
Edit photos by describing the change, on your own GPU. One installer, no Python, no cloud. Qwen-Image 2.1 for Windows and Mac, with an MCP server for AI agents.
python package to build a ggml/llama.cpp/whisper.cpp/stable-diffusion.cpp stack
以 stable-diffusion.cpp 在本機推論 Qwen-Image 2.1 GGUF,提供 OpenAI 相容的圖片生成與編輯 API(/v1/images/generations、/v1/images/edits),並附 Makefile 一鍵安裝、下載模型、驗證與啟動服務
Local-first agent orchestration for small models: isolated roles, one persistent Order Ledger, temporary consume-once phase-ledger handoffs, frozen tasks, evidence-based review and single-GPU specialists.
Open-source AI film studio that runs the models itself — no API key. One sentence in, a finished film out: story, script, storyboard, video, voice, subtitles, on your own GPU. One binary, Apache-2.0. 不用 API Key 的开源 AI 电影 / 短剧工作室:一句话拍成一部片子,模型在你自己的电脑上跑。
A tiny C++17 / ggml image generator for FLUX.2 [klein] by Black Forest Labs, built on top of stable-diffusion.cpp. No Python, no PyTorch at build or run time, runs on both GPU, or CPU-only targets
FLAI is a self-hosted, privacy-first AI platform. Your all-in-one local assistant: smart chat, web search, voice, media generation, and document analysis. Offers long-term memory, Model Hub, and OpenAI API. Fully optimized for GPU and CPU environments.
Plug-and-play Stable Diffusion engine (sd-cli first: CUDA/ROCm/Vulkan/CPU) with Gradio WebUI
Route multiple machines to appear as a single and provide models + configs as model options for seamless switching.
Bulk AI image generation on your own Windows PC: FLUX.2, Qwen-Image, SDXL and more via stable-diffusion.cpp. Batches, reference images, LoRAs, upscaling, an OpenAI-compatible API and an MCP server for AI agents. No cloud, no account.
Seven local-inference studies on one 32 GB Apple Silicon machine: what ships, what it costs, and how it fails.
Pre-built stable-diffusion.cpp binaries for Leaxer
To associate your repository with the stable-diffusion-cpp topic, visit your repo's landing page and select "manage topics."