Llama Cpp

gpt4allC++

Run large language models (LLMs) privately on everyday desktops and laptops without requiring API calls or GPUs.

TurboPilotC++

An open-source, locally-runnable code completion engine using large language models that works on CPU.

LLamaSharpC#

A C#/.NET library for efficient local inference of LLaMA and other large language models, based on llama.cpp.

NobodyWhoRust

A library for running LLMs locally and efficiently on any device with support for Python, Flutter, and Godot.

tenereRust

A terminal user interface (TUI) for interacting with multiple large language model backends, featuring Vim keybindings and chat history.

minja.hppC++

A minimalistic C++ Jinja templating engine specifically designed for LLM chat templates, used in llama.cpp and other projects.

LLMKubeGo

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

omarchy-aiShell

A one-command installer that transforms a fresh Arch Linux installation into a complete, local-first AI development environment with Hyprland.

ExLLamaElixir

Elixir NIF wrapper for llama_cpp.rs enabling GGUF model inference in Elixir/Erlang applications.

localaikGo

A local compatibility server that provides a subset of the Gemini and OpenAI APIs for testing and development, backed by a local LLM.