Llama Cpp

gpt4allC++

Run large language models (LLMs) privately on everyday desktops and laptops without requiring API calls or GPUs.

TurboPilotC++

An open-source, locally-runnable code completion engine using large language models that works on CPU.

LLamaSharpC#

A C#/.NET library for efficient local inference of LLaMA and other large language models, based on llama.cpp.

NobodyWhoRust

A library for running LLMs locally and efficiently on any device with support for Python, Flutter, and Godot.

tenereRust

A terminal user interface (TUI) for interacting with multiple large language model backends, featuring Vim keybindings and chat history.

minja.hppC++

A minimalistic C++ Jinja templating engine specifically designed for LLM chat templates, used in llama.cpp and other projects.