Llamacpp
4 projects
Showing 4 of 4 projects
shimmyRust
A lightweight, single-binary Rust inference server providing 100% OpenAI-API compatible endpoints for local GGUF models.
#safetensors#privacy-first#lora
Stars5.3k
Forks496
Last commit5 days ago
LLamaSharpC#
A C#/.NET library for efficient local inference of LLaMA and other large language models, based on llama.cpp.
#llava#llama3#csharp
Stars3.7k
Forks499
Last commit7 days ago
tenereRust
A terminal user interface (TUI) for interacting with multiple large language model backends, featuring Vim keybindings and chat history.
#developer-tools#ratatui#terminal
Stars668
Forks34
Last commit21 days ago
iOS-GenAI-SamplerSwift
A collection of iOS sample apps demonstrating Generative AI capabilities including OpenAI, local LLMs, Stable Diffusion, and speech recognition.
#ios#metal#openai
Stars157
Forks15
Last commit7 months ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.