Gguf
3 projects
Showing 3 of 3 projects
llama.cppC++
A C/C++ library for efficient, cross-platform LLM inference with extensive hardware support and quantization.
#cuda#ggml#metal
Stars108.0k
Forks17.7k
Last commit10 hours ago
shimmyRust
A lightweight, single-binary Rust inference server providing 100% OpenAI-API compatible endpoints for local GGUF models.
#safetensors#privacy-first#lora
Stars4.7k
Forks426
Last commit1 month ago
NobodyWhoRust
A library for running LLMs locally and efficiently on any device with support for Python, Flutter, and Godot.
#python-llm#gguf#llama-cpp
Stars861
Forks56
Last commit1 day ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.