Local Llm
Showing 22 of 22 projects
An open-source platform for building, collaborating with, and evolving personalized AI agent teams.
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
A privacy-focused AI answering engine that runs on your own hardware, combining web search with local and cloud LLMs.
An LLM acceleration library for Intel XPU (GPU, NPU, CPU) to speed up local inference and finetuning of popular models.
An AI-powered research assistant that performs deep, agentic research using multiple LLMs and search engines with full local deployment and encryption.
A lightweight, single-binary Rust inference server providing 100% OpenAI-API compatible endpoints for local GGUF models.
An Obsidian plugin that integrates ChatGPT, OpenRouter.ai, and local LLMs for AI-powered conversations directly within your notes.
Minuet is a Neovim plugin that provides AI-powered code completion from multiple LLM providers, including OpenAI, Gemini, Claude, and local models.
An open-source ChatGPT alternative that runs 100% offline on your computer with local LLMs or cloud model connections.
An Emacs org-mode minor mode that integrates generative AI models like ChatGPT, DALL-E, and Stable Diffusion for text and image generation.
A CLI tool that uses AI to automatically categorize, rename, and organize files based on their content.
A collection of iOS sample apps demonstrating Generative AI capabilities including OpenAI, local LLMs, Stable Diffusion, and speech recognition.
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
A visual AI workflow automation platform with drag-and-drop interface and local LLM integration, requiring no cloud dependencies.
A zero-code desktop app for locally fine-tuning LLMs on Apple Silicon, with privacy-first data preparation and MLX-powered training.
A native desktop application for running large language models locally with Rust and Tauri, offering private AI chat without internet or cloud services.
An Elixir library providing a unified interface to interact with multiple generative AI providers, including local models, with extensible plugin support.
A PowerToys Run plugin that enables querying local LLMs via Ollama endpoints directly from the launcher.
An open-source browser extension that provides AI-powered contextual insights, content summarization, and chat using local Ollama models for privacy.
Translate code comments and strings in Neovim using online or local LLMs and external translators.
A local compatibility server that provides a subset of the Gemini and OpenAI APIs for testing and development, backed by a local LLM.
An AI-powered Zsh plugin for intelligent CLI command completion using locally-run LLMs with LoRA fine-tuning.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.