Llama3

OllamaGo

A platform to run, manage, and serve open-source large language models (LLMs) locally or on your own infrastructure.

OllamaGo

A platform to run, manage, and serve open-source large language models locally with a simple CLI and REST API.

unslothPython

A web UI and optimization library for running and fine-tuning open-source AI models locally with 2x faster training and 70% less VRAM.

LLamaSharpC#

A C#/.NET library for efficient local inference of LLaMA and other large language models, based on llama.cpp.

MaxTextPython

A high-performance, scalable LLM library and reference implementation written in pure Python/JAX for training on TPUs and GPUs.