Fine Tuning

unslothPython

A web UI and optimization library for running and fine-tuning open-source AI models locally with 2x faster training and 70% less VRAM.

llama-indexPython

An open-source framework for building LLM-powered applications with data ingestion, indexing, and retrieval capabilities.

BERTPython

TensorFlow implementation and pre-trained models for BERT, a bidirectional Transformer for language understanding.

FinGPTJupyter Notebook

An open-source framework for financial large language models, enabling cost-effective fine-tuning for tasks like sentiment analysis and forecasting.

TRLPython

A comprehensive library for post-training foundation models using reinforcement learning and fine-tuning techniques.

Vision TransformerJupyter Notebook

Official JAX/Flax implementation of Vision Transformer (ViT) and MLP-Mixer for image recognition, with pre-trained models.

go-openaiGo

Unofficial Go client library for the OpenAI API, supporting ChatGPT, GPT-4, DALL·E, Whisper, and more.

NebullvmPython

A collection of libraries to optimize AI model performance through inference acceleration, infrastructure efficiency, and fine-tuning optimization.

LLM Engineer Handbook

A curated collection of resources for building, training, serving, and optimizing production-grade Large Language Model applications.

Hands-on LLMs: Train and Deploy a Real-time Financial AdvisorJupyter Notebook

A free course teaching how to design, train, and deploy a production-ready real-time financial advisor LLM system using RAG and LLMOps.

MaxTextPython

A high-performance, scalable LLM library and reference implementation written in pure Python/JAX for training on TPUs and GPUs.

PenzaiPython

A JAX research toolkit for building, editing, and visualizing neural networks as legible, functional pytree data structures.

aitextgenPython

A Python package for fine-tuning and generating text with GPT-2 and GPT Neo models using PyTorch and Hugging Face Transformers.