Garak
A command-line tool for red-teaming and vulnerability scanning of large language models (LLMs).
What is Garak?
Garak is a command-line vulnerability scanner designed specifically for large language models (LLMs). It systematically probes LLMs for security weaknesses including hallucination, data leakage, prompt injection, toxicity generation, and jailbreak vulnerabilities. The tool helps developers and security teams assess the robustness of their LLM deployments against various attack vectors.
AI security researchers, ML engineers deploying LLMs in production, and red teams responsible for assessing the security of generative AI systems. It's particularly valuable for organizations using commercial or open-source LLMs that need to understand model vulnerabilities.
Garak provides a comprehensive, open-source framework for LLM security testing with extensive probe coverage and support for numerous model providers. Unlike generic security tools, it's specifically designed for the unique attack surfaces of large language models with a modular architecture that allows for custom testing scenarios.
Overview
the LLM vulnerability scanner
Use Cases
Best For
- Security teams conducting red-team assessments of LLM deployments
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.