PromptTrace

Damn Vulnerable LLM Agent

Damn Vulnerable LLM Agent is a sample chatbot powered by a Large Language Model (LLM) ReAct agent, implemented with Langchain. It serves as an educational tool to help security professionals understand and test vulnerabilities in AI agents, specifically focusing on prompt injection techniques that can manipulate agent behavior. ## Key Features - **Vulnerable Chatbot Simulation** — Provides a controlled environment to interact with a deliberately insecure LLM agent. - **Prompt Injection Experimentation** — Allows testing of various injection vectors, including Thought/Action/Observation injection. - **Educational CTF Challenge** — Based on a Capture The Flag competition, offering practical examples of security exploits. - **Multi-LLM Support** — Configurable to run with OpenAI, HuggingFace models, or local Ollama instances. ## Philosophy The project believes that understanding attack vectors through hands-on experimentation is crucial for building secure AI systems, and aims to provide a practical learning ground for the security community.

AI/LLM Exploitation Challenges

AI, ML, and LLMs CTF Challenges

CrowdStrike AI Unlocked

Released Feb 2026, designed to train security, developer, and AI teams on prompt injection against increasingly capable agents. Built by CrowdStrike's Counter Adversary Operations team

Gandalf

Your goal is to make Gandalf reveal the secret password for each level. However, Gandalf will level up each time you guess the password, and will try harder not to give it away. Can you beat level 7? (There is a bonus level 8)