ai-prompt-ctf by c-goosen

Damn Vulnerable LLM Agent

Damn Vulnerable LLM Agent is a sample chatbot powered by a Large Language Model (LLM) ReAct agent, implemented with Langchain. It serves as an educational tool to help security professionals understand and test vulnerabilities in AI agents, specifically focusing on prompt injection techniques that can manipulate agent behavior. ## Key Features - **Vulnerable Chatbot Simulation** — Provides a controlled environment to interact with a deliberately insecure LLM agent. - **Prompt Injection Experimentation** — Allows testing of various injection vectors, including Thought/Action/Observation injection. - **Educational CTF Challenge** — Based on a Capture The Flag competition, offering practical examples of security exploits. - **Multi-LLM Support** — Configurable to run with OpenAI, HuggingFace models, or local Ollama instances. ## Philosophy The project believes that understanding attack vectors through hands-on experimentation is crucial for building secure AI systems, and aims to provide a practical learning ground for the security community.

PromptTrace

Free AI security training platform with 7 hands-on prompt injection labs and a 15-level CTF (the Gauntlet) with progressively harder defenses — from prompt-level rules to code guards to LLM classifiers. Unique feature: Context Trace shows the full prompt stack (system prompt, RAG documents, tool definitions, user input) in real-time so you can see exactly how attacks work. Uses real LLMs from OpenAI, Anthropic, Google, Groq, and Cerebras

AI/LLM Exploitation Challenges

AI, ML, and LLMs CTF Challenges

CrowdStrike AI Unlocked

Released Feb 2026, designed to train security, developer, and AI teams on prompt injection against increasingly capable agents. Built by CrowdStrike's Counter Adversary Operations team