Vulnerable LLM Applications

Links to current available vulnerable LLM applications that contain useful educational materials and training exercises relevant to the project. Special thanks 🙏🏾 to @Anugrah SR 🐦‍🔥 for helping curate this list ! 🏆Team tested & recommended

Please add to this list! (in no particular order)

• Lakera Gandalf 🏆
• PortSwiger Web LLM Attacks🏆
• @hxs220034/DamnVulnerableLLMApplication-Demo 🏆
• Rebuff Playground for prompt injection 🏆
• Damn Vulnerable LLM Agent
• Immersivelabs🏆
• GPT Prompt Attack🏆 System Prompt
• Crucible by Dreadnode🏆
• Pokébot, A Damn Vulnerable GenAI RAG App🏆 if you are looking for RAG issues
• Prompt Airline by Wiz🏆
• DEF CON CTF
• @hxs220034/SecureLLMCTF
• @harishsg993010/SecureLLM
• HadessCS/Delta
• wrongsecrets LLM challenges
• @h43z GPT Prompt Attack
• svenmorgenrothio Prompt Injection Playground
• Yudbot - Convince Yud to sell you a GPU cluster
• HackAPrompt Prizes but requires lengthy login process and your own API key-
• Google CyberBotLLM Gemini
• Tensor Trust — open-source project for testing prompt injection
• Machine Learning CTF Challenges