COURSE PREVIEWAbout this course
In Red Teaming AI Apps with Promptfoo: RAG, Chatbots & Agents, you will learn how to systematically identify and test vulnerabilities using Promptfoo, an open-source framework for AI evaluation and red teaming.
This is a practical, application-focused course. Instead of working only with isolated prompts, we will attack a real AI-powered e-commerce application called EA SmartKart. The application includes an LLM-powered shopping assistant, product recommendations, shopping-cart operations, order information, RAG-based product retrieval, embeddings, and a vector database.
What you will learn
Understand the fundamentals of AI red teaming and why traditional testing alone is insufficient
Understand important OWASP risks for LLM-powered applications
Install and configure Promptfoo from scratch
Test real HTTP-based AI applications with Promptfoo
Configure targets, providers, plugins, policies, strategies, graders, and assertions
Write application-specific security and business policies
Run single-turn and multi-turn attacks
Use Meta Jailbreak, Hydra, and Crescendo strategies
Test PII leakage, excessive agency, bias, hallucination, and business-rule violations
Red team RAG applications for source attribution, context injection, and data poisoning
Work with local LLMs as well as cloud-based model providers
Analyze Promptfoo reports and understand why individual attacks pass or fail
Build repeatable AI security tests suitable for regression testing and continuous evaluation
This course is designed for QA engineers, SDETs, automation engineers, developers, AI engineers, security testers, and anyone building or testing LLM-powered applications.
You do not need prior red-team experience. We start with the fundamentals and progressively move into real-world and advanced AI security testing.
If you want to move beyond simply asking whether an AI application works, and start asking how it can be broken, manipulated, or misused, this course will give you a practical path to doing exactly that.
What you'll learn
- Understand AI red teaming fundamentals and how Promptfoo tests RAG apps, chatbots, and AI agents.
- Configure Promptfoo targets, providers, plugins, policies, strategies, assertions, and red-team workflows.
- Run attacks for PII leakage, hallucination, excessive agency, hijacking, prompt injection, and policy violations.
- Test RAG applications for grounding, source attribution, indirect prompt injection, and knowledge-base poisoning.
- Use hosted and local red-team providers, including Promptfoo, MiniMax, and Ollama-based local LLMs.
- Generate, evaluate, and analyze Promptfoo red-team reports to identify and improve AI application security.
Before you begin
- No previous AI security or red-team experience is required; the course starts with the fundamentals.
- Basic understanding of Generative AI, LLMs, or chatbot applications is helpful but not required.
- Basic familiarity with the command line and running npm commands is recommended.
- A computer capable of running Node.js and Promptfoo is required.
Who this is for
- QA engineers, SDETs, and test automation engineers who want to add AI security and red-team testing to their skill set.
- Developers building RAG applications, LLM-powered chatbots, or AI agents who want to test them for security weaknesses.
- AI engineers and GenAI developers who want hands-on experience with Promptfoo red-team testing.
- Security testers who want to learn practical adversarial testing techniques for modern AI applications.
- 1. Anyone interested in learning AI red teaming from scratch using a practical, configuration-first approach.
How do you feel about this course?
Share your reaction. Select one emoji to leave or update your rating.
Please wait 30 seconds to explore this course.
This course opens on an external website.
Join the conversation
Share a thought or question. No account required.
Be the first to share your thoughts.
