Get in Touch
 Duration 14 hours

Course Outline

Introduction to AI Red Teaming

  • Understanding the AI threat landscape
  • The role of red teams in AI security
  • Ethical and legal frameworks

Adversarial Machine Learning

  • Attack categories: evasion, poisoning, extraction, and inference
  • Creating adversarial examples (e.g., FGSM, PGD)
  • Targeted vs. untargeted attacks and performance metrics

Evaluating Model Robustness

  • Assessing robustness against perturbations
  • Identifying model blind spots and failure modes
  • Stress testing for classification, vision, and NLP models

Red Teaming AI Pipelines

  • The attack surface of AI pipelines: data, model, and deployment layers
  • Exploiting insecure model APIs and endpoints
  • Reverse engineering model behavior and outputs

Simulation and Tooling

  • Utilizing the Adversarial Robustness Toolbox (ART)
  • Conducting red teaming with tools such as TextAttack and IBM ART
  • Sandboxing, monitoring, and observability utilities

AI Red Team Strategy and Defense Collaboration

  • Developing red team exercises and objectives
  • Communicating findings to blue teams
  • Integrating red teaming into AI risk management

Summary and Next Steps

Requirements

  • Knowledge of machine learning and deep learning architectures
  • Proficiency with Python and ML frameworks (such as TensorFlow and PyTorch)
  • Familiarity with cybersecurity principles or offensive security methods

Target Audience

  • Security researchers
  • Offensive security teams
  • AI assurance and red team specialists

Number of participants


Price per participant (excl. VAT)

Testimonials (3)

Upcoming Courses

Related Categories