Get in Touch
 Duration 14 hours

Course Outline

LLM Architecture and Attack Surface Overview

  • The construction, deployment, and API access mechanisms of LLMs
  • Key components within LLM application stacks (e.g., prompts, agents, memory, APIs)
  • Real-world scenarios where security issues emerge

Prompt Injection and Jailbreak Attacks

  • Defining prompt injection and assessing its risks
  • Analyzing direct and indirect prompt injection scenarios
  • Examining jailbreaking techniques used to bypass safety filters
  • Strategies for detection and mitigation

Data Leakage and Privacy Risks

  • Preventing accidental data exposure through model responses
  • Mitigating PII leaks and improper model memory usage
  • Designing privacy-conscious prompts and retrieval-augmented generation (RAG) systems

LLM Output Filtering and Guarding

  • Implementing content filtering and validation with Guardrails AI
  • Establishing output schemas and constraints
  • Monitoring and logging unsafe outputs

Human-in-the-Loop and Workflow Approaches

  • Determining optimal points for human oversight
  • Managing approval queues, scoring thresholds, and fallback handling
  • Calibrating trust and leveraging explainability

Secure LLM App Design Patterns

  • Applying least privilege and sandboxing to API calls and agents
  • Implementing rate limiting, throttling, and abuse detection
  • Achieving robust chaining with LangChain and prompt isolation

Compliance, Logging, and Governance

  • Ensuring the auditability of LLM outputs
  • Maintaining traceability through prompt and version control
  • Aligning systems with internal security policies and regulatory requirements

Summary and Next Steps

Requirements

  • A solid understanding of large language models and prompt-based interfaces.
  • Experience in building LLM applications using Python.
  • Familiarity with API integrations and cloud-based deployment strategies.

Target Audience

  • AI developers
  • Application and solution architects
  • Technical product managers working with LLM tools

Number of participants


Price per participant (excl. VAT)

Upcoming Courses

Related Categories