Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
LLM Architecture and Attack Surface Overview
- The construction, deployment, and API access mechanisms of LLMs
- Key components within LLM application stacks (e.g., prompts, agents, memory, APIs)
- Real-world scenarios where security issues emerge
Prompt Injection and Jailbreak Attacks
- Defining prompt injection and assessing its risks
- Analyzing direct and indirect prompt injection scenarios
- Examining jailbreaking techniques used to bypass safety filters
- Strategies for detection and mitigation
Data Leakage and Privacy Risks
- Preventing accidental data exposure through model responses
- Mitigating PII leaks and improper model memory usage
- Designing privacy-conscious prompts and retrieval-augmented generation (RAG) systems
LLM Output Filtering and Guarding
- Implementing content filtering and validation with Guardrails AI
- Establishing output schemas and constraints
- Monitoring and logging unsafe outputs
Human-in-the-Loop and Workflow Approaches
- Determining optimal points for human oversight
- Managing approval queues, scoring thresholds, and fallback handling
- Calibrating trust and leveraging explainability
Secure LLM App Design Patterns
- Applying least privilege and sandboxing to API calls and agents
- Implementing rate limiting, throttling, and abuse detection
- Achieving robust chaining with LangChain and prompt isolation
Compliance, Logging, and Governance
- Ensuring the auditability of LLM outputs
- Maintaining traceability through prompt and version control
- Aligning systems with internal security policies and regulatory requirements
Summary and Next Steps
Requirements
- A solid understanding of large language models and prompt-based interfaces.
- Experience in building LLM applications using Python.
- Familiarity with API integrations and cloud-based deployment strategies.
Target Audience
- AI developers
- Application and solution architects
- Technical product managers working with LLM tools