Course Outline
Foundational Architecture for AI Systems
- Structural layers, boundaries, and the principle of separation of concerns
- Applying ports and adapters patterns to AI components
- Defining quality attribute scenarios for AI functionalities
- Utilizing architecture decision records for governance
Evolution of Existing Applications
- Incremental modernization strategies versus complete rewrites
- Positioning AI services alongside legacy monoliths
- Employing Strangler Fig and anti-corruption layer patterns
- Establishing integration seams for current APIs and data structures
LLM Integration Architectural Patterns
- Implementing model gateways as abstraction boundaries
- Managing synchronous, asynchronous, and streaming integrations
- Designing fallback, degradation, and provider failover mechanisms
- Treating prompt and model configurations as version-controlled assets
Contracts, APIs, and Data Interchange
- Defining structured output schemas and validation rules
- Implementing idempotency, retry logic, and rate limiting
- Allocating latency budgets and orchestrating timeouts
- Considering cost per request as a key architectural constraint
End-to-End RAG Architecture
- Building ingestion, chunking, and embedding pipelines
- Configuring index, retrieval, reranking, and generation stages
- Determining the placement of retrieval relative to application services
- Analyzing trade-offs and potential failure modes at each stage
Vector Databases and Retrieval Design
- Choosing between managed and self-hosted vector stores
- Implementing dense, sparse, and hybrid search strategies
- Applying metadata filtering and tenant isolation
- Planning re-embedding strategies for model transitions
Retrieval Quality, Grounding, and Evaluation
- Constructing evaluation sets from genuine user queries
- Defining metrics for retrieval and answer quality
- Ensuring citation, grounding, and hallucination control
- Establishing feedback loops to refine the index
Agent Architectures
- Understanding the agent loop and tool invocation processes
- Balancing deterministic workflows against autonomous planners
- Identifying scenarios where an agent is an inappropriate solution
- Defining the scope of agent responsibilities and state management
Multi-Agent Systems and Orchestration
- Designing supervisor and orchestrator topologies
- Establishing handoff protocols and message contracts
- Managing shared memory and context state
- Comparing frameworks based on architectural merit
Service Communication and Tool Protocols
- Coordinating via event-driven and queue-based mechanisms
- Exposing tools through standardized protocols
- Managing sagas, compensation, and long-running transactions
- Ensuring observability across multiple service hops
AI Agents in Development Workflows
- Integrating coding agents into the delivery pipeline
- Implementing spec-driven development with review gates
- Generating tests and automating quality checks
- Setting guardrails to preserve architectural integrity
Governance and Software Quality
- Conducting design reviews for AI features
- Managing changes to models and prompts
- Incorporating regression evaluation as a pipeline stage
- Defining ownership, policy, and approval pathways
Security, Privacy, and Data Governance
- Mitigating prompt injection via defense-in-depth strategies
- Managing secrets, access control, and least-privilege principles
- Addressing data residency, personal data, and retention policies
- Ensuring auditability and human-in-the-loop controls
Scalability, Cost, and Observability
- Tracing processes across agent chains
- Monitoring token usage and cost telemetry
- Optimizing caching and latency
- Defining service levels and incident response for AI services
Capstone: Architecture for an AI-Driven Solution
- Creating context, component, and deployment views
- Designing retrieval and agent orchestration systems
- Formulating security, governance, and cost plans
- Engaging in peer review, critique, and roadmap planning for migration
Requirements
- Proven experience in designing and maintaining production-grade software systems
- Practical understanding of REST APIs and service interoperability
- Proficiency with relational databases and data modelling techniques
- Foundational exposure to LLM-based tools or APIs
Target Audience
- Software architects
- Technical leads and senior engineers
- Engineering managers accountable for architectural decision-making
Testimonials (1)
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny