Get in Touch
 Duration 21 hours

Course Outline

Foundational Architecture for AI Systems

  • Defining layers, boundaries, and the separation of concerns
  • Applying ports and adapters patterns to AI components
  • Establishing quality attribute scenarios for AI features
  • Utilizing architecture decision records for effective governance

Modernizing Existing Applications

  • Pursuing incremental modernization rather than full rewrites
  • Integrating AI services alongside existing monolithic structures
  • Implementing Strangler and anti-corruption layer patterns
  • Creating integration seams for legacy APIs and data sources

Architectural Patterns for LLM Integration

  • Implementing the model gateway as an abstraction boundary
  • Managing synchronous, asynchronous, and streaming integrations
  • Designing fallback, degradation, and provider failover strategies
  • Treating prompt and model configuration as version-controlled assets

Contracts, APIs, and Data Interchange

  • Defining structured output schemas and validation rules
  • Ensuring idempotency, retries, and rate limiting
  • Managing latency budgets and timeout orchestration
  • Treating cost per request as a critical architectural constraint

End-to-End RAG Architecture

  • Building ingestion, chunking, and embedding pipelines
  • Designing index, retrieval, reranking, and generation stages
  • Optimizing retrieval placement relative to application services
  • Analyzing trade-offs and potential failure modes at each stage

Vector Databases and Retrieval Design

  • Evaluating managed versus self-hosted vector stores
  • Implementing dense, sparse, and hybrid search strategies
  • Managing metadata filtering and tenant isolation
  • Planning re-embedding strategies for model updates

Retrieval Quality, Grounding, and Evaluation

  • Creating evaluation sets based on real-world queries
  • Defining metrics for retrieval and answer quality
  • Ensuring citation accuracy, grounding, and hallucination control
  • Implementing feedback loops to refine the index

Agent Architectures

  • Understanding the agent loop and tool invocation mechanisms
  • Comparing deterministic workflows with autonomous planners
  • Identifying scenarios where an agent is not the optimal solution
  • Defining agent responsibilities and state management

Multi-Agent Systems and Orchestration

  • Designing supervisor and orchestrator topologies
  • Establishing handoff protocols and message contracts
  • Managing shared memory and context
  • Comparing frameworks based on architectural merits

Service Communication and Tool Protocols

  • Coordinating through event-driven and queue-based systems
  • Exposing tools via standard protocols
  • Implementing sagas, compensation, and long-running transactions
  • Ensuring observability across multiple service hops

Integrating AI Agents into Development Workflows

  • Deploying coding agents within the delivery pipeline
  • Adopting spec-driven development and review gates
  • Automating test generation and quality checks
  • Maintaining guardrails to preserve architectural control

Governance and Software Quality Assurance

  • Conducting design reviews for AI features
  • Managing changes to models and prompts
  • Incorporating regression evaluation into the pipeline
  • Defining ownership, policy, and approval pathways

Security, Privacy, and Data Governance

  • Mitigating prompt injection through defense-in-depth
  • Managing secrets, access control, and least privilege principles
  • Addressing data residency, personal data, and retention policies
  • Ensuring auditability and human-in-the-loop controls

Scalability, Cost, and Observability

  • Tracing performance across agent chains
  • Monitoring token usage and cost telemetry
  • Optimizing caching and latency
  • Defining service levels and incident response for AI services

Capstone: Architecting an AI-Driven Solution

  • Developing context, component, and deployment views
  • Designing retrieval and agent orchestration flows
  • Formulating security, governance, and cost plans
  • Conducting peer review, critique, and migration roadmap planning

Requirements

  • Practical experience in designing and maintaining production-grade software systems
  • Proficiency in working with REST APIs and service integration patterns
  • Understanding of relational databases and data modelling concepts
  • Basic familiarity with LLM-based tools or APIs

Target Audience

  • Software architects
  • Technical leads and senior engineers
  • Engineering managers accountable for architectural decisions

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories