Course Outline
Foundational Architecture for AI Systems
- Defining layers, boundaries, and the separation of concerns
- Applying ports and adapters patterns to AI components
- Establishing quality attribute scenarios for AI features
- Utilizing architecture decision records for effective governance
Modernizing Existing Applications
- Pursuing incremental modernization rather than full rewrites
- Integrating AI services alongside existing monolithic structures
- Implementing Strangler and anti-corruption layer patterns
- Creating integration seams for legacy APIs and data sources
Architectural Patterns for LLM Integration
- Implementing the model gateway as an abstraction boundary
- Managing synchronous, asynchronous, and streaming integrations
- Designing fallback, degradation, and provider failover strategies
- Treating prompt and model configuration as version-controlled assets
Contracts, APIs, and Data Interchange
- Defining structured output schemas and validation rules
- Ensuring idempotency, retries, and rate limiting
- Managing latency budgets and timeout orchestration
- Treating cost per request as a critical architectural constraint
End-to-End RAG Architecture
- Building ingestion, chunking, and embedding pipelines
- Designing index, retrieval, reranking, and generation stages
- Optimizing retrieval placement relative to application services
- Analyzing trade-offs and potential failure modes at each stage
Vector Databases and Retrieval Design
- Evaluating managed versus self-hosted vector stores
- Implementing dense, sparse, and hybrid search strategies
- Managing metadata filtering and tenant isolation
- Planning re-embedding strategies for model updates
Retrieval Quality, Grounding, and Evaluation
- Creating evaluation sets based on real-world queries
- Defining metrics for retrieval and answer quality
- Ensuring citation accuracy, grounding, and hallucination control
- Implementing feedback loops to refine the index
Agent Architectures
- Understanding the agent loop and tool invocation mechanisms
- Comparing deterministic workflows with autonomous planners
- Identifying scenarios where an agent is not the optimal solution
- Defining agent responsibilities and state management
Multi-Agent Systems and Orchestration
- Designing supervisor and orchestrator topologies
- Establishing handoff protocols and message contracts
- Managing shared memory and context
- Comparing frameworks based on architectural merits
Service Communication and Tool Protocols
- Coordinating through event-driven and queue-based systems
- Exposing tools via standard protocols
- Implementing sagas, compensation, and long-running transactions
- Ensuring observability across multiple service hops
Integrating AI Agents into Development Workflows
- Deploying coding agents within the delivery pipeline
- Adopting spec-driven development and review gates
- Automating test generation and quality checks
- Maintaining guardrails to preserve architectural control
Governance and Software Quality Assurance
- Conducting design reviews for AI features
- Managing changes to models and prompts
- Incorporating regression evaluation into the pipeline
- Defining ownership, policy, and approval pathways
Security, Privacy, and Data Governance
- Mitigating prompt injection through defense-in-depth
- Managing secrets, access control, and least privilege principles
- Addressing data residency, personal data, and retention policies
- Ensuring auditability and human-in-the-loop controls
Scalability, Cost, and Observability
- Tracing performance across agent chains
- Monitoring token usage and cost telemetry
- Optimizing caching and latency
- Defining service levels and incident response for AI services
Capstone: Architecting an AI-Driven Solution
- Developing context, component, and deployment views
- Designing retrieval and agent orchestration flows
- Formulating security, governance, and cost plans
- Conducting peer review, critique, and migration roadmap planning
Requirements
- Practical experience in designing and maintaining production-grade software systems
- Proficiency in working with REST APIs and service integration patterns
- Understanding of relational databases and data modelling concepts
- Basic familiarity with LLM-based tools or APIs
Target Audience
- Software architects
- Technical leads and senior engineers
- Engineering managers accountable for architectural decisions
Testimonials (1)
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny