Courses/Track 5: Production & Operations
5.2intermediate3h 30m11 chapters

Deploy, Monitor & Scale

Ship voice AI to production

Master end-to-end production deployment for voice AI with Docker, LiveKit Cloud, monitoring, auto-scaling, alerting, cost optimization, and blue-green deployments.

What You Build

Production deployment pipeline with monitoring dashboard, auto-scaling, and alerting.

Prerequisites

  • Course 1.1
Chapters
01

Deployment architecture

15m

Understand deployment architecture options including cloud, self-hosted, and hybrid approaches.

CloudSelf-hostedHybrid
02

Docker configuration

20m

Configure Docker with multi-stage builds and optimization for voice agent containers.

DockerfileMulti-stageOptimization
03

LiveKit Cloud deployment

20m

Deploy to LiveKit Cloud with the CLI, manage secrets, and handle rollbacks.

lk agent deploySecretsRollback
04

Monitoring setup

25m

Set up monitoring with Cloud Insights, transcript analysis, and distributed traces.

Cloud InsightsTranscriptsTraces
05

Custom metrics & data hooks

20m

Implement custom metrics with data hooks and Prometheus for detailed observability.

Data hooksCustom metricsPrometheus
06

Alerting & incident response

20m

Configure alerting with PagerDuty integration and incident response runbooks.

AlertsPagerDutyRunbooks
07

Multi-tenant architecture

25m

Build a multi-tenant platform on LiveKit: room namespacing for isolation, JWT metadata for per-tenant agent config, dynamic tool registration, usage tracking for billing, and scaling shared worker pools.

Tenant isolationRoom namespacingPer-tenant configUsage billing
08

Auto-scaling

20m

Set up auto-scaling with policies, load balancing, and capacity planning.

Scaling policiesLoad balancingCapacity
09

Cost optimization

15m

Optimize costs through token usage tracking, model selection, and intelligent caching.

Token usageModel selectionCaching
10

Blue-green deployments

20m

Implement blue-green deployments with zero-downtime releases, canary testing, and feature flags.

Zero-downtimeCanaryFeature flags
11

Operational runbook

15m

Create operational runbooks with deployment checklists and post-mortem templates.

RunbooksChecklistsPost-mortems

What You Walk Away With

End-to-end production deployment with monitoring, scaling, alerting, and operational best practices.