Serverless Kubernetes with Knative and Azure Container Apps: The Complete Guide

Table of Contents

☁️ Serverless Kubernetes with Knative and Azure Container Apps: The Complete Guide

Serverless meets Kubernetes — the best of both worlds.

Running containers is great. But managing nodes, scaling pods, configuring load balancers, and setting up metrics?

Not so great — especially if your app only runs once a day or during peak loads.

Enter Serverless Kubernetes — where you deploy containers without managing infrastructure, yet still benefit from the power of K8s.

Let’s break it down — starting from zero.

🧠 What Is Serverless Kubernetes?

It’s Kubernetes that behaves like serverless:

No need to manage nodes or clusters manually
Auto-scaling to zero when idle
Pay-per-use billing
Built on top of Kubernetes (under the hood)

You write your app, containerize it, and deploy — the platform handles everything else.

⚡ Two Leading Options:

Knative — open-source, extendable serverless framework for Kubernetes
Azure Container Apps (ACA) — fully managed serverless containers built on K8s + Dapr + Envoy

☸️ Part 1: Serverless Kubernetes with Knative

🧰 What is Knative?

Knative (from Google + CNCF) adds serverless capabilities to Kubernetes.

It adds three major components:

Component	What It Does
Knative Serving	Auto-scaling HTTP-based workloads (scale to 0)
Knative Eventing	Event-driven architecture, triggers from sources
Knative Functions	Write cloud functions (optional layer on top)

🛠️ Knative Architecture

You → HTTP request → Knative Service
            ↓
        Activator (if scaled to 0)
            ↓
      Auto-scaler spins up Pod
            ↓
     Container receives traffic

Knative uses:

Kubernetes Deployment & Services
Istio/Contour/Kourier as ingress
Horizontal Pod Autoscaler (HPA)
Metrics (Prometheus) to scale up/down

🚀 Deploying with Knative

# Install Knative (with Kourier as Ingress)
kubectl apply -f knative-serving.yaml

# Deploy an app
kubectl apply -f my-service.yaml

Knative Service YAML:

apiVersion: serving.knative.dev/v1
kind: Service
metadata:
  name: helloworld
spec:
  template:
    spec:
      containers:
      - image: docker.io/your/helloworld

Knative will:

Route traffic
Auto-scale to zero on inactivity
Expose your app via HTTP

✅ Knative Use Cases

Use Case	Benefit
Webhooks or APIs with burst traffic	Scales to zero between events
LLM / AI inference apps	Saves cost for GPU workloads
Event-driven microservices	Combine with Kafka or CloudEvents
CI/CD integration	Fast app previews and teardown

☁️ Part 2: Serverless Kubernetes with Azure Container Apps (ACA)

🌐 What is Azure Container Apps?

Azure Container Apps is a fully managed serverless container platform that:

Runs on Kubernetes
Uses KEDA (event-driven autoscaler)
Built-in support for Dapr, HTTPS, revisions, and Envoy

You don’t need to manage Kubernetes directly.

🛠️ ACA Architecture

User Request → Ingress (Envoy)
        ↓
     Container App Revision
        ↓
   Scale up/down via KEDA based on:
     - HTTP requests
     - Kafka/EventHub messages
     - Queues or custom metrics

No YAML required unless you want it. You can:

Deploy via Azure CLI
Use GitHub Actions
Use ARM/Bicep for IaC

🚀 Deploying to ACA

az containerapp create \
  --name myapp \
  --resource-group my-rg \
  --image mydocker/image:latest \
  --target-port 80 \
  --ingress external \
  --env-vars "MODE=production"

OR deploy via containerapp.yaml using:

az containerapp up -n myapp -g my-rg --source . --ingress external

✅ ACA Use Cases

Use Case	Benefit
Public APIs	Fast deploy, secure by default
Background jobs	Scale to 0 on idle
Event-driven apps (Kafka, RabbitMQ)	Built-in KEDA scaling
AI/ML services	Auto-scale GPU-backed container workloads

🔍 Knative vs Azure Container Apps – Feature Comparison

Feature	Knative	Azure Container Apps
Type	Open-source on K8s	Fully managed PaaS
Ingress	Istio, Kourier, Contour	Built-in Envoy
Autoscaling	KPA (scale-to-zero) + HPA	KEDA + scale to zero
Eventing	CloudEvents, Kafka, Pub/Sub	Native via KEDA
Observability	Prometheus, Grafana	Azure Monitor
CI/CD	Manual or GitOps	GitHub Actions built-in
Cost Control	DIY on infra	Pay per request automatically
Best For	Custom control over K8s	Simplicity + Serverless agility

⚠️ Serverless Kubernetes: Challenges to Consider

Challenge	Details
Cold starts	Initial request can be slower (solution: warm pods or pre-scaling)
Limited long-running processes	Serverless prefers short-lived workloads
Complexity in hybrid apps	Mixing Knative with traditional K8s can be tricky
Debugging events	Tracing across event sources is non-trivial
Cost prediction	Cost tied to usage spikes — monitor closely

💡 When to Use Serverless K8s

✅ You want Kubernetes power without the overhead
✅ Your app has inconsistent or bursty traffic
✅ You want infra-free CI/CD pipelines
✅ You build event-driven, stateless, or microservices architectures
✅ You need scale-to-zero cost savings

🧠 Final Thoughts

Knative gives you open-source flexibility with control.
Azure Container Apps gives you simplicity and speed without infrastructure ops.

In 2025 and beyond, the fastest teams won’t just ship code — they’ll deploy containers on-demand with no infrastructure headaches.

Serverless Kubernetes lets you:

Focus on features
Save on costs
Scale with traffic
Ship in hours, not days

Mohammad Gufran Jahangir