Load Balancing & Traffic Management

Load Balancing & Traffic Management

Load Balancing Algorithms

Key Concepts

• health check — load balancer regularly pings servers to detect failures
• sticky session — a user is always routed to the same server
• rate limiting — capping requests per second per client
• circuit breaker — stops sending traffic to a failing server
DDoS mitigationProtecting against distributed denial-of-service attacks

Useful Phrases

• "We use least-connections routing to avoid overloading any single instance."
• "Health checks ensure the load balancer stops sending traffic to an unhealthy node."
• "Rate limiting at the gateway prevents a single client from overwhelming the service."