Performance and capacity¶
All topics · Alphabetical index
Concepts¶
- Latency; throughput; utilization; saturation
- Tail latency; fan-out amplification; stragglers
- Little’s Law; queueing theory; queue stability
- Amdahl’s Law; scalability limits
- Load testing; stress testing; soak testing; spike testing
- Open-loop load; closed-loop load; coordinated omission
- Warmup; cold starts; benchmark bias
- Batching; pipelining; parallelism
- Connection pools; thread pools; memory pressure; GC pauses
- Vertical scaling; horizontal scaling; autoscaling lag; headroom
- Cost per request; cost per tenant; capacity forecasts
Further reading¶
Reference links for this topic.