Load Balancer

A load balancer is a network component that spreads incoming requests across several servers or containers. It keeps any single instance from being overloaded and steers traffic away from unhealthy ones.

Related Terms

  • Service Level Objective (SLO)

    A service level objective (SLO) is an internal reliability target for a service, such as the share of requests that must succeed quickly. It defines what good enough looks like for users over a rolling window.

  • API Gateway

    An API gateway is a service that sits in front of a set of APIs as a single entry point. It routes requests and handles shared concerns such as authentication, rate limiting, logging and transformation.

  • Autoscaling

    Autoscaling automatically adds or removes computing capacity, such as servers, containers or function instances, in response to demand. Applications keep up with traffic peaks without paying for idle resources during quiet periods.

  • Blue-Green Deployment

    Blue-green deployment is a release technique that keeps two identical production environments and moves traffic from the old version to the new one in one step. The old side stays ready for instant rollback.

  • Content Delivery Network (CDN)

    A content delivery network (CDN) is a distributed set of servers that caches and serves content from locations close to users. Pages, images, video and API responses load faster and origin servers carry less load.

  • WebSockets

    WebSockets is a protocol that keeps a single, long-lived, two-way connection open between a client and server. Either side can send messages at any time, which suits real-time features.

A clear proven process, that delivers

End of Scroll. Start of Discovery.

You've seen our ideas - now go deeper.
Discover more insights, guides, and engineering practice.