A load balancer sits in front of several identical backends and picks one for each connection (layer 4) or each request (layer 7). It also hides backends that are down.