Health checks and heartbeats may pass while real requests time out. In my experience this is harder to handle than a clean crash.
Gray failure
A node that is not dead but so slow or flaky that it harms the system while still looking alive.
Health checks and heartbeats may pass while real requests time out. In my experience this is harder to handle than a clean crash.