Client API
AWS load balancer
Put an Application Load Balancer in front of gateway instances
Put an Application Load Balancer (HTTPS) in front of gateway instances:
- HTTPS listener with a publicly trusted certificate (ACM).
- Target group: HTTP → gateway
:8080on manager/worker hosts. - Health check:
GET /readyz(mark unhealthy if SandboxAPI unreachable). - No stickiness — unary routes are safe across instances; each log stream stays on one connection for its lifetime.
- Enable connection draining so in-flight log streams can finish on deregister.
- Raise the ALB idle timeout (e.g. 5–15 minutes) so collected
execand longlogs?follow=truestreams are not cut early.
Keep Raft / gRPC advertise addresses as real node-reachable IPs — do not point intra-cluster traffic at the ALB.