Software Engineer – Cloud Infrastructure

Job description preview

From FriendliAI’s original posting

ABOUT THE JOB FriendliAI is looking for a Cloud Infrastructure Engineer to own the architecture and evolution of the cluster platform behind our GPU-accelerated AI inference cloud. As a Software Engineer, Cloud Infrastructure, you will design how our clusters are built and connected, extend Kubernetes where its defaults fall short, and own the network path that inference traffic depends on. Inference is an unforgiving workload for Kubernetes. Traffic is bursty and latency-sensitive, GPU capacity is scarce and inelastic, tenants must stay isolated, and multi-node serving depends on the network holding up under sustained load. This is a hands-on architecture role for an engineer who has already run large clusters in production and wants to push them further. KEY RESPONSIBILITIES Cluster Architecture - Own the architecture of our multi-cluster, multi-tenant Kubernetes fleet across both managed and self-managed clusters: cluster topology, control plane and etcd lifecycle, and zero-downtime upgrades. - Extend Kubernetes with custom controllers, operators, and CRDs so platform behavior is encoded in software rather than runbooks. - Design GPU scheduling and capacity strategy, including…