Skip to main content

Togetherai

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

San FranciscoJul 16via Greenhouse
DevOps & Infrastructure

About this role

About the Role We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, whether that's a cluster, a model deployment, or a capacity change, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath, so the inference team never has to know or care which specific serving stack, scheduler, or hardware pool…

This is a short excerpt. The full job description and the application are on Togetherai's own site.

More roles at Togetherai

Similar roles