Distributed LLM Inference Engineer

About this role

About Anyscale At Anyscale , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI , Uber , Spotify , Instacart , Cruise , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.…

This is a short excerpt. The full job description and the application are on Anyscale's own site.

More roles at Anyscale

• AWS & Neo Cloud Alliances Senior ManagerAnyscale · Remote
• Forward Deployed Engineer - AI/ML PlatformsAnyscale · San Francisco
• Senior Cloud Security EngineerAnyscale · San Francisco
• Engineering Manager, Ray DataAnyscale · San Francisco
• Senior Product Security EngineerAnyscale · Bengaluru, Karnataka

Similar roles

• Software Engineer, ML PlatformCursor · Palo Alto, CA
• Staff Software Engineer, AI Developer ProductivityCoinbase · Remote - USA
• Staff Software Engineer, AI Developer ProductivityCoinbase · Remote - USA
• AI Programmer InternEpicgames · Cary,North Carolina,United States
• Regional Director, AI DeploymentCursor · Remote