Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference

Job description

We are the Foundation Model Inference team within Cloud OS and AI Inference organization. We are on a mission to build the most highly performant, secure and private inference stack that powers Siri AI, Apple Intelligence and Apps that are powered with the largest foundation models. Our systems serve billions of queries daily across Siri AI, Apple Intelligence, Apple Search, Apple Music, Apple TV, App Store, iMessage, Photos, Camera, Spotlight & Safari, at remarkably low latency with every ounce of compute extracted from the hardware beneath them.

We optimize language, vision, and speech models with billions of parameters using state-of-the-art techniques and ship them at Apple scale. This is a rare opportunity to directly shape how AI reaches billions of people worldwide.