Senior Software Engineer, Private Cloud Compute Inference Routing

Job description

Apple is looking for a senior software engineer to build the next generation of inference routing for Private Cloud Compute, the backbone of Siri AI and Apple Intelligence. You'll design distributed systems that direct inference requests across a global fleet of inference servers, balancing latency, availability, and compute efficiency while preserving PCC's privacy guarantees. Your work will directly shape how reliably and efficiently Apple delivers cloud inference at scale.

You'll join iCloud Platform Engineering team. We build the server stack behind Push Notifications, iMessage, FaceTime, iCloud, iCloud Private Relay and Private Cloud Compute. Our internet scale distributed systems deliver real-time experiences with very low latency and very high availability. They reach hundreds of millions of users across a billion devices worldwide and help them connect and share their lives securely and privately.

Our work spans identity, messaging, queueing, presence, routing, relays, developer APIs and much more. We're a small, highly collaborative team with a large impact.