Software Development Engineer, AI Runtime

Job description

We are looking for a passionate and experienced Software Development Engineer to help us build and scale the next generation of AI runtime infrastructure for Alexa+. You will design and implement Tier-1 distributed systems that orchestrate expert agent executions, manage LLM inference pipelines, and ensure reliable, low-latency delivery across Alexa-enabled devices globally.

This is a high-impact role where your work directly shapes how millions of customers experience Alexa+ every day.

Key job responsibilities

- Design, build, and operate large-scale distributed services that power Alexa+ Expert executions

- Develop and optimize LLM orchestration pipelines — including model serving, prompt routing, and inference optimization

- Build multi-agent coordination systems that route requests to the right expert agents with minimal latency

- Own the operational excellence of Tier-1 services, ensuring 99.99%+ availability at scale

- Collaborate with applied scientists and ML engineers to integrate new AI capabilities into production

- Drive architectural decisions that balance performance, reliability, and cost efficiency

- Mentor teammates and raise the engineering bar through code reviews, design reviews, and technical leadership

About the team

The AI Runtime team is the backbone of Alexa+. We own the infrastructure that powers Expert executions — the multi-agent systems that bring Alexa+'s intelligent capabilities to life for hundreds of millions of customers worldwide. Our services orchestrate LLM inference, coordinate expert agents, and deliver responses at massive scale with low latency. When a customer interacts with Alexa+ and it feels magical, our platform made it happen.