Runtime/Driver Software Development Engineer, Neuron Runtime

Job description

Neuron SDK is the complete software stack for the AWS Inferentia and Trainium machine learning accelerators designed by Annapurna Labs inside AWS. The Neuron SDK consists of a compiler, runtime, frameworks, and tooling customers need. It’s also preinstalled in Amazon Deep Learning AMIs and Deep Learning Containers for customers to quickly get started with running high performance and cost-effective inference and training.

This position is for a Software Engineer for the AWS Neuron SDK team with a deep background in Linux and device drivers. Deep knowledge and experience with hardware-based accelerator platforms and the necessary complexity for the software layers that interact and manage them. Experience implementing high performance software drivers, needed to ensure high throughput from software to hardware, is also a necessity. This engineer will work with the team to define the key interfaces and will develop the runtime stack and driver that manages the accelerator.

This engineer will also work in pre-silicon environments (such as emulation) to shift-left Runtime Software Stack readiness and to develop validation content to checkout HW/Silicon features.

This is a fast-paced, intellectually challenging position, where you’ll work with thought-leaders in multiple technology areas. You’ll have high standards for yourself and everyone you work with, and you’ll be constantly looking for ways to improve our products' performance, quality and cost.

We’re changing an industry, and we want individuals who are ready for this challenge and want to reach beyond what is possible today.