[Skip to main content](#main-content)

[OpenNash Jobs](https://jobs.opennash.com/)
[Hiring report](/reports/hiring/) · [All Amazon jobs](https://jobs.opennash.com/companies/amazon/) · [Search jobs](/search/)

Amazon · IL, Tel Aviv

# ML Software Engineer, Data Plane

IL, Tel Aviv Software Engineering 

Listed on Amazon’s official careers site. Posted August 7, 2026. Check that it is still open and apply there.
[Apply on Amazon’s careers site →](https://www.amazon.jobs/en/jobs/10495487/ml-software-engineer-data-plane)

[OpenNash Jobs](https://jobs.opennash.com/) / [Amazon](https://jobs.opennash.com/companies/amazon/) / ML Software Engineer, Data Plane

## Job description

The MLIL DataPlane team is looking for a Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large models run efficiently on custom hardware - spanning model execution, memory management, data movement, and serving integration.

### Our work covers the full inference path

integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models.

This is a ground-up effort with rapidly evolving hardware and software. We need an individual contributor who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack.

### Key job responsibilities

- Develop and optimize compute kernels for a custom ML accelerator architecture, targeting production-level performance for large language model inference.

- Implement and validate LLM architectures end-to-end - from PyTorch model definition through distributed execution on custom hardware.

- Integrate custom accelerator backends into open-source ML serving frameworks (vLLM, PyTorch), including scheduler extensions, memory management, and model parallelism.

- Build and maintain test infrastructure for model correctness validation across CPU, GPU, simulator, and hardware targets.

- Profile and optimize inference workloads - identify bottlenecks, instrument critical paths, and drive latency and throughput improvements from simulation through hardware bringup.

- Own features end-to-end: from design through implementation, testing, and integration into the broader software stack.

- Contribute to CI/CD pipelines that gate model and kernel changes on correctness and performance regressions.

## At a glance
- Posted by the employer: Aug 7, 2026
- First seen by OpenNash: Aug 20, 2026
- Last checked: Oct 18, 2026
- Listed for: 72 days
- Location: IL, Tel Aviv[Apply on Amazon’s careers site →](https://www.amazon.jobs/en/jobs/10495487/ml-software-engineer-data-plane)

## More jobs at Amazon

### [Embedded Software Engineer, EFA Annapurna](https://jobs.opennash.com/companies/amazon/jobs/b10af8e6454dc9b27bc0/)

IL, Tel Aviv

### [Embedded Software Engineer - Nitro, Annapurna Labs](https://jobs.opennash.com/companies/amazon/jobs/f4e695379acfb543c121/)

IL, Tel Aviv

### [Embedded Software Engineer, AWS Annapurna Labs](https://jobs.opennash.com/companies/amazon/jobs/7958ff54b4edf6b91a6b/)

IL, Tel Aviv

## Similar jobs at other companies

### [Senior Software Engineer, SaaS Control Plane](https://jobs.opennash.com/companies/hitachi/jobs/1f6027aec706fa5f9b4d/)

Hitachi · Bengaluru, KA, India +2 more

### [Software Engineer III - Data Engineer](https://jobs.opennash.com/companies/jpmorganchase/jobs/dfebcf547bf74f75b83d/)

JPMorganChase · Hyderabad, Telangana, India

### [Sr. Staff Software Development Engineer - Golang + Control Plane](https://jobs.opennash.com/companies/zscaler/jobs/28680b606525f94e8254/)

Zscaler · Office - Bangalore, India

### [Electrician - Plane Creek Mill](https://jobs.opennash.com/companies/wilmar-international/jobs/06901fbc1fe3ad0c8db1/)

Wilmar International 

### [Health & Wellbeing Advisor Plane Creek Mill](https://jobs.opennash.com/companies/wilmar-international/jobs/9c4bcfbef84199eec5c1/)

Wilmar International 

[Software Engineering jobs](/functions/software-engineering/)

OpenNash lists jobs from employers’ own careers sites and does not handle applications.
Dates come from the employer where stated; “first seen” and “last checked” are our own observations.

OpenNash Jobs · Official listings with dates and links to the employer. [Weekly hiring report](/reports/hiring/) · [Methodology](/methodology/)