[Skip to main content](#main-content)

[OpenNash Jobs](https://jobs.opennash.com/)
[Hiring report](/reports/hiring/) · [All NetApp jobs](https://jobs.opennash.com/companies/netapp/) · [Search jobs](/search/)

NetApp · San Jose, CA

# Distinguished Engineer - AI

San Jose, California, United States Operations 

Listed on NetApp’s official careers site. Listed as of October 18, 2026. Check that it is still open and apply there.
[Apply on NetApp’s careers site →](https://careers.netapp.com/en/job/san-jose/distinguished-engineer-ai/27600/92333022944)

[OpenNash Jobs](https://jobs.opennash.com/) / [NetApp](https://jobs.opennash.com/companies/netapp/) / Distinguished Engineer - AI

## Job description

### Job Summary

Distinguished Engineer - AI Infrastructure We are seeking a Distinguished Engineer with unrivaled depth in AI/ML inferencing at scale and the distributed systems foundations that power it. You will architect and ship our next-generation AI infrastructure and inferencing platform serving millions of requests with uncompromising latency, throughput, and reliability requirements. You set the technical North Star—translating high-stakes business problems into elegant, defensible architectures that teams rally behind.

You drive consensus through technical authority, shaping roadmaps where your architectural decisions become company strategy. You invent solutions where standard approaches fail, and turn constraints into lasting competitive moats.

### Core Expertise Required

AI Inferencing & ML Systems: Deep hands-on experience with high-performance inference engines (TensorRT, vLLM, ONNX Runtime, Triton), model optimization (quantization, pruning, distillation), and serving patterns for LLMs and computer vision models at scale. Proven track record building, architecting RAG pipelines and optimizing retrieval-augmented generation workflows for production latency targets.

### Distributed Systems at Scale

15+ years architecting fault-tolerant, low-latency distributed systems. Expert-level understanding of consensus protocols, distributed state management, and data consistency models under partition. Experience with high-performance filesystems and storage engines optimized for AI workloads (checkpoints, model artifacts, training datasets).

### AI Infrastructure & Platform Engineering

Built enterprise-grade or SaaS platforms specifically designed for AI/ML workloads—model registries, feature stores, inference gateways, and multi-tenant serving infrastructure. Deep familiarity with GPU/TPU cluster orchestration, memory hierarchy optimization, and heterogeneous compute scheduling.

### High-Performance Data Planes

Designed and implemented high-throughput, low-latency networking stacks for critical data path operations. Expertise in RDMA, DPDK, kernel bypass techniques, and custom protocols for inter-service and accelerator-to-accelerator communication.

### Security & Multi-Tenancy

Hardened multi-tenant ML infrastructure with robust isolation, end-to-end encryption, key management for model weights, and fine-grained RBAC/ABAC for data scientists and production workloads.

### Cloud-Native Orchestration

Expert in Kubernetes scheduling extensions (device plugins, custom controllers), service mesh for AI microservices, and API gateway patterns for model serving.

### Job Requirements

About the team ONTAP is NetApp’s flagship storage operating system. The ONTAP team drives the product strategy, roadmap, and engineering delivery for ONTAP software and systems. You are responsible for developing innovative solutions and architecture for ONTAP software and systems spanning the areas of filesystems and storage, security, networking and protocols. The solutions you architect and design will drive mission critical applications, AI infrastructure and cloud workflows for Fortune 500 companies.

### What will you do

Provide the technology strategy to accelerate the pace of innovation within NetApp and the Industry. Define the roadmap and long-term vision, derived from key business priorities, technology and competitive trends as well as new and emerging customer use cases. Partner with Product management and engineering to define and deliver next generation products for NetApp. Influence executive management and engineering to contribute towards a competitive portfolio.

Demonstrate influence and act as a force multiplier across engineers at NetApp. Mentor senior and principal engineers and be the technical bar-raiser for senior and principal technical roles. Evangelize both internally and externally for NetApp products you own and become an industry recognized authority on related technologies and domain.

### What will you bring

Globally recognized as domain expert in software and system design for highly scalable distributed storage and databases, control and data plane architectures required to fuel large scale infrastructure for serving Gen AI and AI as a Service workloads. Experience building highly resilient and scalable enterprise grade products. Experience in building large scale, compute intensive stateful applications. Ownership for Product and System architecture for multiple significant projects Expertise in coding, design, architecture, subsystems, and technology trends Excellent communication skills to communicate with executives, senior leadership on products, technology trends and customer issues.

### Compensation

The target salary range for this position is 266,050 - 396,000 USD. The salary offered will be determined by the candidate's location, qualifications, experience, and education and may be outside of this range. Final compensation packages are competitive and in line with industry standards, reflecting a variety of factors, and include a comprehensive benefits package. This may cover Health Insurance, Life Insurance, Retirement or Pension Plans, Paid Time Off, various Leave options, Performance-Based Incentives, employee stock purchase plan, and/or restricted stocks (RSU’s), with all offerings subject to regional variations and governed by local laws, regulations, and company policies.

Benefits may vary by country and region, and further details will be provided as part of the recruitment process. At NetApp, we embrace a hybrid working environment designed to strengthen connection, collaboration, and culture for all employees. This means that most roles will have some level of in-office and/or in-person expectations, which will be shared during the recruitment process.

### Equal Opportunity Employer

NetApp is firmly committed to Equal Employment Opportunity (EEO) and to compliance with all federal, state and local laws that prohibit employment discrimination based on age, race, color, gender, sexual orientation, gender identity, national origin, religion, disability or genetic information, pregnancy, protected veteran status, and any other protected classification. Why You'll Thrive at NetApp At NetApp, you won't wait for the perfect moment—you'll make it.

The early planning, the extra thought, the bold idea that turns good into great: That's how our people operate and how we continue to push the boundaries of data infrastructure. NetApp is the trusted partner for organizations transforming data into opportunity. As the only enterprise-grade storage service natively embedded in Google Cloud, AWS, and Microsoft Azure, we empower customers to run everything from traditional workloads to enterprise AI with unmatched performance, resilience, and security.

Our culture We celebrate mold breakers, bold thinkers, and problem solvers. We reward initiative, impact, and ownership. We provide flexibility so you can balance professional ambition with your personal life. Here, differences are not just welcomed—they drive everything we do. If you're ready to innovate, rise to the challenge, and own every moment - make your next move your best one. Apply now. Submitting an Application To ensure a streamlined and fair hiring process for all candidates, our team only reviews applications submitted through our company website.

This practice allows us to track, assess, and respond to applicants efficiently. Emailing our employees, recruiters, or Human Resources personnel directly will not influence your application. AI Disclosure For select roles, some stages of our hiring process may use artificial intelligence tools to help evaluate applications and candidate selection. These tools support—rather than replace—human decision-making.

## At a glance
- Posted by the employer: Not stated
- First seen by OpenNash: Jul 12, 2026
- Last checked: Oct 18, 2026
- Listed for: 98 days
- Location: San Jose, California, United States[Apply on NetApp’s careers site →](https://careers.netapp.com/en/job/san-jose/distinguished-engineer-ai/27600/92333022944)

## More jobs at NetApp

### [Briefing Manager & Operations Lead, SJC EBC](https://jobs.opennash.com/companies/netapp/jobs/bc7f2f0a3c7e546081fc/)

San Jose, California, United States

### [Distinguished Engineer - Hyperscalers](https://jobs.opennash.com/companies/netapp/jobs/a67d4fc785664aa93c0f/)

San Jose, California, United States

### [Program Manager - Business Process & Program Excellence](https://jobs.opennash.com/companies/netapp/jobs/f94b1a7fa72dc3351b1a/)

San Jose, California, United States

### [Senior Network Systems Engineer](https://jobs.opennash.com/companies/netapp/jobs/f57705a70f66752bbdbb/)

San Jose, California, United States

### [Backend Software Engineer (Cloud API & Microservices development)](https://jobs.opennash.com/companies/netapp/jobs/1c002ab00b63098599b1/)

San Jose, California, United States

## Similar jobs at other companies

### [Distinguished Engineer, Networking](https://jobs.opennash.com/companies/equinix/jobs/eaa7e83192d7667b5b37/)

Equinix · Redwood City, California, United States

### [Distinguished Engineer - Distinguished Engineer, Data Foundation](https://jobs.opennash.com/companies/intuit/jobs/904d9d94b55c3f2d1306/)

Intuit · Mountain View, California

### [Distinguished Engineer, Networking](https://jobs.opennash.com/companies/equinix/jobs/dabb1fdd139e0317b3f8/)

Equinix · Toronto, Ontario, Canada +4 more

### [Distinguished, Software Engineer](https://jobs.opennash.com/companies/walmart/jobs/5e9fc6bd8df08a8cc8a4/)

Walmart · United States

### [(USA) Distinguished, Software Engineer](https://jobs.opennash.com/companies/walmart/jobs/73e848c964157a6364e5/)

Walmart · United States

[Jobs in San Jose, CA](/locations/us/ca/san-jose/)[Jobs in California](/locations/us-ca/)[Operations jobs](/functions/operations/)

OpenNash lists jobs from employers’ own careers sites and does not handle applications.
Dates come from the employer where stated; “first seen” and “last checked” are our own observations.

OpenNash Jobs · Official listings with dates and links to the employer. [Weekly hiring report](/reports/hiring/) · [Methodology](/methodology/)
