Hardware/Software Codesign and Performance Engineer, Inference
Listed on Alphabet’s official careers site. Listed as of October 30, 2026. Check that it is still open and apply there.
Apply on Alphabet’s careers site →Job description
info_outline About the job In this role, you’ll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You’ll be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. You'll contribute to the innovation behind products loved by millions worldwide, and leverage your design and verification expertise to verify complex digital designs, with a specific focus on TPU architecture and its integration within AI/ML-driven systems.
As a Technical Lead on the TPU Chip Architecture team, you will bridge the gap between model architecture innovation and next-generation hardware design. Operating at the intersection of AI research and infrastructure engineering, you will define the long-term strategic outlook and architectural roadmap for our future machine learning training and serving capabilities. You will advocate the integration of foundational ML research—such as massive-scale frontier models—with advanced custom silicon architectures to deliver industry-defining, high-performance, and power-efficient accelerators.
The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future.
From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more. Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US
$240000 - $333000 (USD) + 25% bonus target + equity + benefits Learn more about benefits at Google .
More jobs at Alphabet
AI and Infrastructure Software Engineer, Virtualization
Sunnyvale, CA, USA
Firestore Software Engineering Manager
Sunnyvale, CA, USA
GPU System Software Engineer
Sunnyvale, CA, USA
Hardware/Software Co-Design Engineer, Inference
Sunnyvale, CA, USA
Senior Accelerators Systems Software Architect, AI Transformation
Sunnyvale, CA, USA
Similar jobs at other companies
AI Native Hardware & Software Codesign internship 2027
IBM · Yorktown Heights, NY
CoDesign & NextGen Performance Engineer
Cerebras Systems · Sunnyvale, CA
Software Engineer II - Operating Systems (OS) Software/Hardware Optimization
Microsoft · United States, Washington, Redmond
Test Software/Hardware Integration Asc Mgr.
Lockheed Martin · Littleton, CO
Hardware/Software Systems Integration Lead
Lockheed Martin · Littleton, CO, Huntsville, AL