Research Scientist Intern, AI & System Co-Design (PhD)

Job description

The AI System SW/HW Co-design team’s mission is to explore, develop, and help productize high-performance software and hardware technologies for AI at datacenter scale. We achieve this via concurrent design, performance projection, and optimization of many aspects of the system such as models, algorithms, numerics, performance, and AI hardware including compute, networking, and storage. We drive the AI HW roadmap at Meta and ensure our existing and future AI workloads and software are well optimized and suited for new infrastructure.

The team works across HW types (GPUs, ASICs), workload types (Recommendation Models, LLM, LDM) and workloads (Training & Inference). See our webpage https://aisystemcodesign.github.io for a broader introduction to how we operate as well as our recent publications. We’re a diverse group of problem solvers driven by a culture of experimentation and innovation. As a Research Scientist Intern, you will be a key member of a team of innovators, working on leading AI workloads and distributed systems, and developing architectures to enable the future of AI SW/HW co-design.

Our team at Meta AI offers twelve (12) to twenty-four (24) weeks long internships and we have various start dates throughout the year. To learn more about our research, visit https://ai.facebook.com.

Responsibilities

Lead and support research that accelerates ML applications over one or more of software, system and accelerator architectures, optimizing training and/or inference of next generation AI workloads at Meta. Work towards long-term ambitious research goals, while identifying intermediate milestones. Lead and collaborate on research projects with other researchers and engineers across diverse disciplines. Communicate research agenda, progress and results.

Influence progress of relevant research communities by producing publications.

Qualifications

Currently has, or is in the process of obtaining a PhD degree in the field of Computer Science or a related STEM field

• Strong knowledge of Hardware Architecture,Distributed systems, and AI Frameworks with interest in one or more of High Performance Computing, Numerics, Performance, and AI hardware including compute, networking, and storage
• Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
• Track record of achieving results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as MICRO, ISCA, HPCA, ASPLOS, ATC, SOSP, OSDI, NSDI, MLSys, Neurips, ICML, ICLR, or similar Experience or knowledge in developing and debugging in C/C++, Python and/or PyTorch Experience driving original scholarship in collaboration with a team Experience leading a team in solving analytical problems using quantitative approaches Experience in theoretical and empirical research and for answering questions with research Experience communicating research for public audiences of peers Experience working and communicating cross functionally in a team environment Intent to return to the degree program after the completion of the internship/co-op