Senior Core Infrastructure Engineer, AI Infrastructure

Job description

OCI (Oracle Cloud Infrastructure) AI Infrastructure is at the forefront of building a cutting-edge, ultra-high-performance GPU platform designed to support AI/ML/HPC workloads. This is your chance to be part of the AI revolution, creating systems that allow customers to scale from tens to thousands of GPUs without compromising performance. Our team is responsible for designing and developing fundamental architectural changes for GPU delivery, health monitoring, triage automation, and diagnostic services.

These are essential for running distributed AI/ML/HPC workloads across thousands of GPUs, leveraging technologies like RoCE and Infiniband. Why Join Us?

Innovative Projects

Build groundbreaking solutions for our customers from the ground up.

Exciting Times

Be part of a young, fast-growing team working on ambitious new initiatives.

Dynamic Environment

Collaborate in a vibrant, agile environment where learning and adaptability are key.

What We’re Looking For

Adaptable Engineers: Self-motivated individuals with a quick learning ability.

Technical Excellence

Rock-solid developers and distributed systems engineers with a deep understanding of distributed systems and algorithms. Comfortable diving deep into any part of the stack, as well as software debugging and low-level systems troubleshooting.

Passion for Simplicity and Scale

Value simplicity and scalability in design and implementation.

Collaborative Spirit

Comfortable working in a collaborative, agile environment and eager to learn. Ability to collaborate effectively with various dependencies, including Network and Data Center operations. Join us and be a part of the team that's pushing the boundaries of AI technology!

Minimum Qualifications

BS or MS degree in Computer Science or relevant technical field involving coding or equivalent practical experience Deep understanding of operating systems, computer networks, and high-performance applications 4+ years’ experience delivering and operating large-scale production systems (1000+ server instances) Proficient in one programming language (Java/Python/C/C++/GoLang/shell scripting)

Preferred Qualifications

Strong background in Linux systems Familiarity with system-level architecture, data synchronization, fault tolerance, and state management. General enterprise storage, networking, or computing experience Good understanding of databases and SQL (MySQL) and caching technologies (Redis, Memcache etc)

Responsibilities

Key Responsibilities

System Design & Architecture

System Scalability

• Implements and contributes to the development for components of distributed systems that support horizontal and vertical scaling including leveraging distributed state management tools. Optimizes code and/or systems for large-scale data processing in large-scale systems.

Implements scalability requirements for assigned components and reviews implementation of team members. Leverages components of data plane platforms to handle large-scale data retrieval, storage, and processing. Implements performance and load testing. System Design & Architecture

System Reliability Design

• Collaborates with team to build fault-tolerant components capable of withstanding in-service updates by implementing redundancy, replication, and automatic failover mechanisms. Applies recovery oriented computing principles to design components that effectively handle service disruptions.

Implements retry mechanisms, circuit breakers, and timeouts to help handle network unreliability. System Design & Architecture

System Reliability Performance

• Implements tests and alarm configurations to proactively detect and address issues/failures. Supports efforts to recover from failures by drafting and executing runbooks and operational procedures. Builds and customizes dashboards, telemetry systems, and alerting mechanisms to monitor component health.

System Design & Architecture

Correctness / Availability

• Designs and implements functional requirements and testing for assigned features within an existing system. Implements tests scenarios (e.g., fault-injection, brown-out) to evaluate system correctness. Implements standard data replication and synchronization techniques to maintain data integrity and availability.

Operational Troubleshooting & Incident Management

Diagnoses, debugs, and resolves issues in system components to support ongoing operation. Implements basic strategies to prevent interruptions, ensuring no maintenance windows are required for customers and users when resolving issues. Designs and implements automation scripts and tooling used to troubleshoot operational issues. Participates in operational support rotations, assisting in incident responses and root cause investigations.

Compliance & Security

Applies advanced security measures to protect data and applications in multi-tenant environments, including encryption and access controls. Implements remediation plans to continuously improve security. Collaborates with the team to ensure cloud infrastructure complies with relevant industry standards and regulations and that documentation is up-to-date Automation & Change Management: Maintains automation scripts and tools (e.g., Infrastructure as Code (IaC)) for managing cloud infrastructure.

Adheres to change management plans for patching, updating, and rolling back applications.

Core Responsibilities

Planning & Execution: Track timelines with minimal supervision, ensuring work is completed in a timely manner and is in alignment with project requirements. Prioritize and adjust work as resources or timelines change, with some guidance Collaboration & Partnership: Collaborates across teams to align on expectations and achieve shared objectives. Builds and maintains a comprehensive understanding of business, stakeholder, and/or customer needs to build and support effective partnerships.

Actively listens to diverse perspectives and asks questions to ensure understanding of others.

Problem Solving

Independently identifies and addresses standard and non-standard issues in accordance with standard practices, escalating more complex issues as appropriate. Analyzes data and/or information from multiple sources to troubleshoot standard and non-standard errors. Contributes to knowledge sharing and best practices Continuous Learning: Embraces continuous learning by actively seeking to build knowledge and new skills and/or tools, and staying current with industry trends and best practices.

Seeks out and leverages feedback and training to improve skills. Contributes to a culture of continuous learning and knowledge sharing with team members..

Continuous Improvement

Develops ideas and recommends updates to increase the efficiency and effectiveness of processes, protocols, and workflows within a team. Seeks input from team members on alternative approaches and methods for improving work.

Qualifications

Disclaimer

Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements. Range and benefit information provided in this posting are specific to the stated locations only US: Hiring Range in USD from: $79,200 to $209,500 per annum. May be eligible for bonus and equity. Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business.

Candidates are typically placed into the range based on the preceding factors as well as internal peer equity. Oracle US offers a comprehensive benefits package which includes the following:

• Medical, dental, and vision insurance, including expert medical opinion
• Short term disability and long term disability
• Life insurance and AD&D
• Supplemental life insurance (Employee/Spouse/Child)
• Health care and dependent care

Flexible Spending Accounts

• Pre-tax commuter and parking benefits 7. 401(k) Savings and Investment Plan with company match 8.

Paid time off

Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week.

Employees working fewer than 20 hours per week are not eligible for vacation. 9. 11 paid holidays 10.

Paid sick leave

72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours. 11. Paid parental leave 12. Adoption assistance 13. Employee Stock Purchase Plan 14. Financial planning and group legal 15. Voluntary benefits including auto, homeowner and pet insurance The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

As part of Oracle's onboarding process and consistent with applicable law, US-based employees are required to complete identity verification, which involves the collection and processing of their biometric information. Accommodations to this requirement may be granted following an individualized assessment.