AI Infra SW Engineer (Data Science & AI Team)

Job description

Responsibilities We are looking for a highly motivated and skilled AI Infrastructure Engineer with strong hands-on experience in Kubernetes (K8s), particularly in supporting AI/ML workflows. In this role, you will be instrumental in designing, implementing, and maintaining robust, scalable, and high-performance Kubernetes-based infrastructure that supports the entire lifecycle of our AI applications—from data processing and model training to deployment and monitoring.

You will work closely with data scientists, AI/ML engineers, and DevOps teams to ensure seamless integration of AI/ML workloads within cloud-native environments. The ideal candidate has a deep understanding of container orchestration, distributed systems, and MLOps practices, and is passionate about building efficient, reliable platforms that enable rapid AI innovation. This is a unique opportunity to work at the intersection of AI and cloud infrastructure, contributing to next-generation systems that power intelligent applications at scale. ．Design & Architecture: Design, build, and scale a reliable and efficient Kubernetes platform optimized for AI/ML workloads.

This includes provisioning GPUs, managing resources, and ensuring optimal performance for computationally intensive tasks. ．Infrastructure Management: Manage the entire Kubernetes cluster lifecycle—from provisioning and configuration to ongoing maintenance, monitoring, and troubleshooting, ensuring high availability and scalability. ．Deployment & Automation: Develop and implement CI/CD pipelines to automate the deployment, scaling, and updating of machine learning models and AI services.

Ensure seamless integration with AI tools like Kubeflow, MLflow, and Argo Workflows. ．Performance Optimization: Continuously monitor and optimize system performance, focusing on resource utilization, latency reduction, and improving the overall efficiency of AI workloads. Ensure high availability and minimal downtime for AI services. ．Collaboration & Guidance: Work closely with data scientists, ML engineers, and cross-functional teams to understand their infrastructure requirements and provide technical solutions to meet workload demands effectively. ．Security & Compliance: Implement best practices for cluster security, including network policies, access controls, and vulnerability management to safeguard sensitive data and maintain compliance. ．Cost & Resource

Efficiency: Manage resources effectively to optimize cost while maintaining high-performance infrastructure for AI model training, inference, and data processing. [Technical Skills] ．Kubernetes Expertise: You should have hands-on experience with Kubernetes (K8s) architecture, including deploying applications, managing resources, and troubleshooting complex cluster issues in a production environment. ．Containerization & Linux Environment: Strong knowledge of container technologies such as Docker, along with hands-on experience in Linux environments.

Expertise in container orchestration and deployment practices is highly valued. ．AI Workloads: Deep understanding of GPU scheduling and performance optimization, including strategies for resource allocation, workload balancing, and maximizing throughput for AI/ML tasks. ．Automation & CI/CD: You need practical experience with building and managing CI/CD pipelines using tools like GitLab CI, Jenkins, GitHub

Actions, or ArgoCD to automate deployments. ．Programming & Scripting: Proficiency in at least one scripting language (e.g., Python, Bash) is a must. ．Networking: Knowledge of container networking and service mesh technologies (e.g., Istio, Linkerd) is highly desirable and a great advantage. [Soft Skills] ．Problem-Solving: Excellent analytical and problem-solving skills with a proactive approach. ．Communication: Strong verbal and written communication skills to collaborate effectively with cross-functional teams. ．Adaptability: Ability to thrive in a fast-paced, dynamic environment and adapt to new technologies quickly.

Requirements [Nice to Have] ．Experience working in a DevOps/SRE culture. ．Knowledge of infrastructure-as-code tools (Terraform, Helm). ．Background in AI/ML concepts and data workflows, with experience in tools such as Kubeflow, MLflow, or Airflow considered a plus. ．Familiarity with major cloud platforms (e.g., AWS, Google Cloud Platform, Azure) and cloud-native environments like GKE, EKS, or AKS would be advantageous.