[Skip to main content](#main-content) [OpenNash Jobs](https://jobs.opennash.com/) [Hiring report](/reports/hiring/) · [All HSBC Holdings jobs](https://jobs.opennash.com/companies/hsbc-holdings/) · [Search jobs](/search/) HSBC Holdings · Guangzhou, Guangdong, China # Sr. Associate Director, Software Engineering (Model Hosting Pod Tech Lead) Guangzhou, Guangdong, China Director Software Engineering Listed on HSBC Holdings’s official careers site. Listed as of October 20, 2026. Check that it is still open and apply there. [Apply on HSBC Holdings’s careers site →](https://portal.careers.hsbc.com/careers/job/563774611877286) [OpenNash Jobs](https://jobs.opennash.com/) / [HSBC Holdings](https://jobs.opennash.com/companies/hsbc-holdings/) / Sr. Associate Director, Software Engineering (Model Hosting Pod Tech Lead) ## Job description ### Pillar 1 Model Hosting & Inference Optimization Design, build, and maintain scalable, reliable model hosting systems to support large-scale deployment of AI models (LLMs, embedding models, STT/TTS, etc.) across diverse hardware platforms. Develop and implement inference optimization strategies to achieve low latency, high throughput, and cost-efficiency, including model quantization, KV cache optimization, and dynamic batch processing / Continuous Batching. Evaluate, integrate, and customize state-of-the-art inference frameworks (vLLM, TensorRT-LLM, SGLang, etc.) to optimize model performance on target hardware. Monitor and maintain inference system health, track key performance metrics (latency, throughput, TTFT, memory usage, availability), and troubleshoot performance bottlenecks or deployment issues. Collaborate with hardware teams to leverage hardware-specific and optimize hosting infrastructure for maximum resource utilization. Ensure model hosting systems comply with reliability, scalability, and security standards, supporting high-availability production workloads. Design and build end-to-end, scalable model fine-tuning pipelines to support domain-specific adaptation of pre-trained using custom, domain-specified datasets. Collaborate with data scientists and domain experts to understand domain requirements, define fine-tuning objectives, and validate fine-tuned model performance against domain-specific metrics. Bachelor's/Master's/PhD degree in Machine Learning, Natural Language Processing, Computer Science, Data Science, Statistics, or related fields. 3+ years' experience leading teams, including people management and delivery ownership. 5+ years of experience in AI, with proven expertise in both model inference optimization/hosting and model fine-tuning pipeline development; experience with LLM-related work is a strong plus. Proficiency in programming languages such as Python, CUDA; familiarity with GPU/CPU architecture and high-performance computing (HPC) principles. ### Deep understanding of AI model inference KV cache management, batch processing, quantization (INT4/FP8/GPTQ/AWQ), operator optimization, and inference framework integration (vLLM, TensorRT-LLM, SGLang, etc.). Hands-on experience building and maintaining model hosting systems, including knowledge of containerization (Docker, Kubernetes) and cloud computing platforms (AWS, GCP, Azure) for scalable deployment. ### Expertise in designing end-to-end model fine-tuning pipelines data preprocessing, distributed training, hyperparameter tuning, and integration with pre-trained models Familiarity with fine-tuning frameworks and tools (Hugging Face Transformers, Accelerate, LoRA, QLoRA) and experience optimizing fine-tuning workflows for efficiency. Experience with performance benchmarking, monitoring, and troubleshooting for both inference and fine-tuning systems. Demonstrates an AI-native mindset, applying AI-driven approaches to improve productivity, quality, and decision-making. Experienced in leveraging coding assistants (e.g., AI pair-programming tools) to accelerate software development, enhance code quality, and support engineering best practices. ## At a glance - Posted by the employer: Not stated - First seen by OpenNash: Oct 13, 2026 - Last checked: Oct 20, 2026 - Listed for: 7 days - Location: Guangzhou, Guangdong, China[Apply on HSBC Holdings’s careers site →](https://portal.careers.hsbc.com/careers/job/563774611877286) ## More jobs at HSBC Holdings ### [AVP - CRM (Full-stack)](https://jobs.opennash.com/companies/hsbc-holdings/jobs/7a96d6ceb860f017346e/) Guangzhou, Guangdong, China ### [Associate Director, Software Engineering](https://jobs.opennash.com/companies/hsbc-holdings/jobs/3b41f594efaf5138c3f6/) Guangzhou, Guangdong, China ## Similar jobs at other companies ### [Software Architect - Model-Based Systems Engineering (MBSE)](https://jobs.opennash.com/companies/siemens/jobs/c8e872da78741af4ea6e/) Siemens ### [Director, Software Engineering](https://jobs.opennash.com/companies/aegon/jobs/7dd73e2b62ea04739e5e/) Aegon ### [Senior Director of Software Engineering](https://jobs.opennash.com/companies/jpmorganchase/jobs/ab6b1d796dbc2b1b8839/) JPMorganChase · LONDON, United Kingdom ### [Executive Director, Software Engineering AI Solutions](https://jobs.opennash.com/companies/cvs-health/jobs/bb8d84075cfbebe7f5cb/) CVS Health · Woonsocket, RI ### [Director of Software Engineering - Backend ( Java, AWS, AI)](https://jobs.opennash.com/companies/jpmorganchase/jobs/c5302bfcdaeddc92e7eb/) JPMorganChase · Bengaluru, Karnataka, India OpenNash lists jobs from employers’ own careers sites and does not handle applications. Dates come from the employer where stated; “first seen” and “last checked” are our own observations. OpenNash Jobs · Official listings with dates and links to the employer. [Weekly hiring report](/reports/hiring/) · [Methodology](/methodology/)