Senior Software Engineer Modelzoo

Job description

Job Title

Software Engineer (2-3 years experience)

Job Summary

We're looking for a skilled and motivated Machine Learning Software to join our team. The ideal candidate will have a solid foundation in deep learning and a strong interest in optimizing and deploying ML models on specialized hardware. This role involves implementing model optimizations, with a particular focus on quantization, to improve the performance of machine learning inference on target platforms.

Key Responsibilities

Model Porting & Deployment: Port and deploy deep learning models from frameworks like PyTorch and TensorFlow to proprietary or commercial ML accelerator hardware platforms.

Performance Optimization

Analyze and improve the performance of ML models for target hardware, focusing on latency and throughput.

Quantization

Contribute to model quantization efforts (e.g., INT8 ) to reduce model size and accelerate inference while maintaining model accuracy.

Profiling & Debugging

Use profiling tools to identify and fix performance bottlenecks in the ML inference pipeline on the accelerator.

Required Qualifications

Technical Skills: Proficiency in deep learning frameworks such as PyTorch and TensorFlow . Hands-on experience with deploying and optimizing models on GPUs or other specialized accelerators. Some experience with model quantization ( Post-Training Quantization ). Strong proficiency in C++ and Python . Experience with GPU programming models like CUDA/cuDNN is a plus. Familiarity with ML inference engines and runtimes (e.g., TensorRT , OpenVINO , TensorFlow Lite ).

Foundational understanding of computer architecture principles.

Version Control

Proficient with Git and collaborative development workflows.

Education

Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field.

Preferred Qualifications

Knowledge of hardware-aware model design. Familiarity with compiler technologies for deep learning. Experience with real-time or embedded systems. Knowledge of cloud platforms (AWS, GCP, Azure). Experience with CI/CD pipelines for ML models. More information about NXP in India... #LI-2734