Caterpillar · Irving, Texas

Lead Data Quality Assurance Engineer, Data Annotation Services

Irving, TexasFull-timeManager or lead$128,470.00 - $208,770.00Data & Analytics

Listed on Caterpillar’s official careers site. Posted November 18, 2026. Check that it is still open and apply there.

Apply on Caterpillar’s careers site →

Job description

Career Area

Technology, Digital and Data Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live.

Together, we are building a better world, so we can all enjoy living in it. Help Build the Future of Caterpillar At Caterpillar, technology always has a purpose: solving our customers’ toughest challenges. Through Cat Technology, we are building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. With over 1.6 million connected assets generating real-world data daily, we are creating the foundation for AI, autonomy, edge computing, and intelligent machines that continuously learn and improve at global scale.

Be Part of What’s Next in Autonomous Construction Sites Construction autonomy is one of the most challenging applications of AI. As a Lead Data Quality Assurance Engineer, you will lead the quality strategy for training data powering robotics, computer vision, autonomous systems, Physical AI, and Vision-Language-Action (VLA) models. You will combine data quality engineering, test automation, and machine learning expertise to ensure the datasets used by Caterpillar’s AI systems are accurate, scalable, and trustworthy while leading a small team of QA engineers and collaborating across engineering, annotation, and product teams.

Job Summary

Lead the development and execution of quality assurance processes, standards, and automation frameworks for annotation and captioning datasets supporting robotics, autonomous driving, computer vision, and Physical AI initiatives. Drive continuous improvement of dataset quality by establishing metrics, evaluating AI-assisted labeling technologies, managing vendor quality, and implementing scalable validation solutions across the data lifecycle.

What You Will Do

Lead the annotation quality strategy and roadmap, providing technical leadership and mentorship to a team of QA engineers while defining standards, guidelines, acceptance criteria, and governance processes for perception and VLA datasets. Design and implement automated validation frameworks, testing methodologies, and quality gates that verify annotation accuracy, consistency, completeness, schema compliance, and sensor synchronization across multimodal datasets.

Define and monitor dataset quality metrics, dashboards, audits, and benchmarking processes to measure dataset health, identify root causes of labeling defects, and drive continuous quality improvements with internal teams and external annotation providers. Evaluate and validate human, AI-assisted, and automated labeling solutions, including technologies such as NVIDIA Cosmos Curator and Cosmos Reason, while helping develop AI-driven QA capabilities and agentic workflows for scalable review and defect analysis.

Partner with machine learning, platform, product, and vendor teams to integrate quality processes into data pipelines, communicate risks and tradeoffs, and ensure trusted datasets are delivered to support AI model development.

What You Will Have

Bachelor’s degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Robotics, or a related technical field. 5+ years of experience in data quality engineering, annotation quality assurance, or test automation for computer vision, robotics, autonomous systems, Physical AI, or machine learning environments. Experience leading small technical teams, providing mentorship, setting technical direction, and collaborating with external vendors or distributed teams.

Strong Python development skills with experience building automated validation frameworks, data quality tooling, and production-grade software using modern engineering practices and containerized environments. Experience with annotation platforms (Labelbox, Supervisely, Roboflow, or similar), SQL, data analysis tools, and machine learning evaluation metrics such as precision, recall, IoU, F1, and mAP. Experience validating perception datasets that include camera and LiDAR sensor data and investigating data quality issues across collection, annotation, and processing workflows.

Top Candidates Will Have

Experience with computer vision, robotics, autonomous driving, multimodal AI, Physical AI, and 3D perception systems. Experience evaluating AI-assisted annotation workflows, auto-labeling technologies, agentic AI systems, or LLM/VLM-based quality automation solutions. Familiarity with ML frameworks and tooling such as PyTorch, TensorFlow, ONNX, MLflow, or Weights & Biases. Experience with Vision-Language-Action (VLA) datasets, caption quality evaluation, sensor fusion, and autonomous machine data pipelines.

Experience building human-in-the-loop quality processes, managing annotation vendor performance, and working with cloud-based data platforms and MLOps environments.

Additional Details

This position requires the candidate to work full-time onsite in Irving, TX (Dallas). Domestic relocation assistance is available for this position. Visa sponsorship is available for this position.

Summary

Pay Range: $128,470.00 - $208,770.00 Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.

Benefits

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits. Medical, dental, and vision benefits* Paid time off plan (Vacation, Holidays, Volunteer, etc.)* 401(k) savings plans* Health Savings Account (HSA)* Flexible Spending Accounts (FSAs)* Health Lifestyle Programs* Employee Assistance Program* Voluntary Benefits and Employee Discounts* Career Development* Incentive bonus* Disability benefits Life Insurance Parental leave Adoption benefits Tuition Reimbursement * These benefits also apply to part-time employees Posting Dates: Any offer of employment is conditioned upon the successful completion of a drug screen.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply. Not ready to apply? Join our Talent Community .

More jobs at Caterpillar

Similar jobs at other companies

Quality Assurance Engineer

Lowe's · Mooresville, NC

Engineer II - Software Quality Assurance

BAE Systems · Broomfield, Colorado, United States

Software Design Quality Assurance Engineer

BAE Systems · Huntsville, Alabama, United States

Quality Assurance Systems Engineer

Comfort Systems USA · Houston, TX

OpenNash lists jobs from employers’ own careers sites and does not handle applications. Dates come from the employer where stated; “first seen” and “last checked” are our own observations.