[Skip to main content](#main-content)

[OpenNash Jobs](https://jobs.opennash.com/)
[Hiring report](/reports/hiring/) · [All Mercedes-Benz Group jobs](https://jobs.opennash.com/companies/mercedes-benz-group/) · [Search jobs](/search/)

Mercedes-Benz Group

# Ai Qa Engineer (Genai And Ml Systems) 241831 Mer00048Yi

Operations 

Listed on Mercedes-Benz Group’s official careers site. Listed as of October 20, 2026. Check that it is still open and apply there.
[Apply on Mercedes-Benz Group’s careers site →](https://jobs.mercedes-benz.com/en/ai-qa-engineer-(genai-and-ml-systems)-241831-mer00048yi)

[OpenNash Jobs](https://jobs.opennash.com/) / [Mercedes-Benz Group](https://jobs.opennash.com/companies/mercedes-benz-group/) / Ai Qa Engineer (Genai And Ml Systems) 241831 Mer00048Yi

## Job description

### Tasks Job Description

AI QA Engineer (GenAI & ML Systems) We hiring an AI QA Engineer to own the quality, reliability and safety of our GenAI and ML-driven engineering applications. You will define how we test non-deterministic systems, from prompts and RAG pipelines to agentic workflows, and set the release bar for AI features used across Powertrain Engineering.

### Key Responsibilities
- Design evaluation frameworks for LLM, RAG and agentic systems: accuracy, hallucination, consistency, latency and cost
- Build golden datasets, regression suites and automated eval pipelines integrated into CI/CD

### Run red-teaming and adversarial tests
- prompt injection, jailbreaks, data leakage, bias and toxicity
- Validate retrieval quality, tool-calling and multi-step agent behavior
- Define quality gates and release criteria for AI features
- Monitor production drift and failure modes; lead root-cause analysis with AI engineers
- Report quality metrics and risks to engineering leadership Qualifications Required Qualifications:
- 4-8 years in QA/SDET, including 1-2+ years testing ML or GenAI systems
- Strong Python and test automation (pytest, API testing)
- Hands-on with LLM evaluation tools such as Ragas, DeepEval, promptfoo or LangSmith
- Working knowledge of LLM behavior, RAG architectures, embeddings and prompt engineering

### Statistical thinking
- sampling, metric design, confidence, and the limits of LLM-as-judge
- CI/CD (GitHub Actions or Azure DevOps), Git and cloud fundamentals (Azure preferred)

### Preferred Qualifications
- Experience with agent frameworks and MCP/tool integrations
- Observability tooling for tracing and drift monitoring

### Exposure to engineering or automotive domains Who Qualifies
- Skeptical by default, precise, comfortable with non-deterministic outputs, a clear writer, and a close collaborator to AI engineers.

### Experience

4-8 years Employment: Full-time

## At a glance
- Posted by the employer: Not stated
- First seen by OpenNash: Oct 13, 2026
- Last checked: Oct 20, 2026
- Listed for: 7 days[Apply on Mercedes-Benz Group’s careers site →](https://jobs.mercedes-benz.com/en/ai-qa-engineer-(genai-and-ml-systems)-241831-mer00048yi)

## More jobs at Mercedes-Benz Group

### [Adas Algorithm Engineer Longitudinal Control 230768 Mer000467Y](https://jobs.opennash.com/companies/mercedes-benz-group/jobs/cf0219f0ea1ff0bcb22c/)

### [Adas Algorithm Engineer Longitudinal Control 234599 Mer00046L8](https://jobs.opennash.com/companies/mercedes-benz-group/jobs/3776265c95bae9dcd1d7/)

### [Adas Algorithm Engineer Plan And Control Evaluation 230769 Mer000467U](https://jobs.opennash.com/companies/mercedes-benz-group/jobs/26de5681f5fd8355fde5/)

### [Adas Driving System Verification And Validation Engineer Digital And Vehicle Testing () 237314 Mer00047Xn](https://jobs.opennash.com/companies/mercedes-benz-group/jobs/6be7b157c31b85a76c66/)

### [Adas System Hil Automation And Simulation Engineer 240361 Mer00048Ry](https://jobs.opennash.com/companies/mercedes-benz-group/jobs/1a5d814ab14d00d9358d/)

## Similar jobs at other companies

### [Senior Systems Engineer (Traction Power Systems)](https://jobs.opennash.com/companies/siemens/jobs/3484b779ddae5ca5ae9f/)

Siemens 

### [Control Systems Engineer](https://jobs.opennash.com/companies/accenture/jobs/7c77ece2f45c888af698/)

Accenture 

### [Systems Engineer III](https://jobs.opennash.com/companies/tesco/jobs/b085dba1ba665b9668ff/)

Tesco 

### [Graduate Power Systems Engineer](https://jobs.opennash.com/companies/siemens/jobs/59509f4db51da9c489a2/)

Siemens 

### [ML Engineer Senior - GenAI Solutions](https://jobs.opennash.com/companies/ntt/jobs/4210295e664e729c2a58/)

NTT · Milan, Italy

OpenNash lists jobs from employers’ own careers sites and does not handle applications.
Dates come from the employer where stated; “first seen” and “last checked” are our own observations.

OpenNash Jobs · Official listings with dates and links to the employer. [Weekly hiring report](/reports/hiring/) · [Methodology](/methodology/)