[Skip to main content](#main-content) [OpenNash Jobs](https://jobs.opennash.com/) [Hiring report](/reports/hiring/) · [All IntercontinentalExchange jobs](https://jobs.opennash.com/companies/intercontinentalexchange/) · [Search jobs](/search/) IntercontinentalExchange · Hyderabad, India # Senior QA Engineer, AI Hyderabad, India Full-time Senior individual contributor Operations Listed on IntercontinentalExchange’s official careers site. Posted October 7, 2026. Check that it is still open and apply there. [Apply on IntercontinentalExchange’s careers site →](https://globalcareers-ice.icims.com/jobs/12759/login) [OpenNash Jobs](https://jobs.opennash.com/) / [IntercontinentalExchange](https://jobs.opennash.com/companies/intercontinentalexchange/) / Senior QA Engineer, AI ## Job description ICE's AI Center of Excellence is looking for a Senior Software Test Engineer to own QA for our AI powered applications. This role works with Systems Analysts, Development, and QA to understand business/product and system requirements and define test scenarios for AI applications, combining core QA fundamentals, Python scripting, and API validation with specialized AI/LLM evaluation skills such as detecting hallucinations, bias, and drift. ### Responsibilities Lead test strategy for AI/ML features: model output validation, regression testing across model/prompt versions, and edge case discovery. Build evaluation frameworks for testing AI outputs for accuracy, consistency, bias, hallucination, and safety/guardrail compliance. Define golden datasets, ground truth labels, and release acceptance criteria with data science and ML engineering. Automate prompt based test suites and model evaluation metrics into CI/CD release gates. Lead and mentor a QA team, setting AI testing standards across projects. Translate AI feature requirements into test scenarios and quality gates. Monitor production of AI behavior and evolve test coverage based on real world failures. - Knowledge and Experience - 8+ years of QA/test engineering experience, including - 3+ years testing AI, ML, or data driven applications. 3+ years of experience with AI/LLM evaluation frameworks: prompt regression, hallucination detection, bias/fairness testing, and model/data drift detection. 5+ years of Python experience for test automation, data analysis, and evaluation scripting. 3+ years of experience with UI automation frameworks (Selenium, Playwright, or Cypress) for AI powered features. Strong SQL and data validation skills for testing the pipelines that feed AI models. ### Working knowledge of ML fundamentals evaluation of metrics, train/validation/test splits, model versioning. ### Experience testing conversational AI/chatbots multi turn dialogue, intent/context handling, and guardrail validation against harmful or adversarial prompts. ### Experience testing REST/GraphQL APIs functional, contract, and schema validation, auth testing, negative/boundary testing, and load testing. ### Experience testing AI applications for infosec prompt injection resistance, data leakage/PII exposure prevention, access control, and secure endpoint authentication, per organizational security policy. Ability to validate AI applications against organizational compliance requirements and frameworks (SOC 2, ISO 27001, NIST AI RMF, GDPR), coordinating with InfoSec and Compliance. Preferred Knowledge and Experience Experience testing RAG systems or autonomous agents. ### Familiarity with responsible AI principles fairness, transparency, safety guardrails. Experience with LLM eval tools such as LangSmith, Ragas, or DeepEval. Exposure cloud AI/ML platforms (AWS SageMaker, Azure ML, or GCP Vertex AI). Experience in financial services, Mortgage or fintech applications. Experience with Git or other version control systems. ## At a glance - Posted by the employer: Oct 7, 2026 - First seen by OpenNash: Jul 11, 2026 - Last checked: Oct 18, 2026 - Listed for: 99 days - Location: Hyderabad, India - Employment type: Full-time[Apply on IntercontinentalExchange’s careers site →](https://globalcareers-ice.icims.com/jobs/12759/login) ## More jobs at IntercontinentalExchange ### [Analyst, Network Operations](https://jobs.opennash.com/companies/intercontinentalexchange/jobs/5df483f9643daf5bbd91/) Hyderabad, India ### [Automation Engineer II](https://jobs.opennash.com/companies/intercontinentalexchange/jobs/7c3c5d535a3b2aa54904/) Hyderabad, India ### [Business Continuity Operations Analyst II](https://jobs.opennash.com/companies/intercontinentalexchange/jobs/54ac1bb94f0e408d6a84/) Hyderabad, India ### [Engineer, Release Engineering](https://jobs.opennash.com/companies/intercontinentalexchange/jobs/7a7f8e0d4db0adb331b8/) Hyderabad, India ### [QA Engineer](https://jobs.opennash.com/companies/intercontinentalexchange/jobs/4bf701c74e4b8180d46f/) Hyderabad, India ## Similar jobs at other companies ### [Test Engineer – HSIO ATE Test Development & Characterization, Engineer to Senior Engineer](https://jobs.opennash.com/companies/qualcomm/jobs/cf40c94f18d6c1f73b5f/) Qualcomm · Hsinchu City, Taiwan ### [【Welcome New Grads】Package/System Design Solutions Engineer - Engineer / Sr. Engineer](https://jobs.opennash.com/companies/qualcomm/jobs/f9102030826588db58c4/) Qualcomm · Hsinchu City, Taiwan ### [Senior / Staff Engineer - Product Engineer](https://jobs.opennash.com/companies/infineon-technologies/jobs/6dd15d624c257699ec75/) Infineon Technologies · Singapore ### [Automation Test Engineer - Senior Systems Engineer](https://jobs.opennash.com/companies/autozone/jobs/41a916502e37e4108140/) AutoZone · India ### [Mechanical Project Engineer (Design Engineer)](https://jobs.opennash.com/companies/siemens/jobs/fdc31e71d029076eed75/) Siemens OpenNash lists jobs from employers’ own careers sites and does not handle applications. Dates come from the employer where stated; “first seen” and “last checked” are our own observations. OpenNash Jobs · Official listings with dates and links to the employer. [Weekly hiring report](/reports/hiring/) · [Methodology](/methodology/)