Quality Engineering Lead

Job description

Must Have Technical/Functional Skills

• AI/ML/LLM Quality Engineering experience (testing, validation, evaluation frameworks)
• Expertise in AI evaluation methods (deterministic & non-deterministic systems)
• Validation frameworks, golden datasets, and test harness
• Scalable testing strategies for enterprise AI platforms
• Experience embedding quality practices into AI SDLC / delivery lifecycle
• Model evaluation, monitoring, and continuous quality improvement
• Agent/LLM evaluation and autonomy threshold
• Cross-functional collaboration with engineering, data, and architecture ________________________________________ Roles & Responsibilities
• Build the AI QA function as a dedicated capability within the broader AI delivery organization.
• Define quality engineering practices for AI systems, including evaluation methods for deterministic and non-deterministic outputs.
• Develop, adopt AI for QE capabilities and improve outcomes of the Quality Engineering function using new AI capabilities
• Establish validation criteria, golden datasets, and test harnesses to support safe deployment and continuous model or prompt changes.
• Work with engineering and synthetic data teams to ensure quality controls are embedded into the AI delivery lifecycle.
• Establish baseline KPIs for QE function and incorporate mechanism to track maturity
• Help define thresholds for agent maturity and autonomy, including when systems can move from analysis to decision and action under appropriate oversight.

Salary Range

$130,000- $150,000 a year TCS Employee Benefits Summary: Discretionary Annual Incentive.

Comprehensive Medical Coverage

Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support

Maternal & Parental Leaves.

Insurance Options

Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth

Commuter Benefits & Certification & amp; Training Reimbursement.

Time Off

Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance

Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing. #LI-SP1

Qualifications

BACHELOR OF COMPUTER SCIENCE