[Skip to main content](#main-content)

[OpenNash Jobs](https://jobs.opennash.com/)
[Hiring report](/reports/hiring/) · [All ServiceNow jobs](https://jobs.opennash.com/companies/servicenow/) · [Search jobs](/search/)

ServiceNow · Hyderabad, Telangana, India

# Senior Research Scientist, Agent Evaluation

Hyderabad, Telangana, India Full-time Senior individual contributor Research & Science 

Listed on ServiceNow’s official careers site. Posted September 29, 2026. Check that it is still open and apply there.
[Apply on ServiceNow’s careers site →](https://jobs.smartrecruiters.com/ServiceNow/744000152324819-senior-research-scientist-agent-evaluation)

[OpenNash Jobs](https://jobs.opennash.com/) / [ServiceNow](https://jobs.opennash.com/companies/servicenow/) / Senior Research Scientist, Agent Evaluation

## Job description

We build the evaluation layer that validates AI agents before they reach customers — an automated system that scores across large volumes of agent traces.

### You'll own core parts of that platform

the pipeline that runs traces through model-based judges at scale, and the scoring logic that turns raw output into results teams can act on.

### What you'll do
- Design evaluation methodologies and benchmarks for agent reasoning, planning, tool use, reliability, and safety — across LLM-as-a-Judge, trajectory-based, and human evaluation
- Take problems from research question to prototype to shipped feature, owning them end to end
- Build and harden the pipelines and scoring logic behind customer-facing evaluation Curate synthetic and real-world datasets; measure the evaluator itself for consistency and agreement with human labels

## Qualifications

What we're looking for 5+ years in ML, applied AI, prompt engineering, agentic AI, including shipping something real to users Strong Python skills Practical depth in agentic AI and context engineering: planning, reasoning, memory, tool use, retrieval, long-context Experience designing evaluation methodologies, not just running evaluations Hands-on production work with LLM APIs — prompt engineering, structured output, cost and latency tradeoffs Clear communication with technical and non-technical audiences Good to have Experience with AI-assisted development tools (Claude code, Windsurf, or similar)

## At a glance
- Posted by the employer: Sep 29, 2026
- First seen by OpenNash: Oct 10, 2026
- Last checked: Oct 17, 2026
- Listed for: 18 days
- Location: Hyderabad, Telangana, India
- Employment type: Full-time[Apply on ServiceNow’s careers site →](https://jobs.smartrecruiters.com/ServiceNow/744000152324819-senior-research-scientist-agent-evaluation)

## More jobs at ServiceNow

### [Senior Research Engineer/Scientist](https://jobs.opennash.com/companies/servicenow/jobs/ae043819c491bf93a9aa/)

Hyderabad, Telangana, India

### [Director, UX Research](https://jobs.opennash.com/companies/servicenow/jobs/9027a6f00d09b99a2605/)

Hyderabad, Telangana, India

### [Senior Infrastructure Developer](https://jobs.opennash.com/companies/servicenow/jobs/6b260ce4d36e7d1b00e5/)

Hyderabad, Telangana, India

### [Senior Product Designer](https://jobs.opennash.com/companies/servicenow/jobs/958c8ab38cc9bfc1e2ce/)

Hyderabad, Telangana, India

### [Senior Software Engineer- Full Stack](https://jobs.opennash.com/companies/servicenow/jobs/acbd267e6aead400d70e/)

Hyderabad, Telangana, India

## Similar jobs at other companies

### [Research Scientist, Model Evaluation](https://jobs.opennash.com/companies/chery-automobile/jobs/b700334e589829251736/)

Chery Automobile · 美国, 加利福尼亚, 旧金山 +3 more

### [Shrimp Senior Research Scientist](https://jobs.opennash.com/companies/cargill/jobs/e27afe3bd9ea6adc50b5/)

Cargill · Guayaquil, Ecuador

### [Research Scientist, Multi-Agent Systems](https://jobs.opennash.com/companies/chery-automobile/jobs/14e4ef2fa2feab33953e/)

Chery Automobile · 美国, 加利福尼亚, 旧金山 +3 more

### [Research Scientist - Software Architecture](https://jobs.opennash.com/companies/hitachi/jobs/59faa3997f15285ae752/)

Hitachi · Kraków, Lesser Poland Voivodeship, Poland

### [Applied Scientist - CoreAI Voice Agent](https://jobs.opennash.com/companies/microsoft/jobs/279505638a84ead5cc4e/)

Microsoft · Canada, British Columbia, Vancouver

OpenNash lists jobs from employers’ own careers sites and does not handle applications.
Dates come from the employer where stated; “first seen” and “last checked” are our own observations.

OpenNash Jobs · Official listings with dates and links to the employer. [Weekly hiring report](/reports/hiring/) · [Methodology](/methodology/)