[Skip to main content](#main-content)

[ OpenNash ](https://opennash.com/) / [Jobs](https://jobs.opennash.com/) [ 01 Search jobs](https://jobs.opennash.com/search/)[ 02 Companies](https://jobs.opennash.com/explore/)[ 03 Hiring report](https://jobs.opennash.com/reports/hiring/)[ 04 AI assistants](https://jobs.opennash.com/connect/)[ 05 How it works](https://jobs.opennash.com/methodology/)

BMO · Toronto, ON, CAN

# Senior AI Engineer for Observability

Toronto, ON, CAN Hybrid Senior individual contributor $80,000.00 - $175,000.00 Operations 

Listed on BMO’s official careers site. Posted October 22, 2026. Check that it is still open and apply there.
[Apply on BMO’s careers site →](https://bmo.wd3.myworkdayjobs.com/External/job/Toronto-ON-CAN/Senior-AI-Engineer-for-Observability_R260027468)

[OpenNash Jobs](https://jobs.opennash.com/) / [BMO](https://jobs.opennash.com/companies/bmo/) / Senior AI Engineer for Observability

## Job description

### Application Deadline

11/29/2026 Address: 33 Dundas Street West Job Family Group: Data Analytics & Reporting Hybrid role Designs, builds, and maintains systems that track, evaluate, and debug non-deterministic AI models and agent workflows. Trace LLM calls, monitor token usage, detect drift, set up automated evaluations, and govern autonomous agent behaviors in production. Designs and develops machine learning (ML) and deep learning systems.

Runs machine learning tests and experiments. Trains and retrain systems to prevent drift and optimize results. Solves complex problems with multi-layered data sets, extends existing ML frameworks and optimizes existing machine learning libraries. Develops Machine Learning apps, implements algorithms, and builds tools to apply ML frameworks. Turns unstructured data into useful information by auto-tagging images and text-to-speech conversions.

Develops ML algorithms to analyze huge volumes of historical data to make predictions. Runs tests, performs statistical analysis, and interprets test results. Focus is primarily on business/group within BMO; may have broader, enterprise-wide focus. Provides specialized consulting, analytical and technical support. Exercises judgment to identify, diagnose, and solve problems within given rules. Works independently and regularly handles non-routine situations.

Broader work or accountabilities may be assigned as needed. Take measured risks while protecting the bank by applying our Risk Management Framework in the execution of your role, in line with our Risk Culture and within our approved Risk Appetite, making sound and risk informed decisions that align to business strategy, protect assets, and adhere to applicable policy documents (Frameworks, Policies, Standards, Procedures and Supporting documents), laws and regulations.

### Qualifications

Bachelor's Degree in Computer Science, Engineering or other relevant domain 7-10 years experience in Site Reliability Engineering Experience in Artificial Intelligence Observability Engineering, facilitating the ability to Automate Detect, Investigate, and Remediate Exposure to Platform Engineering, building AI capabilities Highly proficient in automation, monitoring, observability, buildouts, AI engineering, understand model architectures, evaluation metrics, token usage, and how to spot concept or data drift Experience using Python for custom evaluations and SQL or LogQL/PromQL for querying telemetry, logs, and metrics data.

Provision, configure, and standardize observability pipelines, logging sidecars, and centralized dashboards using Prometheus, Grafana, Datadog) to track SLIs/SLOs, handle alert fatigue, and run root cause analysis. Exposure to heavily regulated industry organizations Agent & LLM Tracing: Implement OpenTelemetry-based frameworks to capture step-by-step agent trajectories, spans, prompts, tool calls, and intermediate outputs.

### Evaluation & Quality Assurance

Design automated evaluation pipelines for relevance, groundedness, hallucination detection, and prompt adherence using LLM-as-a-judge or custom code.

### Drift & Performance Monitoring

Track model drift, data quality degradation, latency spikes, and error rates across production pipelines.

### Cost & Token Optimization

Build telemetry and sampling strategies to control high data and inference costs, managing log retention and cardinality.

### Agent Governance & Guardrails

Define operational boundaries for autonomous AI agents, setting rules for when they can self-remediate.

### Alert Hygiene & Incident Response

Reduce alert fatigue by replacing static thresholds with dynamic, intelligent anomaly detection and building runbooks for AI failures.

### Salary

$80,000.00 - $175,000.00 Pay Type: Salaried The above represents BMO Financial Group’s pay range and type. Salaries will vary based on factors such as location, skills, experience, education, and qualifications for the role, and may include a commission structure. Salaries for part-time roles will be pro-rated based on number of hours regularly worked. For commission roles, the salary listed above represents BMO Financial Group’s expected target for the first year in this position.

BMO Financial Group’s total compensation package will vary based on the pay type of the position and may include performance-based incentives, discretionary bonuses, as well as other perks and rewards. BMO also offers health insurance, tuition reimbursement, accident and life insurance, and retirement savings plans. To view more details of our benefits, please visit: [https://jobs.bmo.com/global/en/Total-Rewards](https://jobs.bmo.com/global/en/Total-Rewards)

### About Us

At BMO we are driven by a shared Purpose: Boldly Grow the Good in business and life. It calls on us to create lasting, positive change for our customers, our communities and our people. By working together, innovating and pushing boundaries, we transform lives and businesses, and power economic growth around the world. As a member of the BMO team you are valued, respected and heard, and you have more ways to grow and make an impact.

We strive to help you make an impact from day one – for yourself and our customers. We’ll support you with the tools and resources you need to reach new milestones, as you help our customers reach theirs. From in-depth training and coaching, to manager support and network-building opportunities, we’ll help you gain valuable experience, and broaden your skillset. To find out more visit us at [https://jobs.bmo.com/ca/en](https://jobs.bmo.com/ca/en). BMO is committed to an inclusive, equitable and accessible workplace.

By learning from each other’s differences, we gain strength through our people and our perspectives. Accommodations are available on request for candidates taking part in all aspects of the selection process. To request accommodation, please contact your recruiter.

### Note to Recruiters

BMO does not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to BMO, directly or indirectly, will be considered BMO property. BMO will not pay a fee for any placement resulting from the receipt of an unsolicited resume. A recruiting agency must first have a valid, written and fully executed agency agreement contract for service to submit resumes.

## At a glance
- Posted by the employer: Oct 22, 2026
- First seen by OpenNash: Oct 25, 2026
- Last checked: Nov 8, 2026
- Listed for: 17 days
- Location: Toronto, ON, CAN
- Work arrangement: Hybrid
- Pay: $80,000.00 - $175,000.00[Apply on BMO’s careers site →](https://bmo.wd3.myworkdayjobs.com/External/job/Toronto-ON-CAN/Senior-AI-Engineer-for-Observability_R260027468)

## Hiring at BMO
- Open jobs: 1,034
- New in the last 7 days: 257
- Tracked since: Jul 16, 2026

[All BMO jobs](https://jobs.opennash.com/companies/bmo/) · [Weekly hiring report](/reports/hiring/)

## More jobs at BMO

### [Manager, Business Continuity](https://jobs.opennash.com/companies/bmo/jobs/3a057f3a2030460f23c3/)

Toronto, ON, CAN

### [Manager, Business Operations](https://jobs.opennash.com/companies/bmo/jobs/41aaa00ab73323c87df9/)

Toronto, ON, CAN

### [Manager, Digital Strategy & Insights](https://jobs.opennash.com/companies/bmo/jobs/da33ba96d1fb61ae1203/)

Toronto, ON, CAN

### [Manager, Employee and Community Giving Enablement and Operations](https://jobs.opennash.com/companies/bmo/jobs/13802e963e16e827368f/)

Toronto, ON, CAN

### [Platform Engineer RPA and Agentic Automation](https://jobs.opennash.com/companies/bmo/jobs/d8e9c905cd5cbfd6994a/)

Toronto, ON, CAN

## Similar jobs at other companies

### [Enterprise Tools & Observability Engineer (L3)](https://jobs.opennash.com/companies/ntt/jobs/14970bca8bea738f2fb1/)

NTT · Cyberjaya, Selangor, Malaysia

### [Staff Observability Engineer Bengaluru Karnataka India](https://jobs.opennash.com/companies/equinix/jobs/6e187c1482c8ff753557/)

Equinix 

### [SRE Engineer - Observability & Monitoring](https://jobs.opennash.com/companies/genuine-parts/jobs/a7bc3d32600d73aaf5f2/)

Genuine Parts · Krakow, Lesser Poland

### [Senior DevOps Engineer – Observability Platform](https://jobs.opennash.com/companies/qualcomm/jobs/0f23e30919c51a5e63b6/)

Qualcomm · Chennai, Tamil Nādu, India

[Operations jobs](/functions/operations/)

OpenNash lists jobs from employers’ own careers sites and does not handle applications.
Dates come from the employer where stated; “first seen” and “last checked” are our own observations.

[ OpenNash ](https://opennash.com/)

AI-native services firm that builds custom software and 24/7 AI agents.

OpenNash Jobs is an OpenNash Applied AI project.
[Book time with OpenNash](https://calendly.com/opennash/new-meeting?hide_gdpr_banner=1)

Jobs
- [Search jobs](https://jobs.opennash.com/search/)
- [Companies](https://jobs.opennash.com/explore/)
- [Hiring report](https://jobs.opennash.com/reports/hiring/)
- [AI assistants](https://jobs.opennash.com/connect/)
- [How it works](https://jobs.opennash.com/methodology/)

OpenNash
- [opennash.com](https://opennash.com/)
- [Services](https://opennash.com/ai-agent-consulting/)
- [OpenNash CX](https://opennash.com/cx/)
- [AI Tools](https://opennash.com/ai-tools/)
- [Blog](https://opennash.com/blog/)
- [About](https://opennash.com/about/)

Contact
- [hello@opennash.com](mailto:hello@opennash.com)

- [LinkedIn](https://www.linkedin.com/company/opennash)

- [Support](https://jobs.opennash.com/support/)

- [Privacy](https://jobs.opennash.com/privacy/)

- [Terms](https://jobs.opennash.com/terms/)

© 2026 OpenNash, Inc. Company names and public job postings belong to their respective owners. Employers control source availability and application decisions.