Software Platform Engineer II

Job description

Description and Requirements

• Design and implement production APIs and microservices in Python (FastAPI, async I/O).
• Build agentic AI workflows and the surrounding harness with LangGraph/LangChain — tool calling, multi‑step orchestration, context & memory management, retries, and guardrails.
• Ship and operate production agents on frontier models (Claude, GPT, Gemini); optimize for latency, cost, and reliability.
• Package, serve, version, and optimize ML/LLM models for low‑latency and batch/async inference (MLflow/LangSmith or equivalent).

Implement LLM features

• embeddings, retrieval‑augmented generation (RAG), vector search, and prompt & context engineering.
• Build resilient event‑driven integrations (Event Hubs/Kafka patterns), idempotent consumers, and backfill/replay strategies.
• Containerize services (Docker), author manifests/Helm charts, and debug Kubernetes (AKS) workloads.
• Instrument services and models (logging, metrics, tracing), define SLOs, and lead incident triage and remediation.
• Deliver automated tests and CI/CD for services and model pipelines; collaborate on release gating and security scans.
• Partner with frontend (React/Next.js/TypeScript) to deliver end‑to‑end AI features.