Principal Product Manager

Job description

Embed in the post-training loop

work day-to-day with research and applied ML teams during fine-tuning and RLHF cycles, reviewing model outputs and giving structured feedback on quality, tone, and behavior Run RLHF/preference data campaigns: partner with data and labeling teams to scope what human preference data gets collected, for which behaviors, and why

• Build and maintain behavior evals: translate qualitative judgment calls ("this response felt too hedgy," "this refused when it shouldn't have") into evaluation sets that can be tracked release over release
• Own the feedback loop: turn user research, enterprise customer feedback, and production incident learnings into concrete post-training priorities — closing the gap between "users are unhappy with X" and "the next fine-tune addresses X"

Make the tuning tradeoffs explicit

helpfulness vs. caution, consistency vs. personality, latency/cost vs. quality — and drive alignment across research, safety, and product leadership on where the line sits Represent Responsible AI and enterprise requirements into training priorities — compliance behaviors, refusal policies, and brand voice all have to be reflected in what the model is actually tuned to do. Bachelor's

Degree AND 10+ years experience in product/service/program management or software development Bachelor's Degree AND 15+ years experience in product/service/program management or software development OR equivalent experience. 6+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework). 8+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn). 8+ years experience disrupting a market for a product, feature, or experience (e.g., competitive disruption, taking the place of an established competing product).