Senior Data Engineer

Qualifications

EXPERIENCE, SKILLS & KNOWLEDGE Required

• 5–8+ years of hands-on data engineering experience, including experience designing pipelines and data models in enterprise environments.
• Strong hands-on expertise in Databricks and Apache Spark for pipeline development and performance tuning.
• Strong SQL and Python development skills.
• Working knowledge of Azure-based cloud data environments.
• Solid experience with Delta Lake and lakehouse reliability patterns.

Preferred

• Experience with SODA or similar data quality and observability tooling.
• Familiarity with Atlan or equivalent catalog/metadata platforms.
• Power BI awareness, with an understanding of downstream reporting needs.
• Prior experience mentoring or informally leading other engineers.

Success Measures

• High-quality, reliable pipeline deliveries with minimal defects, including on complex designs.
• Improved stability and faster recovery from pipeline issues.
• Growing coverage of automated data quality checks across owned pipelines.
• Positive feedback from junior engineers on mentorship and technical guidance.