UC (Unity Catalog) Data Governance & Lineage Lead

Job description

UC (Unity Catalog) Data Governance & Lineage Lead Minimum

• 5+ years data platforms and Data Governance
• 3+ years Databricks and UC (mandatory) Key Responsibilities (R&R)
• Design and implement Databricks Unity Catalog (metastore, catalogs, schemas, RBAC, audit)
• Define and implement BYOL strategy for external lineage (ADF, ingestion frameworks, BI, ETL tools)
• Design metadata models for lineage (objects, relationships, directionality)

Enable end‑to‑end lineage

• Source → ADLS → Bronze/Silver/Gold → Consumption
• Integrate lineage with retry, rerun, reschedule, idempotency scenarios
• Ensure governance meets enterprise audit and compliance expectations
• Act as architecture SPOC for UC/BYOL with customers, Microsoft, Databricks Mandatory Skills (Must‑Have) Databricks Unity Catalog (hands‑on implementation) Databricks Lineage + BYOL concepts Azure Databricks (SQL, Spark) Azure Data Lake Gen2 Entra ID / Azure AD (RBAC, group‑based access)
• Strong understanding of technical and operational lineage Metadata‑driven architecture mindset
• Ability to design lineage beyond Spark (external systems)

Good‑to‑Have Skills Lineage export/import experience from

Informatica (IDMC / PowerCenter) Power BI (dataset → report → semantic model lineage) ADF / orchestration frameworks Experience transforming lineage into JSON / metadata payloads Familiarity with API ‑based metadata ingestion Experience reconciling lineage across multiple tools into a single catalog Optional Exposure to Purview / Collibra / Alation (conceptual mapping only) </ul