Bangalore Sr Data Engineer Ka 560076

Job description

Job Overview

Build declarative pipelines (Databricks Lakeflow / DLT) on Medallion Architecture (Bronze → Silver → Gold), delivering governed, audit-ready data products with Unity Catalog lineage, access controls, and CI/CD (Asset Bundles, GitHub Actions). Able to decode SAP ABAP programs (Z-reports, Transaction codes) into modern Databricks pipelines and orchestrate pipelines via Databricks Workflows. Build production grade, reliable ETL/ELT processes using Python / PySpark transformations notebooks in Databricks / DBT Tool to transform, validate and publish data from multiple sources or bronze layers.

Design optimized, scalable and well documented Gold Layers and semantic models (Direct Lake, star-schema, RLS, incremental refresh) for high-performance finance reporting in Microsoft Fabric / Sigma Computing / Databricks. Build AI Integrated Insights on curated Gold-layer finance datasets to enable natural-language analytics for Finance Users. Act as strategic consultants to senior finance stakeholders like elicit requirements, frame problems, build business cases, and produce BRDs, dependency matrix and required documentation.

Establish architecture standards, perform RCA on data and platform issues, close lineage / KPI gaps, and drive structural fixes. Mentor engineers / BI analysts and Finance users on copilots and promoting best practices.

What your background should look like

6-8 years of experience in Data engineering.