Specialist Software Engineer - Java + React

Job description

MSA Role

Software Engineer / Senior Software Engineer – Databricks & AWS Experience: 5–8 Years Design, develop, and maintain scalable data engineering solutions using Databricks, PySpark, SQL, and Delta Lake. Build and optimize batch and real-time data pipelines on AWS using services such as S3, Lambda, Glue, EMR, Redshift, and related cloud-native components. Develop, implement, and support Delta Live Tables (DLT) pipelines for reliable, high-quality, and auditable data processing.

Work with Unity Catalog to implement data governance, access control, lineage, and security best practices. Develop and optimize ETL/ELT pipelines with a focus on performance tuning, scalability, reliability, and cost efficiency. Implement infrastructure and platform automation using Terraform and Infrastructure as Code (IaC) principles. Build and maintain CI/CD pipelines using Jenkins, Git, and related DevOps tools to enable automated deployments and testing.

Support deployment, monitoring, and maintenance of Databricks workloads across development, testing, and production environments. Collaborate with architects, product owners, data scientists, and business stakeholders to understand requirements and deliver high-quality solutions. Participate in cloud migration, modernization, and data platform transformation initiatives on AWS. Contribute to data quality, observability, logging, monitoring, and alerting frameworks to ensure platform reliability.

Work with APIs, data integration frameworks, and external systems to enable seamless data exchange across platforms. Troubleshoot production issues, perform root cause analysis, and drive continuous improvement initiatives. Follow software engineering best practices, participate in code reviews, and ensure adherence to coding, security, and operational standards. Work effectively within Agile teams, contributing to sprint planning, estimation, development, and release activities.

Collaborate with global teams and support business-critical deliveries across different time zones when required.