Azure Databricks Engineer

Job description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.Your RoleDesigning and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS.IImplementing data validation and quality frameworks to ensure data reliability.

Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices Working in an Agile/Scrum environment, delivering solutions aligned with business needs.Your ProfileShould have 4 to 12 years of experience in Azure Databricks with strong pyspark experienceExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD pipelines in Data environmentsWhat you’ll love about working hereYou can shape your career with us.

We offer a range of career paths and internal opportunities within Capgemini group. You will also get personalized career guidance from our leaders.You will get comprehensive wellness benefits including health checks, telemedicine, insurance with top-ups, elder care, partner coverage or new parent support via flexible work.You will have the opportunity to learn on one of the industry's largest digital learning platforms, with access to 250,000+ courses and numerous certifications.About CapgeminiCapgemini is an AI-powered global business and technology transformation partner, delivering tangible business value.

We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations.

The Group reported 2024 global revenues of €22.1 billion. Capgemini in India comprises nearly 235,000 team members working across 13 locations: Bangalore, Bhubaneswar, Chennai, Coimbatore, Gandhinagar, Gurugram, Hyderabad, Kolkata, Mumbai, Noida, Pune, Salem, and Tiruchirappalli. Make it real | www.capgemini.com/in-en.