Data Engineer

Job description

TCS- WALKIN DRIVE KOLKATA JD

Desired Competencies (Technical / Behavioral Competency ) Must-Have

• Design, develop and implement data pipelines to perform (ETL) from multiple sources into Azure Services.

Experience on Azure Data & Analytics PaaS Services

• Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Stream Analytics and Azure SQL DB, etc.
• Proficiency in programming languages (e.g., Python, SQL, PySpark etc.) and data manipulation tools.
• Manage Azure Data Storage Solutions including Azure Data Lake, different databases.
• Knowledge of DevOps tools
• Manage and monitor the health of data integration processes, troubleshooting
• Experience in Data Migrations (Perform Data Migrations to Azure from on-premises or other platforms)
• Experience with Azure ARM templates, PowerShell and CI/CD using Azure DevOps.
• Experience with exposing data to end-users via Power BI, Azure API Apps.
• Understanding of on-premises and cloud-based data architecture and integration.
• Knowledge of DevOps practices and tools.

Good-to-Have

• Knowledge of integrating different systems

Qualifications

BACHELOR OF ENGINEERING