Senior Data Engineer

Job description

Must Have Technical/Functional Skills

• ETL/ELT concepts (pipelines, incremental loads, validation)
• Advanced SQL (CTEs, joins, performance tuning)
• Python (modular code, testing, CI/CD)
• PySpark (distributed processing, optimization)
• Azure Data Factory (pipelines, triggers, monitoring)
• Databricks (Delta Lake, workflows, clusters)
• Azure (ADLS Gen2, Azure SQL, Resource Groups, Portal)
• Pulumi (Infrastructure as Code)
• Azure API Services
• Azure Function Apps Roles & Responsibilities
• Design and build end-to-end data pipelines
• Develop and optimize SQL and PySpark transformations
• Build production-grade Python components
• Create and maintain ADF pipelines
• Work within Azure environments
• Provision Azure resources using Pulumi
• Participate in code reviews, documentation, and operational support Salary Range: $100,000- $120,000 a year TCS Employee Benefits Summary: Discretionary Annual Incentive.

Comprehensive Medical Coverage

Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support

Maternal & Parental Leaves.

Insurance Options

Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth

Commuter Benefits & Certification & amp; Training Reimbursement.

Time Off

Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance

Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing. #LI-SP1

Qualifications

BACHELOR OF COMPUTER SCIENCE