Senior Data Engineer

Job description

Must Have Technical/Functional Skills

• Experience developing and supporting database solutions using SQL Server or Azure SQL required.
• Strong proficiency in T-SQL, including query development, performance tuning, and optimization required.
• Hands-on experience using Python for data processing, analytics, or data engineering workflows required.
• Experience with Databricks, Apache Spark, or similar distributed data processing platforms required.
• Understanding of data warehousing concepts, dimensional modeling, and ETL/ELT pipelines required.
• Experience working in Azure cloud environments required.
• Experience with .Net, C#, .Net Core, Angular and AI/ML preferred.
• Strong analytical, problem-solving, and written and verbal communication skills.
• You must be authorized to work in the United States without sponsorship now and in the future.

Roles & Responsibilities

• Design, build, test, and optimize relational database solutions using SQL Server and Azure SQL, including T-SQL queries, stored procedures, and data models.
• Improve database performance, reliability, and scalability through indexing strategies, query tuning, and optimization techniques.
• Develop and maintain scalable Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes to integrate data across cloud-based platforms.
• Build and support data pipelines and workflows using Azure SQL, Databricks, Apache Spark, Python, and PySpark.
• Design and implement relational and dimensional data models, including Slowly Changing Dimension (SCD) patterns.
• Support AI/ML initiatives by developing and maintaining data pipelines and feature datasets used for model training and analytics.
• Utilize Python to enable data preparation, analytics workflows, and experimentation for machine learning use cases.
• Collaborate with data science teams to operationalize models using Spark, ML frameworks, or cloud-based ML services.
• Participate in design discussions, code reviews, and Agile ceremonies to ensure high-quality and maintainable solutions.
• Partner with application developers, data engineers, BI teams, and analytics partners to deliver integrated solutions.
• Troubleshoot production issues, conduct root cause analysis, and implement sustainable resolutions.
• Adhere to data governance, security, and quality standards to ensure compliance and data integrity.

Salary Range

$120,000 -$130,000 year TCS Employee Benefits Summary: Discretionary Annual Incentive.

Comprehensive Medical Coverage

Medical & Health, Dental & Vision, Disability Planning & Insura nce, Pet Insurance Plans.

Family Support

Maternal & Parental Leaves.

Insurance Options

Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth

Commuter Benefits & Certification & amp; Training Reimbursement.

Time Off

Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance

Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing. #LI-SP1 </div

Qualifications

BACHELOR OF COMPUTER SCIENCE