[Skip to main content](#main-content) [OpenNash Jobs](https://jobs.opennash.com/) [Hiring report](/reports/hiring/) · [All Tata Consultancy Services jobs](https://jobs.opennash.com/companies/tata-consultancy-services/) · [Search jobs](/search/) Tata Consultancy Services · Visakhapatnam # Azure PySpark Data Engineer Visakhapatnam Data & Analytics Last seen on Tata Consultancy Services’s official careers site on August 1, 2026; it may have closed since. [Apply on Tata Consultancy Services’s careers site →](https://ibegin.tcsapps.com/candidate/next/en-IN/jobs/418259J) [OpenNash Jobs](https://jobs.opennash.com/) / [Tata Consultancy Services](https://jobs.opennash.com/companies/tata-consultancy-services/) / Azure PySpark Data Engineer ## Job description Develop and maintain ETL pipelines using PySpark / Spark SQL in Azure Databricks. Process and transform large-scale financial data for various business and compliance applications. Implement data pipelines ensuring data quality, governance, and lineage tracking. Integrate data from different systems such as core banking, payments, and trading platforms. Optimize Spark jobs for high performance and cost efficiency. Collaborate with business teams and compliance departments to align on project requirements. Apply error handling, logging, and monitoring techniques during pipeline development. Perform advanced data transformations and develop user-defined functions (UDFs) where necessary. Use Unix scripting, scheduling tools, and maintain generic process development and performance tuning. Support audit requirements and ensure compliance with regulatory standards