Big Data Engineer

Job description

Join our data-centric team at SG Group’s Corporate and Investment Banking (CIB) division, working at the heart of the information system. We are responsible for building the new data platform that supports various business processes and interacts with multiple stakeholders. Our team is dedicated to implementing data solutions using the latest big data technologies to support structured finance activities within the GLBA business line.

As a Big Data Engineer (Spark/Scala) based in Warsaw, Poland, you will collaborate with the team in Paris (France) to develop and enhance our financing datahub. You will be instrumental in designing and implementing data solutions, ensuring data quality, and supporting technical projects that drive our digital strategy.

Your future scope of responsibility will cover

Designing and developing solutions for collecting, transforming, and processing large datasets Analyzing data from multiple sources and translating findings into technical specifications Industrializing data processing for reliability, robustness, efficiency, and resilience Developing and implementing data collection, processing jobs, and data mapping using Spark/Scala Conducting code reviews and collaborating with team members for continuous improvement

Contributing to agile feature teams and helping advance agile best practices Delivering IT solutions in Scrum cycles (2-3 weeks) with tangible business value Recommending and contributing to big data architecture strategies Staying up to date with emerging data technologies and implementing best practices Supporting applications and troubleshooting production issues as needed

Ensuring quality and maintainability of code through best development practices (BDD, TDD, clean code, DevOps) Producing technical documentation, test plans, and project deliverables Identifying potential project risks related to costs and deadlines, proposing mitigation strategies when necessary