Lead Software Engineer - AWS automation with Java/Spring Boot, Kubernetes & Spark

Job description

Requisition Title

AWS Automation Expert with Java/Sprint Boot, Kubernetes & Spark Background: As part of the development and maintenance of our Big Data infrastructure on public cloud, we are looking for an experienced administrator to manage, optimize and ensure the availability of a platform focused on Spark and Synapse, with on-premise environments soon to migrate to public cloud solutions such as Snowflake and Databricks.

Level

Middle to Expert Technical skills - Must Have: Development: Java/Springboot, Powershell Java application containerization, AKS application deployment, Docker image creation AWS Kubernetes Service with a focus on its specificities: AWS Identity, CSI, Nodepool, autoscaling, VM spot, etc.

CI/CD & GitOps

Jenkins, ArgoCD, GitHub/Git, Nexus, Harbor Linux & Bash; mastery of security protocols: OAuth, SSL Monitoring: ElasticSearch/Kibana (user level, no administrator role).

Technical skills - Good to Have

Big Data: Spark, Hive Metastore, Hadoop (Hadoop is optional) Notion of Snowflake, Databricks (knowledge of Snowflake and Databricks, particularly in terms of storage, Data Catalog, and Data Federation Relationship skills: Spirit of analysis and synthesis, autonomy and sense of responsibility

• Ability to work as a team and communicate effectively Customer focus and quality of service Main missions: Development of APIs in Java/Spring Facilitating interface with AWS, Application Lifecycle Management (CI/CD)
• Ensure automated deployment and integration of solutions while complying with security requirements of the bank (authorization, authentication, encryption, resilience, AWS policies, etc.)
• Ensure availability, performance, and security of deployed solutions
• Manage incidents and tickets related to the Hadoop infrastructure by providing quality technical support Change management (preparation for change, testing, rollback, coordination with stakeholders, process)
• Participate in the development and monitoring of global production planning
• Set up and maintain technical documentation for internal teams and users
• Participate in task forces to solve complex technical problems
• Support customers in their transitions from on-premises to public cloud
• Work closely with publishers and internal teams
• Ensure technical periodic penalty payments according to the defined schedule