Spark Scala AWS

Job description

Role

Data engineer (Spark Scala AWS)

Primary skills

Bigdata: 5-6 years of Hands-on experience in Hadoop / Spark (Scala or Python), Hbase, Hive, Sqoop. Knowledge on Database architectures of RDBMS & No-SQL. Good in writing optimized SQL queries which give good performance.

AWS

Working knowledge on Lambda, EC2, ECS, EMR, Athena, S3. Working knowledge on Git/bitbucket.

AWS Debugging

Very good at debugging issues in AWS CloudWatch Hands-on and good coding skills with Scala or Python. Experience in AWS including EMR, EC2, Terraform, Lambda, S3, Cloud watch, VPC Experience in setup of Open shift Containerization Platform and Kubernetes cluster across the cloud platforms. DevSecOps tools such as Ansible, Splunk, Dynatrace, Kubernetes, Confluence, Jenkins High scalability projects involving on-prem and cloud-based Experience with scripting languages Perl, Python, PowerShell, Bash Previous experience testing across multiple platforms (API, web.) Direct hands-on experience with ad hoc query programs (MySQL required, DB2 a plus), automated testing tools, and reporting software.

Experience in Linux Admin

Qualifications

BACHELOR OF TECHNOLOGY