Spark/Scala Data Engineer

Job description

Job Title

Spark/Scala Data Engineer Experience : 6-10 years Must Have: Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities: Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to develop code in the corresponding language (see technical skills), test it, and follow up with the implementation into Production environment.

Candidate will also take part in the solution design phase, so experience in analysis requirements is desirable. Technical expert to lead a squad of e ngineers for a Data Product and implement data transformation projects in Hadoop. Candidate will lead a team of 3-5 data engineers with minimum supervision and integrate with wider IT and business project teams.

Good to have: Good exposure to Unix and HDFS commands Experience on Pyspark will be an added advantage Experience working on Data Analytics will be an added advantage. Experience on SAS will be an added advantage <br /

Qualifications

BACHELOR OF ENGINEERING