Pyspark Developer

Job description

Python, PySpark, SPARK, Scala, Hadoop, Hive, Sqoop, Unix, Cloudera, MapR, ETLLead the team from offshore by owning project deliverables & provide technical oversight (For Tech Lead) 2. Experienced in architecting & Developing Big Data solutions (For Tech Lead) 3. Strong understanding of Big Data tools and Apache projects (For Tech Lead, Sr. Developer) 4. Good understanding on performance tuning on Big data technologies (For Tech Lead, Sr.

Developer) 5 Good to have Python and Java background (For Tech Lead, Sr.

Developer) 6 Experience in relational database and data warehousing concept 7 Well versed in Hive QL, Spark QL 8 Create ETL transformation using Hive, Spark 9

• Support development team and testing team in implementing and testing the ETL respectively 10
• Build data quality rule and orchestrate using in house framework 11
• Work with Cloudera/Big Data support for root cause analysis and resolutions 12 Good team player and collaborate with other teams

Qualifications

BACHELOR OF ENGINEERING