PySpark Developer / Lead

Job description

Role - Pyspark Developer / Lead Experience - 4 to 15 years Location - PAN INDIA Job description Technical/Functional Skills

PySpark

• In-depth knowledge of PySpark, Apache Spark, and Python.

Data Processing

• Strong understanding of data processing concepts, including data ingestion, data transformation, and data storage.

Cloud Experience

• Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud.
• Expertise in DataFrames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines
• Very good conceptual understanding of Multithreading, distributed computing concepts of Pyspark

Programming

• Proficiency in programming languages, including Python, Java, or Scala.

Communication

• Excellent communication and collaboration skills.

Apache Spark Certifications

• Relevant certifications, such as Apache Spark Certification or Cloudera Certified Spark Developer.

Big Data

• Experience with big data technologies, including Hadoop, HBase, or Cassandra.

Machine Learning

• Experience with machine learning frameworks, including TensorFlow, PyTorch, or Scikit-learn.

Data Science

• Experience with data science tools, including Jupyter Notebook, Pandas, or NumPy

Qualifications

BACHELOR OF TECHNOLOGY