Kafka Tester

Job description

Skill

Kafka Tester Must Have Technical/Functional Skills: Apache Kafka: Deep understanding of Kafka's architecture, components, and functionality.

SQL

Experience with No SQL database for data validation and debugging. Experience with Mongo DB needed.

ETL

Experience with ETL processes and data warehousing concepts.

Test Automation

Experience in developing and maintaining automated tests for data pipelines using Karate Data Analysis: Ability to analyze data, identify issues, and propose solutions.

Communication

Strong communication and collaboration skills are essential for working with development teams.

Roles & Responsibilities

Data Pipeline Testing: Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data.

Data Validation

Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems.

Kafka Expertise

Hands-on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka's architecture and concepts.

Scripting and Automation

Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts.

Issue Resolution

Collaborating with developers to identify, analyze, and resolve data issues, performing root cause analysis, and proposing solutions.

Performance Testing

Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput.

Agile/Scrum

Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle.

Data Warehousing

Familiarity with data warehousing concepts and cloud data platforms is often a plus. Salary Range - $100,000-$120,000 a year TCS Employee Benefits Summary: Discretionary Annual Incentive.

Comprehensive Medical Coverage

Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support

Maternal & Parental Leaves.

Insurance Options

Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth

Commuter Benefits & Certification & Training Reimbursement.

Time Off

Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance

Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Qualifications

BACHELOR OF COMPUTER SCIENCE